Jul 02 14:14:20.917488 ip-10-0-143-132 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 02 14:14:20.917502 ip-10-0-143-132 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 02 14:14:20.917512 ip-10-0-143-132 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 02 14:14:20.917739 ip-10-0-143-132 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 02 14:14:31.012677 ip-10-0-143-132 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 02 14:14:31.012693 ip-10-0-143-132 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ae9f3a4558a946bd8c7d2d539b657621 --
Jul 02 14:16:32.204013 ip-10-0-143-132 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.717984    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722055    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722068    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722072    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722075    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722078    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722081    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722084    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 14:16:32.740334 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722089    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722094    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722097    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722101    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722104    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722107    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722110    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722113    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722116    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722123    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722126    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722130    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722133    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722135    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722138    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722141    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722144    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722146    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722149    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722152    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 14:16:32.741536 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722155    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722158    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722160    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722164    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722167    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722169    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722172    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722175    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722178    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722181    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722184    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722187    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722190    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722193    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722196    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722199    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722202    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722204    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722207    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722210    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 14:16:32.745091 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722212    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722217    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722220    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722223    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722226    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722229    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722232    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722235    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722238    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722241    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722244    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722246    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722249    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722252    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722254    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722258    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722261    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722264    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722267    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 14:16:32.746056 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722269    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722272    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722275    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722278    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722280    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722284    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722286    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722289    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722292    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722295    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722298    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722300    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722303    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722306    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722308    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722311    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722315    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722317    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722321    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 14:16:32.747041 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722324    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722327    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722329    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722332    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722337    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722341    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722344    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722347    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722351    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722356    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722360    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722365    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722369    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.722413    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723214    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723222    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723226    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723229    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723233    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 14:16:32.748979 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723236    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723240    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723245    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723249    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723253    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723257    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723260    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723263    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723266    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723270    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723273    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723276    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723278    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723281    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723285    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723287    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723290    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723293    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723296    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723298    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 14:16:32.749953 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723301    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723305    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723308    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723311    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723313    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723316    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723320    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723325    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723328    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723331    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723334    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723337    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723339    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723342    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723345    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723347    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723350    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723352    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723357    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 14:16:32.752543 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723361    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723365    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723367    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723370    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723373    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723375    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723379    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723382    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723384    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723387    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723390    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723393    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723396    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723398    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723401    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723404    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723407    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723410    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723413    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723416    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 14:16:32.753512 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723419    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723422    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723425    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723428    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723430    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723433    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723436    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723438    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723441    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723443    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723446    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723448    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723451    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723454    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723457    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723460    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723463    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723466    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723473    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723476    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 14:16:32.822973 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723479    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723482    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723485    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723488    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723490    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723493    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723496    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723498    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723501    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723504    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723507    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723510    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723513    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723515    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723518    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723963    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723973    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723978    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723983    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723987    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 14:16:32.823932 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723992    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.723996    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724001    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724005    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724010    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724015    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724019    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724023    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724027    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724030    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724036    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724039    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724042    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724045    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724048    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724052    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724056    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724061    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724066    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 14:16:32.830491 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724070    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724074    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724079    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724084    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724088    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724093    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724098    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724104    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724107    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724110    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724113    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724116    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724119    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724122    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724124    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724127    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724130    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724132    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724135    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724138    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 14:16:32.831679 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724140    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724143    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724146    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724151    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724154    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724157    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724160    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724163    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724165    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724168    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724171    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724173    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724176    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724179    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724181    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724184    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724187    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724190    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724193    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724195    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 14:16:32.832633 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724198    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724203    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724207    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724210    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724213    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724216    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724219    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724223    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724225    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724228    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724231    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724233    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724236    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724239    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724241    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724248    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724251    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724254    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724256    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 14:16:32.834302 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724261    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724264    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724268    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724272    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724275    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724278    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724280    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724283    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724286    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724289    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724291    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724294    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724297    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724299    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724303    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.724305    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724375    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724382    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724388    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724393    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724407    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 14:16:32.835276 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724410    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724414    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724419    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724422    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724426    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724429    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724433    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724439    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724443    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724446    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724449    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724452    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724456    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724460    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724463    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724467    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724470    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724473    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724477    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724481    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724484    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724488    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724491    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724494    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 14:16:32.836462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724497    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724500    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724504    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724509    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724512    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724515    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724518    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724522    2559 flags.go:64] FLAG: --enable-server="true"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724525    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724529    2559 flags.go:64] FLAG: --event-burst="100"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724532    2559 flags.go:64] FLAG: --event-qps="50"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724535    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724539    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724542    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724546    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724551    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724554    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724558    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724561    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724564    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724567    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724571    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724574    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724577    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724580    2559 flags.go:64] FLAG: --feature-gates=""
Jul 02 14:16:32.837639 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724584    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724587    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724599    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724603    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724607    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724610    2559 flags.go:64] FLAG: --help="false"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724613    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-143-132.ec2.internal"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724617    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724620    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724624    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724628    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724632    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724635    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724638    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724641    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724644    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724647    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724651    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724654    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724657    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724660    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724663    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724669    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724672    2559 flags.go:64] FLAG: --lock-file=""
Jul 02 14:16:32.839286 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724675    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724678    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724681    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724687    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724690    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724693    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724696    2559 flags.go:64] FLAG: --logging-format="text"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724699    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724703    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724706    2559 flags.go:64] FLAG: --manifest-url=""
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724708    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724713    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724716    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724721    2559 flags.go:64] FLAG: --max-pods="110"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724737    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724741    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724744    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724747    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724750    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724754    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724757    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724765    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724768    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724771    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 14:16:32.841406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724775    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724778    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724784    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724787    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724791    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724794    2559 flags.go:64] FLAG: --port="10250"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724799    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724804    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-017ef2edb3eb39d91"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724807    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724810    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724814    2559 flags.go:64] FLAG: --register-node="true"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724817    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724821    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724824    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724827    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724830    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724834    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724837    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724840    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724843    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724846    2559 flags.go:64] FLAG: --runonce="false"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724849    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724853    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724856    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724859    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 14:16:32.842402 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724862    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724865    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724869    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724872    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724875    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724878    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724882    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724884    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724888    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724891    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724894    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724900    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724903    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724907    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724913    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724916    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724919    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724922    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724925    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724928    2559 flags.go:64] FLAG: --v="2"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724933    2559 flags.go:64] FLAG: --version="false"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724937    2559 flags.go:64] FLAG: --vmodule=""
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724941    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.724944    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725063    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 14:16:32.843398 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725066    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725070    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725073    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725076    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725078    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725081    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725084    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725087    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725090    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725093    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725095    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725098    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725102    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725104    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725107    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725110    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725112    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725115    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725118    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725121    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 14:16:32.844446 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725126    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725130    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725132    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725135    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725138    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725141    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725143    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725146    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725149    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725152    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725155    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725158    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725160    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725163    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725166    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725170    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725173    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725176    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725179    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 14:16:32.845224 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725182    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725185    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725188    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725191    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725193    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725196    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725199    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725202    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725204    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725207    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725210    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725212    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725215    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725219    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725223    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725226    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725229    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725231    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725234    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 14:16:32.845997 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725237    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725239    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725242    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725247    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725250    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725254    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725257    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725259    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725262    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725265    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725268    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725271    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725275    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725278    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725281    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725283    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725286    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725289    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725292    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 14:16:32.846741 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725295    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725298    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725300    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725303    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725306    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725308    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725312    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725317    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725322    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725325    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725328    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725331    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725334    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725336    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725339    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725342    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725345    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725348    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725350    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725353    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 14:16:32.847506 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.725356    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.726170    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.734619    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.734771    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.736058    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.736066    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736125    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736130    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736134    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736137    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736141    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736144    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736148    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736151    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736154    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 14:16:32.848289 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736157    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736160    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736162    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736165    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736169    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736173    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736177    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736182    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736186    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736190    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736193    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736196    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736199    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736201    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736204    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736207    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736210    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736213    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736216    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 14:16:32.848891 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736220    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736223    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736225    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736228    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736231    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736234    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736236    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736239    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736242    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736245    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736248    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736251    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736254    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736257    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736260    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736263    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736265    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736268    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736271    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736273    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 14:16:32.849610 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736276    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736279    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736282    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736285    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736287    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736290    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736293    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736296    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736298    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736301    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736304    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736308    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736311    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736314    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736317    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736319    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736322    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736325    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736328    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736331    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 14:16:32.850395 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736334    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736338    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736341    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736345    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736348    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736352    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736355    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736358    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736361    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736364    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736367    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736370    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736373    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736376    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736378    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736381    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736384    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736387    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736389    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736392    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 14:16:32.851175 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736395    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736397    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736400    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736406    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736411    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736414    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736417    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736420    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736422    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736425    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736428    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.736433    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736551    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736556    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 14:16:32.851933 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736559    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736563    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736566    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736570    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736573    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736576    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736579    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736583    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736586    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736589    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736592    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736595    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736598    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736601    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736604    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736607    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736610    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736613    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736615    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736618    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 14:16:32.852479 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736621    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736625    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736628    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736632    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736635    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736637    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736640    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736643    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736646    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736650    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736654    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736657    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736660    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736663    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736666    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736669    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736672    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736675    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736678    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 14:16:32.853639 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736681    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736683    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736686    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736689    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736691    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736694    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736713    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736718    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736722    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736726    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736728    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736732    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736734    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736737    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736741    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736744    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736749    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736752    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736755    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736758    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 14:16:32.854160 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736760    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736763    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736766    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736769    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736772    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736774    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736777    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736780    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736783    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736785    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736789    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736792    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736794    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736797    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736800    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736802    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736805    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736808    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736810    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736813    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 14:16:32.854696 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736816    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736818    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736840    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736845    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736849    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736852    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736856    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736859    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736864    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736867    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736869    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736872    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736875    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736879    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736883    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736887    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736890    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 14:16:32.855227 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:32.736893    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 14:16:32.855663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.736898    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 14:16:32.855663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.736998    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 14:16:32.855663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.740478    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 14:16:32.855663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.742638    2559 server.go:1019] "Starting client certificate rotation"
Jul 02 14:16:32.855663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.743450    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 14:16:32.855663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.744194    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 14:16:32.855663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.754914    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 14:16:32.855663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.768541    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 14:16:32.855663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.787027    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 02 14:16:32.855663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.788376    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 14:16:32.855663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.789256    2559 log.go:25] "Validated CRI v1 image API"
Jul 02 14:16:32.855663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.790844    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 14:16:32.855998 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.794943    2559 fs.go:135] Filesystem UUIDs: map[35a7e98f-bc8d-432c-a414-f9002b052de4:/dev/nvme0n1p4 42e4dd9a-e875-4ff4-8242-a6d32f83672b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 02 14:16:32.855998 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.794962    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.800158    2559 manager.go:216] Machine: {Timestamp:2026-07-02 14:16:32.799409933 +0000 UTC m=+0.431302891 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100808 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20a44d60fb3b159e0e95448da1a41a SystemUUID:ec20a44d-60fb-3b15-9e0e-95448da1a41a BootID:ae9f3a45-58a9-46bd-8c7d-2d539b657621 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b2:15:49:dd:0b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b2:15:49:dd:0b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:3c:2e:46:e5:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.800290    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.800421    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.804231    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.804263    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-132.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.804998    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.805010    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.805021    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.805800    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.806621    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.810625    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.810772    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.810803    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.810815    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.810835    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.810847    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.810859    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 14:16:32.856061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.811229    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.811248    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.813897    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.815693    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.815741    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.816359    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.816372    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.816379    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.816384    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.816393    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.816398    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.816624    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.816631    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.816637    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.816642    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.816651    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.816659    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.817679    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 14:16:32.856554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.817686    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 14:16:32.861224 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.861196    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qhqg5"
Jul 02 14:16:32.861224 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.861227    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qhqg5"
Jul 02 14:16:32.863361 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.863344    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-132.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 14:16:32.864139 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:32.864116    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-132.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 14:16:32.864139 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:32.864115    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 14:16:32.864414 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.864400    2559 server.go:1268] "Started kubelet"
Jul 02 14:16:32.864836 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.864792    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 14:16:32.864915 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.864857    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 14:16:32.865126 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.865092    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 14:16:32.865166 ip-10-0-143-132 systemd[1]: Started Kubernetes Kubelet.
Jul 02 14:16:32.879400 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.879316    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 14:16:32.881010 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.880989    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 14:16:32.881109 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:32.881075    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 14:16:32.884421 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:32.883332    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-132.ec2.internal.18be7eaf11909fad  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-132.ec2.internal,UID:ip-10-0-143-132.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-132.ec2.internal,},FirstTimestamp:2026-07-02 14:16:32.864362413 +0000 UTC m=+0.496255345,LastTimestamp:2026-07-02 14:16:32.864362413 +0000 UTC m=+0.496255345,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-132.ec2.internal,}"
Jul 02 14:16:32.886093 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.886073    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 14:16:32.886093 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.886082    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 14:16:32.886812 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:32.886788    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:32.886812 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.886797    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 14:16:32.886954 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.886819    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 14:16:32.886954 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.886822    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 14:16:32.887048 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.886966    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 14:16:32.887048 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.886975    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 14:16:32.888645 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.888621    2559 factory.go:55] Registering systemd factory
Jul 02 14:16:32.888744 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.888678    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 02 14:16:32.888966 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.888951    2559 factory.go:153] Registering CRI-O factory
Jul 02 14:16:32.889005 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.888971    2559 factory.go:223] Registration of the crio container factory successfully
Jul 02 14:16:32.889039 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.889021    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 14:16:32.889071 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.889047    2559 factory.go:103] Registering Raw factory
Jul 02 14:16:32.889071 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.889061    2559 manager.go:1196] Started watching for new ooms in manager
Jul 02 14:16:32.889498 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.889486    2559 manager.go:349] Starting recovery of all containers
Jul 02 14:16:32.898368 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.898351    2559 manager.go:354] Recovery completed
Jul 02 14:16:32.906923 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.906895    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 14:16:32.907647 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.907631    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 14:16:32.909294 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.909273    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 14:16:32.909375 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.909307    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 14:16:32.909375 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.909319    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Jul 02 14:16:32.909794 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.909776    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 14:16:32.909794 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.909791    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 14:16:32.909794 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.909794    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 14:16:32.909974 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.909826    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 14:16:32.910841 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.910820    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 14:16:32.910920 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.910863    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 14:16:32.910920 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.910879    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Jul 02 14:16:32.911026 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.910988    2559 policy_none.go:49] "None policy: Start"
Jul 02 14:16:32.911026 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.911008    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 14:16:32.911122 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.911024    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 14:16:32.912167 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.912139    2559 policy_none.go:47] "Start"
Jul 02 14:16:32.912904 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:32.912887    2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-132.ec2.internal\" not found" node="ip-10-0-143-132.ec2.internal"
Jul 02 14:16:32.951301 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.951287    2559 manager.go:337] "Starting Device Plugin manager"
Jul 02 14:16:32.963438 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:32.951317    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 14:16:32.963438 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.951327    2559 server.go:87] "Starting device plugin registration server"
Jul 02 14:16:32.963438 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.951542    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 14:16:32.963438 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.951552    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 14:16:32.963438 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.951652    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 14:16:32.963438 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.951757    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 14:16:32.963438 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.951768    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 14:16:32.963438 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:32.952837    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 14:16:32.963438 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:32.952899    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:32.964477 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.964458    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 14:16:32.965677 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.965659    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 14:16:32.965785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.965698    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 14:16:32.965785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.965716    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 14:16:32.965785 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:32.965763    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 14:16:32.968167 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:32.968146    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 14:16:33.051933 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.051902    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 14:16:33.053485 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.053472    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 14:16:33.053562 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.053503    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 14:16:33.053562 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.053518    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Jul 02 14:16:33.053562 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.053545    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.061178 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.061164    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.061225 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:33.061185    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-132.ec2.internal\": node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:33.066103 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.066080    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"]
Jul 02 14:16:33.066197 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.066143    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 14:16:33.066888 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.066874    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 14:16:33.066995 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.066905    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 14:16:33.066995 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.066921    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Jul 02 14:16:33.068757 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.068742    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 14:16:33.068874 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.068860    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.068924 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.068892    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 14:16:33.069508 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.069485    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 14:16:33.069508 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.069500    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 14:16:33.069626 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.069514    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 14:16:33.069626 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.069522    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 14:16:33.069626 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.069526    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Jul 02 14:16:33.069626 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.069535    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Jul 02 14:16:33.070835 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.070818    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.070910 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.070844    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 14:16:33.071524 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.071508    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 14:16:33.071600 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.071529    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 14:16:33.071600 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.071542    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeHasSufficientPID"
Jul 02 14:16:33.087471 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:33.087454    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:33.088623 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.088606    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79f80ec7d4a5318d8f15f1326136326f-config\") pod \"kube-apiserver-proxy-ip-10-0-143-132.ec2.internal\" (UID: \"79f80ec7d4a5318d8f15f1326136326f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.088677 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.088632    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d694d21ca18bd065cdf985973787b973-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal\" (UID: \"d694d21ca18bd065cdf985973787b973\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.088677 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.088649    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d694d21ca18bd065cdf985973787b973-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal\" (UID: \"d694d21ca18bd065cdf985973787b973\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.105512 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:33.105491    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-132.ec2.internal\" not found" node="ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.110223 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:33.110208    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-132.ec2.internal\" not found" node="ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.187546 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:33.187489    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:33.189851 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.189833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d694d21ca18bd065cdf985973787b973-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal\" (UID: \"d694d21ca18bd065cdf985973787b973\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.189933 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.189867    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d694d21ca18bd065cdf985973787b973-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal\" (UID: \"d694d21ca18bd065cdf985973787b973\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.189933 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.189894    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79f80ec7d4a5318d8f15f1326136326f-config\") pod \"kube-apiserver-proxy-ip-10-0-143-132.ec2.internal\" (UID: \"79f80ec7d4a5318d8f15f1326136326f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.190026 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.189946    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d694d21ca18bd065cdf985973787b973-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal\" (UID: \"d694d21ca18bd065cdf985973787b973\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.190026 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.189962    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d694d21ca18bd065cdf985973787b973-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal\" (UID: \"d694d21ca18bd065cdf985973787b973\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.190026 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.189965    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/79f80ec7d4a5318d8f15f1326136326f-config\") pod \"kube-apiserver-proxy-ip-10-0-143-132.ec2.internal\" (UID: \"79f80ec7d4a5318d8f15f1326136326f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.287813 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:33.287786    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:33.392109 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:33.392080    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:33.409531 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.409510    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.414176 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.414162    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:33.492905 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:33.492833    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:33.593622 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:33.593592    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:33.694647 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:33.694616    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:33.755332 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.755271    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 14:16:33.755745 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.755423    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 14:16:33.755745 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.755435    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 14:16:33.795296 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:33.795273    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:33.810243 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.810222    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 14:16:33.880320 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.880288    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 14:11:33 +0000 UTC" deadline="2028-04-16 15:21:58.30618547 +0000 UTC"
Jul 02 14:16:33.880320 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:33.880315    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15697h5m24.425873626s"
Jul 02 14:16:33.896185 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:33.896169    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:33.996780 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:33.996761    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:34.085960 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:34.085801    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd694d21ca18bd065cdf985973787b973.slice/crio-218a8aa5f83e20ba767852f94f8c3235b7e0818f2b064e93e8052af3e4179402 WatchSource:0}: Error finding container 218a8aa5f83e20ba767852f94f8c3235b7e0818f2b064e93e8052af3e4179402: Status 404 returned error can't find the container with id 218a8aa5f83e20ba767852f94f8c3235b7e0818f2b064e93e8052af3e4179402
Jul 02 14:16:34.091833 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.091816    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 14:16:34.097707 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:34.097682    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:34.198628 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:34.198605    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:34.298802 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:34.298764    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:34.335756 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:34.335726    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f80ec7d4a5318d8f15f1326136326f.slice/crio-0a423a1d02f6c53bf78a735a571b5a2a14ea3226742fdc7074076cbb9593be8a WatchSource:0}: Error finding container 0a423a1d02f6c53bf78a735a571b5a2a14ea3226742fdc7074076cbb9593be8a: Status 404 returned error can't find the container with id 0a423a1d02f6c53bf78a735a571b5a2a14ea3226742fdc7074076cbb9593be8a
Jul 02 14:16:34.399426 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:34.399405    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-132.ec2.internal\" not found"
Jul 02 14:16:34.401874 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.401859    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 14:16:34.487662 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.487628    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:34.504122 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.504102    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 14:16:34.505255 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.505241    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal"
Jul 02 14:16:34.515276 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.515260    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 14:16:34.813820 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.813738    2559 apiserver.go:52] "Watching apiserver"
Jul 02 14:16:34.824367 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.824330    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 14:16:34.826386 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.826353    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-6wbj8","openshift-multus/network-metrics-daemon-xg2xd","openshift-ovn-kubernetes/ovnkube-node-zphb6","kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal","openshift-cluster-node-tuning-operator/tuned-trqf6","openshift-dns/node-resolver-qz97f","openshift-image-registry/node-ca-t7jl4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal","openshift-multus/multus-additional-cni-plugins-r9zn6","openshift-network-diagnostics/network-check-target-vmzd7","openshift-network-operator/iptables-alerter-7mf5d","kube-system/global-pull-secret-syncer-tntl5","kube-system/konnectivity-agent-krchm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"]
Jul 02 14:16:34.827704 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.827682    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.828892 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.828870    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:34.829923 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.829900    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:34.830031 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:34.829963    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:34.830498 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.830444    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 14:16:34.830701 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.830681    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-58zgp\""
Jul 02 14:16:34.830828 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.830730    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 14:16:34.830828 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.830769    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 14:16:34.830828 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.830821    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 14:16:34.831114 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.831088    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.832009 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.831835    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 14:16:34.832009 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.831914    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n2xxv\""
Jul 02 14:16:34.832009 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.831922    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 14:16:34.832009 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.831944    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 14:16:34.832277 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.832222    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qz97f"
Jul 02 14:16:34.833435 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.833412    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t7jl4"
Jul 02 14:16:34.834154 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.834133    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 14:16:34.834260 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.834187    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s6qtk\""
Jul 02 14:16:34.834390 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.834372    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 14:16:34.834573 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.834554    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 14:16:34.834833 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.834814    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kcc7b\""
Jul 02 14:16:34.834944 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.834861    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:34.835135 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.835031    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 14:16:34.835717 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.835698    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 14:16:34.836232 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.835996    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vtdsj\""
Jul 02 14:16:34.836232 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.836093    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 14:16:34.836306 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.836276    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 14:16:34.837530 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.836862    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.838082 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.838060    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 14:16:34.838178 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.838138    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 14:16:34.839586 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.838847    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7mf5d"
Jul 02 14:16:34.839586 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.839169    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bm92k\""
Jul 02 14:16:34.839586 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.839324    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 14:16:34.839835 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.839614    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 14:16:34.839835 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.839621    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-66drc\""
Jul 02 14:16:34.840416 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.839977    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 14:16:34.840416 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.840099    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 14:16:34.840416 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.840326    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:34.840416 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:34.840395    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:16:34.841162 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.841143    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 14:16:34.841369 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.841352    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 14:16:34.842618 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.842224    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 14:16:34.842618 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.842278    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-krchm"
Jul 02 14:16:34.842618 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.842325    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 14:16:34.842618 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.842361    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 14:16:34.842618 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.842230    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6j9c9\""
Jul 02 14:16:34.843919 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.843900    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:34.844001 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:34.843959    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:16:34.845424 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.845407    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 14:16:34.845786 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.845766    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n4cff\""
Jul 02 14:16:34.845871 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.845855    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 14:16:34.886280 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.886254    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 14:16:34.888093 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.888078    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 14:16:34.900437 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.900414    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 14:16:34.902677 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902652    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-var-lib-openvswitch\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.902777 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-run-ovn-kubernetes\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.902777 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902715    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/618bf971-9ffc-4d84-9af2-649808bc68ba-dbus\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:34.902777 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902756    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/77425abb-cd5c-4da3-87bf-e267d052a799-hosts-file\") pod \"node-resolver-qz97f\" (UID: \"77425abb-cd5c-4da3-87bf-e267d052a799\") " pod="openshift-dns/node-resolver-qz97f"
Jul 02 14:16:34.902926 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902780    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77425abb-cd5c-4da3-87bf-e267d052a799-tmp-dir\") pod \"node-resolver-qz97f\" (UID: \"77425abb-cd5c-4da3-87bf-e267d052a799\") " pod="openshift-dns/node-resolver-qz97f"
Jul 02 14:16:34.902926 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902805    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztcvz\" (UniqueName: \"kubernetes.io/projected/77425abb-cd5c-4da3-87bf-e267d052a799-kube-api-access-ztcvz\") pod \"node-resolver-qz97f\" (UID: \"77425abb-cd5c-4da3-87bf-e267d052a799\") " pod="openshift-dns/node-resolver-qz97f"
Jul 02 14:16:34.902926 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902832    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-sysconfig\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.902926 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902852    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-var-lib-kubelet\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.902926 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902878    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb27d825-0583-4db1-8bee-109bbea38bdf-host\") pod \"node-ca-t7jl4\" (UID: \"bb27d825-0583-4db1-8bee-109bbea38bdf\") " pod="openshift-image-registry/node-ca-t7jl4"
Jul 02 14:16:34.902926 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902903    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53260520-d418-4c07-95c7-d9f3fcf10acb-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:34.902926 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902924    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53260520-d418-4c07-95c7-d9f3fcf10acb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:34.903209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902938    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-run-openvswitch\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.903209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902953    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-os-release\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.903209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.902991    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-var-lib-kubelet\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.903209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903016    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53260520-d418-4c07-95c7-d9f3fcf10acb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:34.903209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d1984103-28cc-405c-b309-308d0d8fe702-ovnkube-script-lib\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.903209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-run-k8s-cni-cncf-io\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.903209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-multus-conf-dir\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.903209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903099    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-run-multus-certs\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.903209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903114    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-etc-kubernetes\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.903209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-sys-fs\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:34.903209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903145    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fnjc\" (UniqueName: \"kubernetes.io/projected/18d6169d-69ba-422f-8da3-d081a07435cf-kube-api-access-2fnjc\") pod \"iptables-alerter-7mf5d\" (UID: \"18d6169d-69ba-422f-8da3-d081a07435cf\") " pod="openshift-network-operator/iptables-alerter-7mf5d"
Jul 02 14:16:34.903209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903160    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-modprobe-d\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.903209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903201    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-host\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903279    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903311    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-run-netns\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903346    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69dh9\" (UniqueName: \"kubernetes.io/projected/d710f0f3-f1db-4002-8898-32316b2800a7-kube-api-access-69dh9\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903375    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18d6169d-69ba-422f-8da3-d081a07435cf-iptables-alerter-script\") pod \"iptables-alerter-7mf5d\" (UID: \"18d6169d-69ba-422f-8da3-d081a07435cf\") " pod="openshift-network-operator/iptables-alerter-7mf5d"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53260520-d418-4c07-95c7-d9f3fcf10acb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903443    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-run-ovn\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903468    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crcs7\" (UniqueName: \"kubernetes.io/projected/d1984103-28cc-405c-b309-308d0d8fe702-kube-api-access-crcs7\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-device-dir\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903550    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-tuned\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903566    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-run-netns\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903596    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-multus-socket-dir-parent\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903625    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl89t\" (UniqueName: \"kubernetes.io/projected/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-kube-api-access-jl89t\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903640    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-sys\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-slash\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.903798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903693    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903713    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-run\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903729    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22dfr\" (UniqueName: \"kubernetes.io/projected/bb27d825-0583-4db1-8bee-109bbea38bdf-kube-api-access-22dfr\") pod \"node-ca-t7jl4\" (UID: \"bb27d825-0583-4db1-8bee-109bbea38bdf\") " pod="openshift-image-registry/node-ca-t7jl4"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1984103-28cc-405c-b309-308d0d8fe702-ovn-node-metrics-cert\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903769    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-system-cni-dir\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903784    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-hostroot\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d710f0f3-f1db-4002-8898-32316b2800a7-multus-daemon-config\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903822    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903839    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvp2x\" (UniqueName: \"kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x\") pod \"network-check-target-vmzd7\" (UID: \"e00643be-d291-4d9d-b372-28467da96c08\") " pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-systemd\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903885    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-lib-modules\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/618bf971-9ffc-4d84-9af2-649808bc68ba-kubelet-config\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903923    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-var-lib-cni-bin\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903945    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/68fdd831-2e75-4b45-b31b-8870d38e0a04-konnectivity-ca\") pod \"konnectivity-agent-krchm\" (UID: \"68fdd831-2e75-4b45-b31b-8870d38e0a04\") " pod="kube-system/konnectivity-agent-krchm"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903967    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-sysctl-d\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903983    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtbqc\" (UniqueName: \"kubernetes.io/projected/53260520-d418-4c07-95c7-d9f3fcf10acb-kube-api-access-dtbqc\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:34.904460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.903998    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d710f0f3-f1db-4002-8898-32316b2800a7-cni-binary-copy\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-kubelet\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d1984103-28cc-405c-b309-308d0d8fe702-ovnkube-config\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904079    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d1984103-28cc-405c-b309-308d0d8fe702-env-overrides\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904098    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd989d3d-cdd0-4e60-b965-9e3e2783d358-tmp\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56kt4\" (UniqueName: \"kubernetes.io/projected/cd989d3d-cdd0-4e60-b965-9e3e2783d358-kube-api-access-56kt4\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904161    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53260520-d418-4c07-95c7-d9f3fcf10acb-system-cni-dir\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904187    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-cni-netd\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904221    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-var-lib-cni-multus\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904254    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-sysctl-conf\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904286    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-node-log\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904310    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-log-socket\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904333    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53260520-d418-4c07-95c7-d9f3fcf10acb-os-release\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904365    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-run-systemd\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904386    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-etc-openvswitch\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904401    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-socket-dir\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:34.905142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-registration-dir\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:34.905874 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904448    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/68fdd831-2e75-4b45-b31b-8870d38e0a04-agent-certs\") pod \"konnectivity-agent-krchm\" (UID: \"68fdd831-2e75-4b45-b31b-8870d38e0a04\") " pod="kube-system/konnectivity-agent-krchm"
Jul 02 14:16:34.905874 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-kubernetes\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:34.905874 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904484    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-cni-bin\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.905874 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcx6f\" (UniqueName: \"kubernetes.io/projected/84655b87-ce0c-4c23-afd6-51d4f4d06657-kube-api-access-bcx6f\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:34.905874 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904543    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-multus-cni-dir\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.905874 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904568    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-cnibin\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:34.905874 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:34.905874 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904605    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18d6169d-69ba-422f-8da3-d081a07435cf-host-slash\") pod \"iptables-alerter-7mf5d\" (UID: \"18d6169d-69ba-422f-8da3-d081a07435cf\") " pod="openshift-network-operator/iptables-alerter-7mf5d"
Jul 02 14:16:34.905874 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb27d825-0583-4db1-8bee-109bbea38bdf-serviceca\") pod \"node-ca-t7jl4\" (UID: \"bb27d825-0583-4db1-8bee-109bbea38bdf\") " pod="openshift-image-registry/node-ca-t7jl4"
Jul 02 14:16:34.905874 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904675    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53260520-d418-4c07-95c7-d9f3fcf10acb-cnibin\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:34.905874 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.904702    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-systemd-units\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:34.924370 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.924347    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lhz9h"
Jul 02 14:16:34.932934 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.932911    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lhz9h"
Jul 02 14:16:34.971055 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.971011    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal" event={"ID":"79f80ec7d4a5318d8f15f1326136326f","Type":"ContainerStarted","Data":"0a423a1d02f6c53bf78a735a571b5a2a14ea3226742fdc7074076cbb9593be8a"}
Jul 02 14:16:34.972194 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:34.972169    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal" event={"ID":"d694d21ca18bd065cdf985973787b973","Type":"ContainerStarted","Data":"218a8aa5f83e20ba767852f94f8c3235b7e0818f2b064e93e8052af3e4179402"}
Jul 02 14:16:35.005341 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005310    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-sys\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.005470 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005352    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-slash\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.005470 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005381    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:35.005557 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005463    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-sys\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.005557 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005475    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-slash\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.005557 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005522    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-run\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.005705 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005564    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22dfr\" (UniqueName: \"kubernetes.io/projected/bb27d825-0583-4db1-8bee-109bbea38bdf-kube-api-access-22dfr\") pod \"node-ca-t7jl4\" (UID: \"bb27d825-0583-4db1-8bee-109bbea38bdf\") " pod="openshift-image-registry/node-ca-t7jl4"
Jul 02 14:16:35.005705 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005592    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1984103-28cc-405c-b309-308d0d8fe702-ovn-node-metrics-cert\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.005705 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005616    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-system-cni-dir\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.005705 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005640    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-hostroot\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.005705 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.005668    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:16:35.005705 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d710f0f3-f1db-4002-8898-32316b2800a7-multus-daemon-config\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.005705 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005701    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.006039 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005728    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvp2x\" (UniqueName: \"kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x\") pod \"network-check-target-vmzd7\" (UID: \"e00643be-d291-4d9d-b372-28467da96c08\") " pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:35.006039 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.005754    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs podName:84655b87-ce0c-4c23-afd6-51d4f4d06657 nodeName:}" failed. No retries permitted until 2026-07-02 14:16:35.505732105 +0000 UTC m=+3.137625038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs") pod "network-metrics-daemon-xg2xd" (UID: "84655b87-ce0c-4c23-afd6-51d4f4d06657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:16:35.006039 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005760    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-run\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.006039 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005786    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-systemd\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.006039 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005809    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-hostroot\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.006039 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-lib-modules\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.006039 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005843    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/618bf971-9ffc-4d84-9af2-649808bc68ba-kubelet-config\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:35.006039 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-var-lib-cni-bin\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.006039 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005919    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.006039 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/68fdd831-2e75-4b45-b31b-8870d38e0a04-konnectivity-ca\") pod \"konnectivity-agent-krchm\" (UID: \"68fdd831-2e75-4b45-b31b-8870d38e0a04\") " pod="kube-system/konnectivity-agent-krchm"
Jul 02 14:16:35.006039 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005973    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-sysctl-d\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.006039 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.005998    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtbqc\" (UniqueName: \"kubernetes.io/projected/53260520-d418-4c07-95c7-d9f3fcf10acb-kube-api-access-dtbqc\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.006039 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006025    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d710f0f3-f1db-4002-8898-32316b2800a7-cni-binary-copy\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006050    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-kubelet\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006073    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d1984103-28cc-405c-b309-308d0d8fe702-ovnkube-config\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006091    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/618bf971-9ffc-4d84-9af2-649808bc68ba-kubelet-config\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006116    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-lib-modules\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006127    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-var-lib-cni-bin\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006213    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-kubelet\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006093    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d1984103-28cc-405c-b309-308d0d8fe702-env-overrides\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006267    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd989d3d-cdd0-4e60-b965-9e3e2783d358-tmp\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006294    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56kt4\" (UniqueName: \"kubernetes.io/projected/cd989d3d-cdd0-4e60-b965-9e3e2783d358-kube-api-access-56kt4\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006322    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53260520-d418-4c07-95c7-d9f3fcf10acb-system-cni-dir\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006348    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-cni-netd\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006377    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-var-lib-cni-multus\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006403    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-sysctl-conf\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006426    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-node-log\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006450    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-log-socket\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53260520-d418-4c07-95c7-d9f3fcf10acb-os-release\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.006502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006479    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d710f0f3-f1db-4002-8898-32316b2800a7-multus-daemon-config\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-run-systemd\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-etc-openvswitch\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006536    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d1984103-28cc-405c-b309-308d0d8fe702-env-overrides\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006505    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-socket-dir\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-registration-dir\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006589    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-systemd\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006608    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/68fdd831-2e75-4b45-b31b-8870d38e0a04-agent-certs\") pod \"konnectivity-agent-krchm\" (UID: \"68fdd831-2e75-4b45-b31b-8870d38e0a04\") " pod="kube-system/konnectivity-agent-krchm"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006631    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-sysctl-d\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006652    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-kubernetes\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006677    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-cni-bin\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcx6f\" (UniqueName: \"kubernetes.io/projected/84655b87-ce0c-4c23-afd6-51d4f4d06657-kube-api-access-bcx6f\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006745    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d1984103-28cc-405c-b309-308d0d8fe702-ovnkube-config\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006847    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-system-cni-dir\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006895    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-kubernetes\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006893    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/68fdd831-2e75-4b45-b31b-8870d38e0a04-konnectivity-ca\") pod \"konnectivity-agent-krchm\" (UID: \"68fdd831-2e75-4b45-b31b-8870d38e0a04\") " pod="kube-system/konnectivity-agent-krchm"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006748    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-multus-cni-dir\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.007188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006945    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-cnibin\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.006998    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53260520-d418-4c07-95c7-d9f3fcf10acb-system-cni-dir\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007010    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-multus-cni-dir\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007058    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-cni-netd\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007095    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-log-socket\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007102    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-var-lib-cni-multus\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007138    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-run-systemd\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007153    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53260520-d418-4c07-95c7-d9f3fcf10acb-os-release\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007239    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-sysctl-conf\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007253    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-socket-dir\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007293    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d710f0f3-f1db-4002-8898-32316b2800a7-cni-binary-copy\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007300    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-etc-openvswitch\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007344    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-node-log\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007353    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-cnibin\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007374    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007400    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-registration-dir\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18d6169d-69ba-422f-8da3-d081a07435cf-host-slash\") pod \"iptables-alerter-7mf5d\" (UID: \"18d6169d-69ba-422f-8da3-d081a07435cf\") " pod="openshift-network-operator/iptables-alerter-7mf5d"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007436    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18d6169d-69ba-422f-8da3-d081a07435cf-host-slash\") pod \"iptables-alerter-7mf5d\" (UID: \"18d6169d-69ba-422f-8da3-d081a07435cf\") " pod="openshift-network-operator/iptables-alerter-7mf5d"
Jul 02 14:16:35.008136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007052    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-cni-bin\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb27d825-0583-4db1-8bee-109bbea38bdf-serviceca\") pod \"node-ca-t7jl4\" (UID: \"bb27d825-0583-4db1-8bee-109bbea38bdf\") " pod="openshift-image-registry/node-ca-t7jl4"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007477    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53260520-d418-4c07-95c7-d9f3fcf10acb-cnibin\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007487    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-etc-selinux\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007497    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-systemd-units\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007524    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-var-lib-openvswitch\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007536    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53260520-d418-4c07-95c7-d9f3fcf10acb-cnibin\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-run-ovn-kubernetes\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/618bf971-9ffc-4d84-9af2-649808bc68ba-dbus\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007580    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-systemd-units\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007595    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/77425abb-cd5c-4da3-87bf-e267d052a799-hosts-file\") pod \"node-resolver-qz97f\" (UID: \"77425abb-cd5c-4da3-87bf-e267d052a799\") " pod="openshift-dns/node-resolver-qz97f"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007615    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77425abb-cd5c-4da3-87bf-e267d052a799-tmp-dir\") pod \"node-resolver-qz97f\" (UID: \"77425abb-cd5c-4da3-87bf-e267d052a799\") " pod="openshift-dns/node-resolver-qz97f"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007620    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-run-ovn-kubernetes\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztcvz\" (UniqueName: \"kubernetes.io/projected/77425abb-cd5c-4da3-87bf-e267d052a799-kube-api-access-ztcvz\") pod \"node-resolver-qz97f\" (UID: \"77425abb-cd5c-4da3-87bf-e267d052a799\") " pod="openshift-dns/node-resolver-qz97f"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007656    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-sysconfig\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007658    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-var-lib-openvswitch\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007702    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-sysconfig\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.009063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007745    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-var-lib-kubelet\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb27d825-0583-4db1-8bee-109bbea38bdf-host\") pod \"node-ca-t7jl4\" (UID: \"bb27d825-0583-4db1-8bee-109bbea38bdf\") " pod="openshift-image-registry/node-ca-t7jl4"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007785    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/618bf971-9ffc-4d84-9af2-649808bc68ba-dbus\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007789    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb27d825-0583-4db1-8bee-109bbea38bdf-serviceca\") pod \"node-ca-t7jl4\" (UID: \"bb27d825-0583-4db1-8bee-109bbea38bdf\") " pod="openshift-image-registry/node-ca-t7jl4"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53260520-d418-4c07-95c7-d9f3fcf10acb-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007822    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53260520-d418-4c07-95c7-d9f3fcf10acb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-run-openvswitch\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007864    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-os-release\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-var-lib-kubelet\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007908    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53260520-d418-4c07-95c7-d9f3fcf10acb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007930    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d1984103-28cc-405c-b309-308d0d8fe702-ovnkube-script-lib\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-run-k8s-cni-cncf-io\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.007974    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-multus-conf-dir\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008002    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-run-multus-certs\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008027    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-etc-kubernetes\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008052    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-sys-fs\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008074    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77425abb-cd5c-4da3-87bf-e267d052a799-tmp-dir\") pod \"node-resolver-qz97f\" (UID: \"77425abb-cd5c-4da3-87bf-e267d052a799\") " pod="openshift-dns/node-resolver-qz97f"
Jul 02 14:16:35.009951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fnjc\" (UniqueName: \"kubernetes.io/projected/18d6169d-69ba-422f-8da3-d081a07435cf-kube-api-access-2fnjc\") pod \"iptables-alerter-7mf5d\" (UID: \"18d6169d-69ba-422f-8da3-d081a07435cf\") " pod="openshift-network-operator/iptables-alerter-7mf5d"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008110    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-modprobe-d\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008157    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/77425abb-cd5c-4da3-87bf-e267d052a799-hosts-file\") pod \"node-resolver-qz97f\" (UID: \"77425abb-cd5c-4da3-87bf-e267d052a799\") " pod="openshift-dns/node-resolver-qz97f"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008183    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-host\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008201    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-modprobe-d\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008207    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008232    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008254    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-run-netns\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008285    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69dh9\" (UniqueName: \"kubernetes.io/projected/d710f0f3-f1db-4002-8898-32316b2800a7-kube-api-access-69dh9\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18d6169d-69ba-422f-8da3-d081a07435cf-iptables-alerter-script\") pod \"iptables-alerter-7mf5d\" (UID: \"18d6169d-69ba-422f-8da3-d081a07435cf\") " pod="openshift-network-operator/iptables-alerter-7mf5d"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008328    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53260520-d418-4c07-95c7-d9f3fcf10acb-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008379    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-host\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008419    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.008489    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.008544    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret podName:618bf971-9ffc-4d84-9af2-649808bc68ba nodeName:}" failed. No retries permitted until 2026-07-02 14:16:35.508528672 +0000 UTC m=+3.140421594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret") pod "global-pull-secret-syncer-tntl5" (UID: "618bf971-9ffc-4d84-9af2-649808bc68ba") : object "kube-system"/"original-pull-secret" not registered
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008558    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53260520-d418-4c07-95c7-d9f3fcf10acb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008581    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-run-netns\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.010710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008609    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-run-openvswitch\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008665    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-os-release\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008705    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-var-lib-kubelet\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008740    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb27d825-0583-4db1-8bee-109bbea38bdf-host\") pod \"node-ca-t7jl4\" (UID: \"bb27d825-0583-4db1-8bee-109bbea38bdf\") " pod="openshift-image-registry/node-ca-t7jl4"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008799    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53260520-d418-4c07-95c7-d9f3fcf10acb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008814    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd989d3d-cdd0-4e60-b965-9e3e2783d358-var-lib-kubelet\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008331    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53260520-d418-4c07-95c7-d9f3fcf10acb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-run-ovn\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crcs7\" (UniqueName: \"kubernetes.io/projected/d1984103-28cc-405c-b309-308d0d8fe702-kube-api-access-crcs7\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008890    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-run-multus-certs\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-device-dir\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.008963    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-host-run-k8s-cni-cncf-io\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009019    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-tuned\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009035    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-sys-fs\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009045    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-etc-kubernetes\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009050    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-run-netns\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-multus-socket-dir-parent\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.012226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009136    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-run-ovn\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.013037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009157    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-multus-socket-dir-parent\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.013037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009172    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d710f0f3-f1db-4002-8898-32316b2800a7-multus-conf-dir\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.013037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009208    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d1984103-28cc-405c-b309-308d0d8fe702-host-run-netns\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.013037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009243    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl89t\" (UniqueName: \"kubernetes.io/projected/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-kube-api-access-jl89t\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.013037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009285    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18d6169d-69ba-422f-8da3-d081a07435cf-iptables-alerter-script\") pod \"iptables-alerter-7mf5d\" (UID: \"18d6169d-69ba-422f-8da3-d081a07435cf\") " pod="openshift-network-operator/iptables-alerter-7mf5d"
Jul 02 14:16:35.013037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009290    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d1984103-28cc-405c-b309-308d0d8fe702-ovnkube-script-lib\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.013037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009404    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-device-dir\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.013037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.009699    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53260520-d418-4c07-95c7-d9f3fcf10acb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.013037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.011459    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd989d3d-cdd0-4e60-b965-9e3e2783d358-tmp\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.013037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.011509    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d1984103-28cc-405c-b309-308d0d8fe702-ovn-node-metrics-cert\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.013037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.011644    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/68fdd831-2e75-4b45-b31b-8870d38e0a04-agent-certs\") pod \"konnectivity-agent-krchm\" (UID: \"68fdd831-2e75-4b45-b31b-8870d38e0a04\") " pod="kube-system/konnectivity-agent-krchm"
Jul 02 14:16:35.013037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.011806    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd989d3d-cdd0-4e60-b965-9e3e2783d358-etc-tuned\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.017258 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.017233    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 14:16:35.017358 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.017263    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 14:16:35.017358 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.017277    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pvp2x for pod openshift-network-diagnostics/network-check-target-vmzd7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:16:35.017358 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.017339    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x podName:e00643be-d291-4d9d-b372-28467da96c08 nodeName:}" failed. No retries permitted until 2026-07-02 14:16:35.5173196 +0000 UTC m=+3.149212543 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pvp2x" (UniqueName: "kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x") pod "network-check-target-vmzd7" (UID: "e00643be-d291-4d9d-b372-28467da96c08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:16:35.018899 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.018875    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtbqc\" (UniqueName: \"kubernetes.io/projected/53260520-d418-4c07-95c7-d9f3fcf10acb-kube-api-access-dtbqc\") pod \"multus-additional-cni-plugins-r9zn6\" (UID: \"53260520-d418-4c07-95c7-d9f3fcf10acb\") " pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.019438 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.019415    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22dfr\" (UniqueName: \"kubernetes.io/projected/bb27d825-0583-4db1-8bee-109bbea38bdf-kube-api-access-22dfr\") pod \"node-ca-t7jl4\" (UID: \"bb27d825-0583-4db1-8bee-109bbea38bdf\") " pod="openshift-image-registry/node-ca-t7jl4"
Jul 02 14:16:35.026927 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.026893    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztcvz\" (UniqueName: \"kubernetes.io/projected/77425abb-cd5c-4da3-87bf-e267d052a799-kube-api-access-ztcvz\") pod \"node-resolver-qz97f\" (UID: \"77425abb-cd5c-4da3-87bf-e267d052a799\") " pod="openshift-dns/node-resolver-qz97f"
Jul 02 14:16:35.027455 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.027428    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fnjc\" (UniqueName: \"kubernetes.io/projected/18d6169d-69ba-422f-8da3-d081a07435cf-kube-api-access-2fnjc\") pod \"iptables-alerter-7mf5d\" (UID: \"18d6169d-69ba-422f-8da3-d081a07435cf\") " pod="openshift-network-operator/iptables-alerter-7mf5d"
Jul 02 14:16:35.027773 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.027752    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcx6f\" (UniqueName: \"kubernetes.io/projected/84655b87-ce0c-4c23-afd6-51d4f4d06657-kube-api-access-bcx6f\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:35.028957 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.028937    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56kt4\" (UniqueName: \"kubernetes.io/projected/cd989d3d-cdd0-4e60-b965-9e3e2783d358-kube-api-access-56kt4\") pod \"tuned-trqf6\" (UID: \"cd989d3d-cdd0-4e60-b965-9e3e2783d358\") " pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.029052 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.028987    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl89t\" (UniqueName: \"kubernetes.io/projected/0fffbb3e-2488-4ca0-8727-bc9f20de18c4-kube-api-access-jl89t\") pod \"aws-ebs-csi-driver-node-97zft\" (UID: \"0fffbb3e-2488-4ca0-8727-bc9f20de18c4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.030063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.030041    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crcs7\" (UniqueName: \"kubernetes.io/projected/d1984103-28cc-405c-b309-308d0d8fe702-kube-api-access-crcs7\") pod \"ovnkube-node-zphb6\" (UID: \"d1984103-28cc-405c-b309-308d0d8fe702\") " pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.031719 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.031668    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69dh9\" (UniqueName: \"kubernetes.io/projected/d710f0f3-f1db-4002-8898-32316b2800a7-kube-api-access-69dh9\") pod \"multus-6wbj8\" (UID: \"d710f0f3-f1db-4002-8898-32316b2800a7\") " pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.140670 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.140586    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6wbj8"
Jul 02 14:16:35.150096 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.150066    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qz97f"
Jul 02 14:16:35.152165 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:35.152129    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd710f0f3_f1db_4002_8898_32316b2800a7.slice/crio-e6d406428f0695f6cc511a3c4779ef1aaeea095f38d51c2fb049545e437ad58c WatchSource:0}: Error finding container e6d406428f0695f6cc511a3c4779ef1aaeea095f38d51c2fb049545e437ad58c: Status 404 returned error can't find the container with id e6d406428f0695f6cc511a3c4779ef1aaeea095f38d51c2fb049545e437ad58c
Jul 02 14:16:35.157800 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.157777    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft"
Jul 02 14:16:35.158074 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:35.158048    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77425abb_cd5c_4da3_87bf_e267d052a799.slice/crio-a867a18078985fabbc9b6e0fcf60f839041986dcf3797a1dac2c8be104bafc5c WatchSource:0}: Error finding container a867a18078985fabbc9b6e0fcf60f839041986dcf3797a1dac2c8be104bafc5c: Status 404 returned error can't find the container with id a867a18078985fabbc9b6e0fcf60f839041986dcf3797a1dac2c8be104bafc5c
Jul 02 14:16:35.163468 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.163432    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trqf6"
Jul 02 14:16:35.166686 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:35.166668    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fffbb3e_2488_4ca0_8727_bc9f20de18c4.slice/crio-1c7279e5f2345716dcf48bacfa84067fa5ee7c0080ef2fe3430cd23470043a32 WatchSource:0}: Error finding container 1c7279e5f2345716dcf48bacfa84067fa5ee7c0080ef2fe3430cd23470043a32: Status 404 returned error can't find the container with id 1c7279e5f2345716dcf48bacfa84067fa5ee7c0080ef2fe3430cd23470043a32
Jul 02 14:16:35.169220 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.169202    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t7jl4"
Jul 02 14:16:35.177040 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.177021    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9zn6"
Jul 02 14:16:35.183804 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.183787    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:16:35.193324 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.193305    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7mf5d"
Jul 02 14:16:35.198891 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.198874    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-krchm"
Jul 02 14:16:35.286947 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.286918    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 14:16:35.336991 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.336805    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 14:16:35.513440 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.513194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:35.513440 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.513259    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:35.513693 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.513493    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 14:16:35.513693 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.513616    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret podName:618bf971-9ffc-4d84-9af2-649808bc68ba nodeName:}" failed. No retries permitted until 2026-07-02 14:16:36.513592633 +0000 UTC m=+4.145485577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret") pod "global-pull-secret-syncer-tntl5" (UID: "618bf971-9ffc-4d84-9af2-649808bc68ba") : object "kube-system"/"original-pull-secret" not registered
Jul 02 14:16:35.513693 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.513615    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:16:35.513891 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.513699    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs podName:84655b87-ce0c-4c23-afd6-51d4f4d06657 nodeName:}" failed. No retries permitted until 2026-07-02 14:16:36.513679936 +0000 UTC m=+4.145572868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs") pod "network-metrics-daemon-xg2xd" (UID: "84655b87-ce0c-4c23-afd6-51d4f4d06657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:16:35.575864 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:35.575826    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd989d3d_cdd0_4e60_b965_9e3e2783d358.slice/crio-10cce74eb3e1ad61ed566a23324c79dc8ba65aa615b41ab5a14f6711fd0f8919 WatchSource:0}: Error finding container 10cce74eb3e1ad61ed566a23324c79dc8ba65aa615b41ab5a14f6711fd0f8919: Status 404 returned error can't find the container with id 10cce74eb3e1ad61ed566a23324c79dc8ba65aa615b41ab5a14f6711fd0f8919
Jul 02 14:16:35.596058 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:35.596028    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53260520_d418_4c07_95c7_d9f3fcf10acb.slice/crio-7344ac2a968d03e566d5e843c9e7e250e9c6f3f5b6f5626752c2b897bf57c500 WatchSource:0}: Error finding container 7344ac2a968d03e566d5e843c9e7e250e9c6f3f5b6f5626752c2b897bf57c500: Status 404 returned error can't find the container with id 7344ac2a968d03e566d5e843c9e7e250e9c6f3f5b6f5626752c2b897bf57c500
Jul 02 14:16:35.598843 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:35.598818    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb27d825_0583_4db1_8bee_109bbea38bdf.slice/crio-3c3054bad32b2235b5ae1cb8d19fef6bd9e351c8ff1c2c44f86419965cda269f WatchSource:0}: Error finding container 3c3054bad32b2235b5ae1cb8d19fef6bd9e351c8ff1c2c44f86419965cda269f: Status 404 returned error can't find the container with id 3c3054bad32b2235b5ae1cb8d19fef6bd9e351c8ff1c2c44f86419965cda269f
Jul 02 14:16:35.599606 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:35.599585    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d6169d_69ba_422f_8da3_d081a07435cf.slice/crio-0e87350f3fc394ac1576dfa795a07757db3da0ae44bc69fab0d9e6351496d9aa WatchSource:0}: Error finding container 0e87350f3fc394ac1576dfa795a07757db3da0ae44bc69fab0d9e6351496d9aa: Status 404 returned error can't find the container with id 0e87350f3fc394ac1576dfa795a07757db3da0ae44bc69fab0d9e6351496d9aa
Jul 02 14:16:35.600585 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:35.600437    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1984103_28cc_405c_b309_308d0d8fe702.slice/crio-e34337342e432e3dfb629a5058b627382a992a3ffa63429d41e5d0b945ed525b WatchSource:0}: Error finding container e34337342e432e3dfb629a5058b627382a992a3ffa63429d41e5d0b945ed525b: Status 404 returned error can't find the container with id e34337342e432e3dfb629a5058b627382a992a3ffa63429d41e5d0b945ed525b
Jul 02 14:16:35.602254 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:16:35.602017    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68fdd831_2e75_4b45_b31b_8870d38e0a04.slice/crio-3aa1f2d134ac00c9fb5bbc102871b6eaff360d946d4105db8b0dde5be8c7d66b WatchSource:0}: Error finding container 3aa1f2d134ac00c9fb5bbc102871b6eaff360d946d4105db8b0dde5be8c7d66b: Status 404 returned error can't find the container with id 3aa1f2d134ac00c9fb5bbc102871b6eaff360d946d4105db8b0dde5be8c7d66b
Jul 02 14:16:35.614005 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.613980    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvp2x\" (UniqueName: \"kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x\") pod \"network-check-target-vmzd7\" (UID: \"e00643be-d291-4d9d-b372-28467da96c08\") " pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:35.614133 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.614118    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 14:16:35.614180 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.614136    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 14:16:35.614180 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.614149    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pvp2x for pod openshift-network-diagnostics/network-check-target-vmzd7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:16:35.614246 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.614204    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x podName:e00643be-d291-4d9d-b372-28467da96c08 nodeName:}" failed. No retries permitted until 2026-07-02 14:16:36.61418525 +0000 UTC m=+4.246078168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvp2x" (UniqueName: "kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x") pod "network-check-target-vmzd7" (UID: "e00643be-d291-4d9d-b372-28467da96c08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:16:35.935456 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.935399    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 14:11:35 +0000 UTC" deadline="2027-12-03 01:54:10.303867746 +0000 UTC"
Jul 02 14:16:35.936021 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.935456    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12443h37m34.368415658s"
Jul 02 14:16:35.966985 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.966952    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:35.967108 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.966963    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:35.967108 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.967086    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:16:35.967218 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:35.967148    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:35.976420 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.976394    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal" event={"ID":"d694d21ca18bd065cdf985973787b973","Type":"ContainerStarted","Data":"bcfc78816c21f5f00eda02949f11850fdf85ba28eae0787fc234f6c6793d8c3d"}
Jul 02 14:16:35.977848 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.977811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6" event={"ID":"d1984103-28cc-405c-b309-308d0d8fe702","Type":"ContainerStarted","Data":"e34337342e432e3dfb629a5058b627382a992a3ffa63429d41e5d0b945ed525b"}
Jul 02 14:16:35.979304 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.979282    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7mf5d" event={"ID":"18d6169d-69ba-422f-8da3-d081a07435cf","Type":"ContainerStarted","Data":"0e87350f3fc394ac1576dfa795a07757db3da0ae44bc69fab0d9e6351496d9aa"}
Jul 02 14:16:35.980573 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.980547    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t7jl4" event={"ID":"bb27d825-0583-4db1-8bee-109bbea38bdf","Type":"ContainerStarted","Data":"3c3054bad32b2235b5ae1cb8d19fef6bd9e351c8ff1c2c44f86419965cda269f"}
Jul 02 14:16:35.981893 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.981865    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9zn6" event={"ID":"53260520-d418-4c07-95c7-d9f3fcf10acb","Type":"ContainerStarted","Data":"7344ac2a968d03e566d5e843c9e7e250e9c6f3f5b6f5626752c2b897bf57c500"}
Jul 02 14:16:35.983155 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.983134    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trqf6" event={"ID":"cd989d3d-cdd0-4e60-b965-9e3e2783d358","Type":"ContainerStarted","Data":"10cce74eb3e1ad61ed566a23324c79dc8ba65aa615b41ab5a14f6711fd0f8919"}
Jul 02 14:16:35.985030 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.984993    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-krchm" event={"ID":"68fdd831-2e75-4b45-b31b-8870d38e0a04","Type":"ContainerStarted","Data":"3aa1f2d134ac00c9fb5bbc102871b6eaff360d946d4105db8b0dde5be8c7d66b"}
Jul 02 14:16:35.986383 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.986355    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft" event={"ID":"0fffbb3e-2488-4ca0-8727-bc9f20de18c4","Type":"ContainerStarted","Data":"1c7279e5f2345716dcf48bacfa84067fa5ee7c0080ef2fe3430cd23470043a32"}
Jul 02 14:16:35.987596 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.987566    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qz97f" event={"ID":"77425abb-cd5c-4da3-87bf-e267d052a799","Type":"ContainerStarted","Data":"a867a18078985fabbc9b6e0fcf60f839041986dcf3797a1dac2c8be104bafc5c"}
Jul 02 14:16:35.989053 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:35.988921    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6wbj8" event={"ID":"d710f0f3-f1db-4002-8898-32316b2800a7","Type":"ContainerStarted","Data":"e6d406428f0695f6cc511a3c4779ef1aaeea095f38d51c2fb049545e437ad58c"}
Jul 02 14:16:36.447546 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:36.447448    2559 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d3135760793a0f16b958eb7c71615b417dd6b0d707b9f31aa5acc0d0df96ecec"
Jul 02 14:16:36.447735 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:36.447585    2559 kuberuntime_manager.go:1459] "Unhandled Error" err="init container egress-router-binary-copy start failed in pod multus-additional-cni-plugins-r9zn6_openshift-multus(53260520-d418-4c07-95c7-d9f3fcf10acb): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 02 14:16:36.447735 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:36.447623    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"egress-router-binary-copy\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-multus/multus-additional-cni-plugins-r9zn6" podUID="53260520-d418-4c07-95c7-d9f3fcf10acb"
Jul 02 14:16:36.523830 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:36.523027    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:36.523830 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:36.523084    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:36.523830 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:36.523229    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:16:36.523830 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:36.523293    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs podName:84655b87-ce0c-4c23-afd6-51d4f4d06657 nodeName:}" failed. No retries permitted until 2026-07-02 14:16:38.523273966 +0000 UTC m=+6.155166886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs") pod "network-metrics-daemon-xg2xd" (UID: "84655b87-ce0c-4c23-afd6-51d4f4d06657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:16:36.523830 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:36.523720    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 14:16:36.523830 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:36.523792    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret podName:618bf971-9ffc-4d84-9af2-649808bc68ba nodeName:}" failed. No retries permitted until 2026-07-02 14:16:38.52377407 +0000 UTC m=+6.155666994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret") pod "global-pull-secret-syncer-tntl5" (UID: "618bf971-9ffc-4d84-9af2-649808bc68ba") : object "kube-system"/"original-pull-secret" not registered
Jul 02 14:16:36.624532 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:36.624493    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvp2x\" (UniqueName: \"kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x\") pod \"network-check-target-vmzd7\" (UID: \"e00643be-d291-4d9d-b372-28467da96c08\") " pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:36.624737 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:36.624680    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 14:16:36.624737 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:36.624705    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 14:16:36.624737 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:36.624716    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pvp2x for pod openshift-network-diagnostics/network-check-target-vmzd7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:16:36.624917 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:36.624784    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x podName:e00643be-d291-4d9d-b372-28467da96c08 nodeName:}" failed. No retries permitted until 2026-07-02 14:16:38.624763924 +0000 UTC m=+6.256656856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvp2x" (UniqueName: "kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x") pod "network-check-target-vmzd7" (UID: "e00643be-d291-4d9d-b372-28467da96c08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:16:36.936126 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:36.936073    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 14:11:35 +0000 UTC" deadline="2028-03-07 21:07:59.084822953 +0000 UTC"
Jul 02 14:16:36.936126 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:36.936117    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14742h51m22.148712534s"
Jul 02 14:16:36.968490 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:36.968383    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:36.968642 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:36.968519    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:16:36.995416 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:36.995381    2559 generic.go:356] "Generic (PLEG): container finished" podID="d694d21ca18bd065cdf985973787b973" containerID="bcfc78816c21f5f00eda02949f11850fdf85ba28eae0787fc234f6c6793d8c3d" exitCode=0
Jul 02 14:16:36.995584 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:36.995472    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal" event={"ID":"d694d21ca18bd065cdf985973787b973","Type":"ContainerDied","Data":"bcfc78816c21f5f00eda02949f11850fdf85ba28eae0787fc234f6c6793d8c3d"}
Jul 02 14:16:37.007892 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:37.007841    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal" event={"ID":"79f80ec7d4a5318d8f15f1326136326f","Type":"ContainerStarted","Data":"b9313b4258c9f015c7a9eea8ef69b6d2fc48062a14041713778b0050d2d97fa4"}
Jul 02 14:16:37.009910 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:37.009574    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"egress-router-binary-copy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d3135760793a0f16b958eb7c71615b417dd6b0d707b9f31aa5acc0d0df96ecec\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-multus/multus-additional-cni-plugins-r9zn6" podUID="53260520-d418-4c07-95c7-d9f3fcf10acb"
Jul 02 14:16:37.047026 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:37.046963    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-132.ec2.internal" podStartSLOduration=2.046941524 podStartE2EDuration="2.046941524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:16:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:16:37.046453851 +0000 UTC m=+4.678346793" watchObservedRunningTime="2026-07-02 14:16:37.046941524 +0000 UTC m=+4.678834468"
Jul 02 14:16:37.966421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:37.966387    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:37.966960 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:37.966516    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:16:37.966960 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:37.966594    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:37.966960 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:37.966665    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:38.016808 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:38.016776    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal" event={"ID":"d694d21ca18bd065cdf985973787b973","Type":"ContainerStarted","Data":"a6db2b3d5c0f9ee348289c4c9218bb3cdf47d5f9bc425600df3f0e2b9488e326"}
Jul 02 14:16:38.539041 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:38.539000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:38.539246 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:38.539067    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:38.539246 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:38.539242    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:16:38.539364 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:38.539302    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs podName:84655b87-ce0c-4c23-afd6-51d4f4d06657 nodeName:}" failed. No retries permitted until 2026-07-02 14:16:42.539283825 +0000 UTC m=+10.171176764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs") pod "network-metrics-daemon-xg2xd" (UID: "84655b87-ce0c-4c23-afd6-51d4f4d06657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:16:38.539747 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:38.539706    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 14:16:38.539864 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:38.539774    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret podName:618bf971-9ffc-4d84-9af2-649808bc68ba nodeName:}" failed. No retries permitted until 2026-07-02 14:16:42.539757906 +0000 UTC m=+10.171650824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret") pod "global-pull-secret-syncer-tntl5" (UID: "618bf971-9ffc-4d84-9af2-649808bc68ba") : object "kube-system"/"original-pull-secret" not registered
Jul 02 14:16:38.639937 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:38.639902    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvp2x\" (UniqueName: \"kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x\") pod \"network-check-target-vmzd7\" (UID: \"e00643be-d291-4d9d-b372-28467da96c08\") " pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:38.640137 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:38.640119    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 14:16:38.640214 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:38.640144    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 14:16:38.640214 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:38.640158    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pvp2x for pod openshift-network-diagnostics/network-check-target-vmzd7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:16:38.640382 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:38.640222    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x podName:e00643be-d291-4d9d-b372-28467da96c08 nodeName:}" failed. No retries permitted until 2026-07-02 14:16:42.640201062 +0000 UTC m=+10.272093989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvp2x" (UniqueName: "kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x") pod "network-check-target-vmzd7" (UID: "e00643be-d291-4d9d-b372-28467da96c08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:16:38.968830 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:38.968230    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:38.968830 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:38.968400    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:16:39.966228 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:39.966188    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:39.966449 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:39.966341    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:16:39.966449 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:39.966424    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:39.966566 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:39.966535    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:40.968884 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:40.968847    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:40.969528 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:40.969001    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:16:41.966843 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:41.966798    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:41.966843 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:41.966839    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:41.967109 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:41.966947    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:16:41.967168 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:41.967101    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:42.576471 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:42.576429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:42.576986 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:42.576488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:42.576986 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:42.576644    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 14:16:42.576986 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:42.576751    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret podName:618bf971-9ffc-4d84-9af2-649808bc68ba nodeName:}" failed. No retries permitted until 2026-07-02 14:16:50.576728231 +0000 UTC m=+18.208621156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret") pod "global-pull-secret-syncer-tntl5" (UID: "618bf971-9ffc-4d84-9af2-649808bc68ba") : object "kube-system"/"original-pull-secret" not registered
Jul 02 14:16:42.576986 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:42.576769    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:16:42.576986 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:42.576827    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs podName:84655b87-ce0c-4c23-afd6-51d4f4d06657 nodeName:}" failed. No retries permitted until 2026-07-02 14:16:50.576811426 +0000 UTC m=+18.208704344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs") pod "network-metrics-daemon-xg2xd" (UID: "84655b87-ce0c-4c23-afd6-51d4f4d06657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:16:42.677942 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:42.677898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvp2x\" (UniqueName: \"kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x\") pod \"network-check-target-vmzd7\" (UID: \"e00643be-d291-4d9d-b372-28467da96c08\") " pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:42.678136 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:42.678062    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 14:16:42.678136 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:42.678092    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 14:16:42.678136 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:42.678106    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pvp2x for pod openshift-network-diagnostics/network-check-target-vmzd7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:16:42.678312 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:42.678170    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x podName:e00643be-d291-4d9d-b372-28467da96c08 nodeName:}" failed. No retries permitted until 2026-07-02 14:16:50.678150252 +0000 UTC m=+18.310043190 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvp2x" (UniqueName: "kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x") pod "network-check-target-vmzd7" (UID: "e00643be-d291-4d9d-b372-28467da96c08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:16:42.967476 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:42.967301    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:42.967476 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:42.967464    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:16:43.967000 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:43.966906    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:43.967460 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:43.967050    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:16:43.967460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:43.967102    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:43.967460 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:43.967196    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:44.966491 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:44.966455    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:44.966726 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:44.966611    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:16:45.965994 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:45.965919    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:45.966371 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:45.965919    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:45.966371 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:45.966041    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:45.966371 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:45.966080    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:16:46.038111 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:46.038079    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t7jl4" event={"ID":"bb27d825-0583-4db1-8bee-109bbea38bdf","Type":"ContainerStarted","Data":"629c3c411346606c25ed72afd46759432e24246ba81c42b456002c11500a9bfb"}
Jul 02 14:16:46.040331 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:46.040213    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trqf6" event={"ID":"cd989d3d-cdd0-4e60-b965-9e3e2783d358","Type":"ContainerStarted","Data":"6210d620da9fa89b3d6d2160e63959700ddea736dc15506adf5cdcac389bc409"}
Jul 02 14:16:46.042746 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:46.042707    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-krchm" event={"ID":"68fdd831-2e75-4b45-b31b-8870d38e0a04","Type":"ContainerStarted","Data":"f997d213619f7252e2f33e82ac678ad3476d529f649bebe74e0ca9dfa434575a"}
Jul 02 14:16:46.044629 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:46.044588    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft" event={"ID":"0fffbb3e-2488-4ca0-8727-bc9f20de18c4","Type":"ContainerStarted","Data":"ca7798e6fa1db958eb59dbb653581e567269abc61e47f370bb7162a9551d801b"}
Jul 02 14:16:46.046344 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:46.046321    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qz97f" event={"ID":"77425abb-cd5c-4da3-87bf-e267d052a799","Type":"ContainerStarted","Data":"ad9a05a2566aa69a2115146501d72827a6c5965006b06d9b8150d5732a7ff6c4"}
Jul 02 14:16:46.057609 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:46.057550    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t7jl4" podStartSLOduration=2.21588838 podStartE2EDuration="12.057528276s" totalImagesPullingTime="9.841639896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:16:46.056844934 +0000 UTC m=+13.688737873" watchObservedRunningTime="2026-07-02 14:16:46.057528276 +0000 UTC m=+13.689421281"
Jul 02 14:16:46.057818 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:46.057668    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-132.ec2.internal" podStartSLOduration=11.057662001 podStartE2EDuration="11.057662001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:16:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:16:38.034983561 +0000 UTC m=+5.666876507" watchObservedRunningTime="2026-07-02 14:16:46.057662001 +0000 UTC m=+13.689554937"
Jul 02 14:16:46.073512 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:46.073452    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-krchm" podStartSLOduration=1.971354718 podStartE2EDuration="12.073429543s" totalImagesPullingTime="10.102074825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:16:46.072991241 +0000 UTC m=+13.704884206" watchObservedRunningTime="2026-07-02 14:16:46.073429543 +0000 UTC m=+13.705322482"
Jul 02 14:16:46.093608 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:46.093552    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-trqf6" podStartSLOduration=2.239967244 podStartE2EDuration="12.093533404s" totalImagesPullingTime="9.85356616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:16:46.093018731 +0000 UTC m=+13.724911676" watchObservedRunningTime="2026-07-02 14:16:46.093533404 +0000 UTC m=+13.725426343"
Jul 02 14:16:46.110745 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:46.110682    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qz97f" podStartSLOduration=1.821645542 podStartE2EDuration="12.11064253s" totalImagesPullingTime="10.288996988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:16:46.109893819 +0000 UTC m=+13.741786778" watchObservedRunningTime="2026-07-02 14:16:46.11064253 +0000 UTC m=+13.742535468"
Jul 02 14:16:46.966279 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:46.966237    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:46.966697 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:46.966404    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:16:47.050635 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:47.050592    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7mf5d" event={"ID":"18d6169d-69ba-422f-8da3-d081a07435cf","Type":"ContainerStarted","Data":"2480aba0963738268ebc3e533f5343db7c53779fe07fb274ada4181241a5d06b"}
Jul 02 14:16:47.073161 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:47.073099    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7mf5d" podStartSLOduration=3.232424156 podStartE2EDuration="13.073078016s" totalImagesPullingTime="9.84065386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:16:47.072712555 +0000 UTC m=+14.704605494" watchObservedRunningTime="2026-07-02 14:16:47.073078016 +0000 UTC m=+14.704970951"
Jul 02 14:16:47.806348 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:47.806316    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-krchm"
Jul 02 14:16:47.807034 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:47.807013    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-krchm"
Jul 02 14:16:47.966848 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:47.966811    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:47.967322 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:47.966821    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:47.967322 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:47.966930    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:47.967322 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:47.967023    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:16:48.966281 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:48.966243    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:48.966468 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:48.966387    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:16:49.055144 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:49.055115    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 14:16:49.966328 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:49.966287    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:49.966590 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:49.966287    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:49.966590 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:49.966424    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:49.966590 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:49.966543    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:16:50.642409 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:50.642192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:50.642879 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:50.642431    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:50.642879 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:50.642355    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 14:16:50.642879 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:50.642540    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:16:50.642879 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:50.642542    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret podName:618bf971-9ffc-4d84-9af2-649808bc68ba nodeName:}" failed. No retries permitted until 2026-07-02 14:17:06.64251925 +0000 UTC m=+34.274412186 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret") pod "global-pull-secret-syncer-tntl5" (UID: "618bf971-9ffc-4d84-9af2-649808bc68ba") : object "kube-system"/"original-pull-secret" not registered
Jul 02 14:16:50.642879 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:50.642595    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs podName:84655b87-ce0c-4c23-afd6-51d4f4d06657 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:06.642579339 +0000 UTC m=+34.274472257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs") pod "network-metrics-daemon-xg2xd" (UID: "84655b87-ce0c-4c23-afd6-51d4f4d06657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:16:50.743452 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:50.743411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvp2x\" (UniqueName: \"kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x\") pod \"network-check-target-vmzd7\" (UID: \"e00643be-d291-4d9d-b372-28467da96c08\") " pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:50.743623 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:50.743591    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 14:16:50.743623 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:50.743616    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 14:16:50.743729 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:50.743630    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pvp2x for pod openshift-network-diagnostics/network-check-target-vmzd7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:16:50.743729 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:50.743712    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x podName:e00643be-d291-4d9d-b372-28467da96c08 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:06.743691918 +0000 UTC m=+34.375584846 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvp2x" (UniqueName: "kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x") pod "network-check-target-vmzd7" (UID: "e00643be-d291-4d9d-b372-28467da96c08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:16:50.966502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:50.966421    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:50.966677 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:50.966552    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:16:51.966430 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:51.966399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:51.966924 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:51.966400    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:51.966924 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:51.966519    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:16:51.966924 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:51.966614    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:52.966627 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:52.966595    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:52.967066 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:52.966730    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:16:53.966885 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:53.966846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:53.967386 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:53.966855    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:53.967386 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:53.966960    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:53.967386 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:53.967071    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:16:54.635494 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:54.635469    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 14:16:54.961935 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:54.961584    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T14:16:54.635490707Z","UUID":"6f19dee8-689e-4b6c-94df-6eb04ae62db8","Handler":null,"Name":"","Endpoint":""}
Jul 02 14:16:54.963507 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:54.963455    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 14:16:54.963663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:54.963514    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 14:16:54.966189 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:54.966169    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:54.966357 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:54.966331    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:16:55.068729 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:55.068696    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft" event={"ID":"0fffbb3e-2488-4ca0-8727-bc9f20de18c4","Type":"ContainerStarted","Data":"0851d171aa1363b24a3bbc4d41967c28476e2a83b75347f1abd2c357998aaa84"}
Jul 02 14:16:55.070727 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:55.070687    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6wbj8" event={"ID":"d710f0f3-f1db-4002-8898-32316b2800a7","Type":"ContainerStarted","Data":"e1bcb659bb79478019458b39170c7c3554c5b01b02fc75e5cc3462884c1de20c"}
Jul 02 14:16:55.074275 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:55.074251    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6" event={"ID":"d1984103-28cc-405c-b309-308d0d8fe702","Type":"ContainerStarted","Data":"711655f4254fc423cb478f0c0942a14c733b6fead38a8a8d07d255134c1a337f"}
Jul 02 14:16:55.074376 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:55.074341    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6" event={"ID":"d1984103-28cc-405c-b309-308d0d8fe702","Type":"ContainerStarted","Data":"be8427d1b13999b9e4c52e7aef1dbc80dd14c4cca7abb41a764b54548eef5c24"}
Jul 02 14:16:55.074425 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:55.074391    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6" event={"ID":"d1984103-28cc-405c-b309-308d0d8fe702","Type":"ContainerStarted","Data":"75bd598960a80337e57bd7fdcf4552b86175247a676c2cadda5c97df40328c4c"}
Jul 02 14:16:55.074425 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:55.074424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6" event={"ID":"d1984103-28cc-405c-b309-308d0d8fe702","Type":"ContainerStarted","Data":"034a8db6340b94e7cff5afe40066fa61a6ac9669222fa6d53f1af190e4367095"}
Jul 02 14:16:55.074491 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:55.074451    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6" event={"ID":"d1984103-28cc-405c-b309-308d0d8fe702","Type":"ContainerStarted","Data":"e28dbea6670d4f615f6b1000ffe5ac58d56a6252d23dc643bb2f58f31e07fe73"}
Jul 02 14:16:55.074491 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:55.074478    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6" event={"ID":"d1984103-28cc-405c-b309-308d0d8fe702","Type":"ContainerStarted","Data":"e573f616056671ec030ffd3ba6ad26e2e21390106ef98dc5775a963eb2461c4d"}
Jul 02 14:16:55.095449 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:55.095392    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6wbj8" podStartSLOduration=2.75834771 podStartE2EDuration="22.095374893s" totalImagesPullingTime="19.337027183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:16:55.095286386 +0000 UTC m=+22.727179327" watchObservedRunningTime="2026-07-02 14:16:55.095374893 +0000 UTC m=+22.727267833"
Jul 02 14:16:55.966332 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:55.966298    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:55.966708 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:55.966341    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:55.966708 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:55.966426    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:55.966708 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:55.966519    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:16:56.967015 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:56.966936    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:56.967372 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:56.967072    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:16:57.079565 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:57.079534    2559 generic.go:356] "Generic (PLEG): container finished" podID="53260520-d418-4c07-95c7-d9f3fcf10acb" containerID="9dfa2bdaffaa4a3a5749a80e93ba90486973cb472c6c91c87b36e32f69264f26" exitCode=0
Jul 02 14:16:57.079715 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:57.079606    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9zn6" event={"ID":"53260520-d418-4c07-95c7-d9f3fcf10acb","Type":"ContainerDied","Data":"9dfa2bdaffaa4a3a5749a80e93ba90486973cb472c6c91c87b36e32f69264f26"}
Jul 02 14:16:57.084087 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:57.084059    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft" event={"ID":"0fffbb3e-2488-4ca0-8727-bc9f20de18c4","Type":"ContainerStarted","Data":"72d10e4740f8088b9512b85db0ddae9524dd27a46a96f47fef425fc3a13c57d6"}
Jul 02 14:16:57.129370 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:57.129329    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97zft" podStartSLOduration=3.228156153 podStartE2EDuration="24.129314616s" totalImagesPullingTime="20.901158463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:16:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:16:57.128871012 +0000 UTC m=+24.760763949" watchObservedRunningTime="2026-07-02 14:16:57.129314616 +0000 UTC m=+24.761207553"
Jul 02 14:16:57.965990 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:57.965959    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:57.966131 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:57.966073    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:16:57.966131 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:57.966114    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:57.966322 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:57.966192    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:58.089359 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:58.089323    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6" event={"ID":"d1984103-28cc-405c-b309-308d0d8fe702","Type":"ContainerStarted","Data":"dd6e4ac1fed567e6bdb15c15346c2b510b050a0207e5df8e96ad264085e43b58"}
Jul 02 14:16:58.966472 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:58.966433    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:16:58.966708 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:58.966589    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:16:59.966252 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:59.966221    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:16:59.967144 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:16:59.966220    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:16:59.967144 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:59.966354    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:16:59.967144 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:16:59.966422    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:17:00.098132 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:00.098055    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6" event={"ID":"d1984103-28cc-405c-b309-308d0d8fe702","Type":"ContainerStarted","Data":"a314bdc32b4761aef0018abddcac60c0aab502977a5b3a5d09c3908ce420ca3b"}
Jul 02 14:17:00.098447 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:00.098427    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:17:00.098556 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:00.098521    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:17:00.098689 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:00.098641    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:17:00.116593 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:00.116563    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:17:00.116880 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:00.116848    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:17:00.133429 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:00.133372    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6" podStartSLOduration=7.195733336 podStartE2EDuration="26.133353153s" totalImagesPullingTime="18.937619817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:17:00.132305743 +0000 UTC m=+27.764198706" watchObservedRunningTime="2026-07-02 14:17:00.133353153 +0000 UTC m=+27.765246094"
Jul 02 14:17:00.966802 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:00.966532    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:17:00.967230 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:00.966946    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:17:01.461175 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:01.461138    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tntl5"]
Jul 02 14:17:01.461347 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:01.461262    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:17:01.461419 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:01.461394    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:17:01.466807 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:01.466134    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xg2xd"]
Jul 02 14:17:01.466807 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:01.466240    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vmzd7"]
Jul 02 14:17:01.466807 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:01.466332    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:17:01.466807 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:01.466446    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:17:01.466807 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:01.466523    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:17:01.466807 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:01.466636    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:17:02.966925 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:02.966901    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:17:02.967308 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:02.967002    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:17:02.967308 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:02.967090    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:17:02.967308 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:02.967219    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:17:02.967308 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:02.967302    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:17:02.967470 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:02.967403    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:17:03.106522 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:03.106487    2559 generic.go:356] "Generic (PLEG): container finished" podID="53260520-d418-4c07-95c7-d9f3fcf10acb" containerID="9f14787c716f96b4d4ae0d1699d3add21f6108d8cb56ac0e773d0c643d835546" exitCode=0
Jul 02 14:17:03.106663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:03.106529    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9zn6" event={"ID":"53260520-d418-4c07-95c7-d9f3fcf10acb","Type":"ContainerDied","Data":"9f14787c716f96b4d4ae0d1699d3add21f6108d8cb56ac0e773d0c643d835546"}
Jul 02 14:17:04.384809 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:04.384783    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-krchm"
Jul 02 14:17:04.385160 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:04.384933    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 02 14:17:04.385365 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:04.385346    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-krchm"
Jul 02 14:17:04.966016 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:04.965975    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:17:04.966177 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:04.965975    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:17:04.966177 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:04.966101    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:17:04.966177 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:04.966097    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:17:04.966296 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:04.966205    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:17:04.966296 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:04.966259    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:17:05.112867 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:05.112836    2559 generic.go:356] "Generic (PLEG): container finished" podID="53260520-d418-4c07-95c7-d9f3fcf10acb" containerID="953fe80a4002e6152c3fac4f778993ed78d0bda29dacf167756adc137a5b8c56" exitCode=0
Jul 02 14:17:05.113003 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:05.112909    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9zn6" event={"ID":"53260520-d418-4c07-95c7-d9f3fcf10acb","Type":"ContainerDied","Data":"953fe80a4002e6152c3fac4f778993ed78d0bda29dacf167756adc137a5b8c56"}
Jul 02 14:17:06.656330 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:06.656148    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:17:06.656715 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:06.656345    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:17:06.656715 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:06.656303    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 14:17:06.656715 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:06.656428    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:17:06.656715 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:06.656449    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret podName:618bf971-9ffc-4d84-9af2-649808bc68ba nodeName:}" failed. No retries permitted until 2026-07-02 14:17:38.656434437 +0000 UTC m=+66.288327353 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret") pod "global-pull-secret-syncer-tntl5" (UID: "618bf971-9ffc-4d84-9af2-649808bc68ba") : object "kube-system"/"original-pull-secret" not registered
Jul 02 14:17:06.656715 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:06.656468    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs podName:84655b87-ce0c-4c23-afd6-51d4f4d06657 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:38.656457246 +0000 UTC m=+66.288350162 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs") pod "network-metrics-daemon-xg2xd" (UID: "84655b87-ce0c-4c23-afd6-51d4f4d06657") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 14:17:06.757459 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:06.757433    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvp2x\" (UniqueName: \"kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x\") pod \"network-check-target-vmzd7\" (UID: \"e00643be-d291-4d9d-b372-28467da96c08\") " pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:17:06.757622 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:06.757554    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 14:17:06.757622 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:06.757568    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 14:17:06.757622 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:06.757579    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pvp2x for pod openshift-network-diagnostics/network-check-target-vmzd7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:17:06.757756 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:06.757639    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x podName:e00643be-d291-4d9d-b372-28467da96c08 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:38.757626626 +0000 UTC m=+66.389519556 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pvp2x" (UniqueName: "kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x") pod "network-check-target-vmzd7" (UID: "e00643be-d291-4d9d-b372-28467da96c08") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 14:17:06.966316 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:06.966289    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:17:06.966451 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:06.966320    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:17:06.966451 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:06.966407    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:17:06.966451 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:06.966419    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tntl5" podUID="618bf971-9ffc-4d84-9af2-649808bc68ba"
Jul 02 14:17:06.966591 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:06.966509    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xg2xd" podUID="84655b87-ce0c-4c23-afd6-51d4f4d06657"
Jul 02 14:17:06.966632 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:06.966598    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmzd7" podUID="e00643be-d291-4d9d-b372-28467da96c08"
Jul 02 14:17:07.116979 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.116897    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-132.ec2.internal" event="NodeReady"
Jul 02 14:17:07.117117 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.117034    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 14:17:07.119521 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.119500    2559 generic.go:356] "Generic (PLEG): container finished" podID="53260520-d418-4c07-95c7-d9f3fcf10acb" containerID="4371dfa51debd47b0f735d2361939362e28a48e3c24ce8faae4e205383f6402b" exitCode=0
Jul 02 14:17:07.119627 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.119532    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9zn6" event={"ID":"53260520-d418-4c07-95c7-d9f3fcf10acb","Type":"ContainerDied","Data":"4371dfa51debd47b0f735d2361939362e28a48e3c24ce8faae4e205383f6402b"}
Jul 02 14:17:07.157767 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.157728    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-87d9c4c4d-s7r5c"]
Jul 02 14:17:07.182725 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.182696    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5zfzw"]
Jul 02 14:17:07.182870 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.182845    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.185477 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.185408    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 14:17:07.185616 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.185526    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hxdbc\""
Jul 02 14:17:07.185616 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.185535    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 14:17:07.185616 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.185596    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 14:17:07.191350 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.191154    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 14:17:07.198785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.198756    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sw4qm"]
Jul 02 14:17:07.198927 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.198846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5zfzw"
Jul 02 14:17:07.201228 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.201207    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 14:17:07.201334 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.201242    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z4mlq\""
Jul 02 14:17:07.201474 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.201460    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 14:17:07.201549 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.201505    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 14:17:07.220902 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.220877    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-87d9c4c4d-s7r5c"]
Jul 02 14:17:07.220902 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.220909    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5zfzw"]
Jul 02 14:17:07.221077 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.220924    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sw4qm"]
Jul 02 14:17:07.221077 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.220997    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:07.223254 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.223235    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 14:17:07.223369 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.223238    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mttc5\""
Jul 02 14:17:07.223369 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.223238    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 14:17:07.262067 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.262036    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-bound-sa-token\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.262234 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.262080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3f8207c-088f-4d1f-998e-5935331cd1a1-ca-trust-extracted\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.262234 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.262105    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-certificates\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.262234 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.262144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3f8207c-088f-4d1f-998e-5935331cd1a1-image-registry-private-configuration\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.262234 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.262174    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3f8207c-088f-4d1f-998e-5935331cd1a1-installation-pull-secrets\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.262408 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.262267    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.262408 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.262299    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3f8207c-088f-4d1f-998e-5935331cd1a1-trusted-ca\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.262408 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.262344    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4g5k\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-kube-api-access-j4g5k\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.363009 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.362972    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-bound-sa-token\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.363009 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363009    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3f8207c-088f-4d1f-998e-5935331cd1a1-ca-trust-extracted\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.363270 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363028    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-certificates\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.363270 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363053    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9e3c620-4554-4c19-aed2-8bee0a571bcc-cert\") pod \"ingress-canary-5zfzw\" (UID: \"a9e3c620-4554-4c19-aed2-8bee0a571bcc\") " pod="openshift-ingress-canary/ingress-canary-5zfzw"
Jul 02 14:17:07.363270 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3f8207c-088f-4d1f-998e-5935331cd1a1-image-registry-private-configuration\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.363270 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363144    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dfsz\" (UniqueName: \"kubernetes.io/projected/fdd69d65-f10f-4a67-b47b-a9fb75528349-kube-api-access-9dfsz\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:07.363270 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363179    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cxhj\" (UniqueName: \"kubernetes.io/projected/a9e3c620-4554-4c19-aed2-8bee0a571bcc-kube-api-access-5cxhj\") pod \"ingress-canary-5zfzw\" (UID: \"a9e3c620-4554-4c19-aed2-8bee0a571bcc\") " pod="openshift-ingress-canary/ingress-canary-5zfzw"
Jul 02 14:17:07.363270 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3f8207c-088f-4d1f-998e-5935331cd1a1-installation-pull-secrets\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.363270 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363261    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fdd69d65-f10f-4a67-b47b-a9fb75528349-config-volume\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:07.363598 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363324    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:07.363598 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363348    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdd69d65-f10f-4a67-b47b-a9fb75528349-tmp-dir\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:07.363598 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363381    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.363598 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363412    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3f8207c-088f-4d1f-998e-5935331cd1a1-trusted-ca\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.363598 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:07.363449    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 14:17:07.363598 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363461    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4g5k\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-kube-api-access-j4g5k\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.363598 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363482    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3f8207c-088f-4d1f-998e-5935331cd1a1-ca-trust-extracted\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.363598 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:07.363467    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87d9c4c4d-s7r5c: secret "image-registry-tls" not found
Jul 02 14:17:07.363598 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:07.363564    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls podName:e3f8207c-088f-4d1f-998e-5935331cd1a1 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:07.863543396 +0000 UTC m=+35.495436315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls") pod "image-registry-87d9c4c4d-s7r5c" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1") : secret "image-registry-tls" not found
Jul 02 14:17:07.363932 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.363799    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-certificates\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.364242 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.364223    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3f8207c-088f-4d1f-998e-5935331cd1a1-trusted-ca\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.367178 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.367127    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3f8207c-088f-4d1f-998e-5935331cd1a1-installation-pull-secrets\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.367270 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.367194    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3f8207c-088f-4d1f-998e-5935331cd1a1-image-registry-private-configuration\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.376047 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.373575    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-bound-sa-token\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.376824 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.376805    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4g5k\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-kube-api-access-j4g5k\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.464502 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.464465    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9e3c620-4554-4c19-aed2-8bee0a571bcc-cert\") pod \"ingress-canary-5zfzw\" (UID: \"a9e3c620-4554-4c19-aed2-8bee0a571bcc\") " pod="openshift-ingress-canary/ingress-canary-5zfzw"
Jul 02 14:17:07.464695 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.464507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dfsz\" (UniqueName: \"kubernetes.io/projected/fdd69d65-f10f-4a67-b47b-a9fb75528349-kube-api-access-9dfsz\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:07.464695 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.464534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cxhj\" (UniqueName: \"kubernetes.io/projected/a9e3c620-4554-4c19-aed2-8bee0a571bcc-kube-api-access-5cxhj\") pod \"ingress-canary-5zfzw\" (UID: \"a9e3c620-4554-4c19-aed2-8bee0a571bcc\") " pod="openshift-ingress-canary/ingress-canary-5zfzw"
Jul 02 14:17:07.464695 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.464566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fdd69d65-f10f-4a67-b47b-a9fb75528349-config-volume\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:07.464695 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.464609    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:07.464695 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.464632    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdd69d65-f10f-4a67-b47b-a9fb75528349-tmp-dir\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:07.464952 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:07.464759    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 14:17:07.464952 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:07.464841    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls podName:fdd69d65-f10f-4a67-b47b-a9fb75528349 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:07.964825548 +0000 UTC m=+35.596718467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls") pod "dns-default-sw4qm" (UID: "fdd69d65-f10f-4a67-b47b-a9fb75528349") : secret "dns-default-metrics-tls" not found
Jul 02 14:17:07.465030 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.464957    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdd69d65-f10f-4a67-b47b-a9fb75528349-tmp-dir\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:07.465193 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.465174    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fdd69d65-f10f-4a67-b47b-a9fb75528349-config-volume\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:07.466976 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.466952    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9e3c620-4554-4c19-aed2-8bee0a571bcc-cert\") pod \"ingress-canary-5zfzw\" (UID: \"a9e3c620-4554-4c19-aed2-8bee0a571bcc\") " pod="openshift-ingress-canary/ingress-canary-5zfzw"
Jul 02 14:17:07.478171 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.478150    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dfsz\" (UniqueName: \"kubernetes.io/projected/fdd69d65-f10f-4a67-b47b-a9fb75528349-kube-api-access-9dfsz\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:07.478263 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.478223    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cxhj\" (UniqueName: \"kubernetes.io/projected/a9e3c620-4554-4c19-aed2-8bee0a571bcc-kube-api-access-5cxhj\") pod \"ingress-canary-5zfzw\" (UID: \"a9e3c620-4554-4c19-aed2-8bee0a571bcc\") " pod="openshift-ingress-canary/ingress-canary-5zfzw"
Jul 02 14:17:07.507311 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.507286    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5zfzw"
Jul 02 14:17:07.697567 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.697537    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5zfzw"]
Jul 02 14:17:07.701304 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:17:07.701274    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e3c620_4554_4c19_aed2_8bee0a571bcc.slice/crio-74ce024b047a414bd7de4c9d9be64b6d9036819a472b2c9e39dde7ec6671e71e WatchSource:0}: Error finding container 74ce024b047a414bd7de4c9d9be64b6d9036819a472b2c9e39dde7ec6671e71e: Status 404 returned error can't find the container with id 74ce024b047a414bd7de4c9d9be64b6d9036819a472b2c9e39dde7ec6671e71e
Jul 02 14:17:07.868371 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.868292    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:07.868519 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:07.868471    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 14:17:07.868519 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:07.868492    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87d9c4c4d-s7r5c: secret "image-registry-tls" not found
Jul 02 14:17:07.868611 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:07.868562    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls podName:e3f8207c-088f-4d1f-998e-5935331cd1a1 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:08.86854225 +0000 UTC m=+36.500435169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls") pod "image-registry-87d9c4c4d-s7r5c" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1") : secret "image-registry-tls" not found
Jul 02 14:17:07.969212 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:07.969177    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:07.969401 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:07.969288    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 14:17:07.969401 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:07.969363    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls podName:fdd69d65-f10f-4a67-b47b-a9fb75528349 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:08.969342947 +0000 UTC m=+36.601235868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls") pod "dns-default-sw4qm" (UID: "fdd69d65-f10f-4a67-b47b-a9fb75528349") : secret "dns-default-metrics-tls" not found
Jul 02 14:17:08.124129 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:08.124043    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5zfzw" event={"ID":"a9e3c620-4554-4c19-aed2-8bee0a571bcc","Type":"ContainerStarted","Data":"74ce024b047a414bd7de4c9d9be64b6d9036819a472b2c9e39dde7ec6671e71e"}
Jul 02 14:17:08.879397 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:08.879361    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:08.879888 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:08.879500    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 14:17:08.879888 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:08.879522    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87d9c4c4d-s7r5c: secret "image-registry-tls" not found
Jul 02 14:17:08.879888 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:08.879590    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls podName:e3f8207c-088f-4d1f-998e-5935331cd1a1 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:10.879568435 +0000 UTC m=+38.511461369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls") pod "image-registry-87d9c4c4d-s7r5c" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1") : secret "image-registry-tls" not found
Jul 02 14:17:08.965957 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:08.965923    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:17:08.966430 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:08.966233    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:17:08.966430 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:08.966239    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:17:08.969057 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:08.968865    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 14:17:08.969057 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:08.968981    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 14:17:08.969221 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:08.969129    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 14:17:08.970391 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:08.970089    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q6bk5\""
Jul 02 14:17:08.970391 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:08.970224    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 14:17:08.970391 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:08.970293    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8mqz5\""
Jul 02 14:17:08.980628 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:08.980173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:08.980628 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:08.980319    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 14:17:08.980628 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:08.980469    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls podName:fdd69d65-f10f-4a67-b47b-a9fb75528349 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:10.980450494 +0000 UTC m=+38.612343424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls") pod "dns-default-sw4qm" (UID: "fdd69d65-f10f-4a67-b47b-a9fb75528349") : secret "dns-default-metrics-tls" not found
Jul 02 14:17:10.894952 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:10.894916    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:10.895347 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:10.895081    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 14:17:10.895347 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:10.895101    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87d9c4c4d-s7r5c: secret "image-registry-tls" not found
Jul 02 14:17:10.895347 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:10.895156    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls podName:e3f8207c-088f-4d1f-998e-5935331cd1a1 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:14.89514156 +0000 UTC m=+42.527034481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls") pod "image-registry-87d9c4c4d-s7r5c" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1") : secret "image-registry-tls" not found
Jul 02 14:17:10.995827 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:10.995795    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:10.996000 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:10.995936    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 14:17:10.996058 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:10.996002    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls podName:fdd69d65-f10f-4a67-b47b-a9fb75528349 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:14.995984609 +0000 UTC m=+42.627877524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls") pod "dns-default-sw4qm" (UID: "fdd69d65-f10f-4a67-b47b-a9fb75528349") : secret "dns-default-metrics-tls" not found
Jul 02 14:17:13.137987 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:13.137906    2559 generic.go:356] "Generic (PLEG): container finished" podID="53260520-d418-4c07-95c7-d9f3fcf10acb" containerID="060e3e71ce794839e4aac128df6c3f17554258c5aecceccae158f925f6642367" exitCode=0
Jul 02 14:17:13.138511 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:13.137976    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9zn6" event={"ID":"53260520-d418-4c07-95c7-d9f3fcf10acb","Type":"ContainerDied","Data":"060e3e71ce794839e4aac128df6c3f17554258c5aecceccae158f925f6642367"}
Jul 02 14:17:13.139311 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:13.139287    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5zfzw" event={"ID":"a9e3c620-4554-4c19-aed2-8bee0a571bcc","Type":"ContainerStarted","Data":"fefbb013d582320b067371816ed8448e034685e19315ddd73fd360736203bec8"}
Jul 02 14:17:13.179877 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:13.179830    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5zfzw" podStartSLOduration=1.324939243 podStartE2EDuration="6.179811011s" totalImagesPullingTime="4.854871768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:17:13.179160227 +0000 UTC m=+40.811053176" watchObservedRunningTime="2026-07-02 14:17:13.179811011 +0000 UTC m=+40.811703949"
Jul 02 14:17:14.144516 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:14.144478    2559 generic.go:356] "Generic (PLEG): container finished" podID="53260520-d418-4c07-95c7-d9f3fcf10acb" containerID="b2a25745b8bb2ce23a467032244668f3c51511fc6005b85cea82f7197bef1471" exitCode=0
Jul 02 14:17:14.144938 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:14.144555    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9zn6" event={"ID":"53260520-d418-4c07-95c7-d9f3fcf10acb","Type":"ContainerDied","Data":"b2a25745b8bb2ce23a467032244668f3c51511fc6005b85cea82f7197bef1471"}
Jul 02 14:17:14.927371 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:14.927194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:14.927371 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:14.927344    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 14:17:14.927582 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:14.927388    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87d9c4c4d-s7r5c: secret "image-registry-tls" not found
Jul 02 14:17:14.927582 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:14.927435    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls podName:e3f8207c-088f-4d1f-998e-5935331cd1a1 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:22.927422934 +0000 UTC m=+50.559315850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls") pod "image-registry-87d9c4c4d-s7r5c" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1") : secret "image-registry-tls" not found
Jul 02 14:17:15.028555 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:15.028523    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:15.028761 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:15.028709    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 14:17:15.028824 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:15.028786    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls podName:fdd69d65-f10f-4a67-b47b-a9fb75528349 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:23.028766104 +0000 UTC m=+50.660659022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls") pod "dns-default-sw4qm" (UID: "fdd69d65-f10f-4a67-b47b-a9fb75528349") : secret "dns-default-metrics-tls" not found
Jul 02 14:17:15.149927 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:15.149893    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9zn6" event={"ID":"53260520-d418-4c07-95c7-d9f3fcf10acb","Type":"ContainerStarted","Data":"cc3a9526bab090299976b02c12ab67dd49036f291d25279c166e0cb64cae3fd6"}
Jul 02 14:17:15.177662 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:15.177567    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r9zn6" podStartSLOduration=4.223204418 podStartE2EDuration="41.17755211s" totalImagesPullingTime="36.954347692s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:16:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-02 14:17:15.176070556 +0000 UTC m=+42.807963504" watchObservedRunningTime="2026-07-02 14:17:15.17755211 +0000 UTC m=+42.809445047"
Jul 02 14:17:22.985437 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:22.985404    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:22.985960 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:22.985509    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 14:17:22.985960 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:22.985519    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87d9c4c4d-s7r5c: secret "image-registry-tls" not found
Jul 02 14:17:22.985960 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:22.985565    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls podName:e3f8207c-088f-4d1f-998e-5935331cd1a1 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:38.985551814 +0000 UTC m=+66.617444730 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls") pod "image-registry-87d9c4c4d-s7r5c" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1") : secret "image-registry-tls" not found
Jul 02 14:17:23.086528 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:23.086487    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:23.086750 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:23.086646    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 14:17:23.086750 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:23.086736    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls podName:fdd69d65-f10f-4a67-b47b-a9fb75528349 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:39.086718655 +0000 UTC m=+66.718611571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls") pod "dns-default-sw4qm" (UID: "fdd69d65-f10f-4a67-b47b-a9fb75528349") : secret "dns-default-metrics-tls" not found
Jul 02 14:17:32.112797 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:32.112772    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zphb6"
Jul 02 14:17:37.052143 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.052113    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6ff7f5b667-967lx"]
Jul 02 14:17:37.054764 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.054747    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.057778 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.057735    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 02 14:17:37.057961 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.057946    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 02 14:17:37.058038 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.058002    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 02 14:17:37.058101 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.058044    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 14:17:37.058280 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.058265    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 02 14:17:37.058803 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.058785    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 14:17:37.058893 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.058817    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gllzp\""
Jul 02 14:17:37.071613 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.071593    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6ff7f5b667-967lx"]
Jul 02 14:17:37.088019 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.087974    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-default-certificate\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.088019 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.088027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-stats-auth\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.088339 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.088077    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.088339 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.088113    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnnf7\" (UniqueName: \"kubernetes.io/projected/ba8732ec-3fe5-49af-86e1-e98bf2da100d-kube-api-access-gnnf7\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.088339 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.088147    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.189187 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.189156    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnnf7\" (UniqueName: \"kubernetes.io/projected/ba8732ec-3fe5-49af-86e1-e98bf2da100d-kube-api-access-gnnf7\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.189467 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.189434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.189694 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.189679    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-default-certificate\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.189841 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.189824    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-stats-auth\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.190003 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.189978    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.190258 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:37.190244    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 14:17:37.190435 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:37.190426    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs podName:ba8732ec-3fe5-49af-86e1-e98bf2da100d nodeName:}" failed. No retries permitted until 2026-07-02 14:17:37.690391857 +0000 UTC m=+65.322284784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs") pod "router-default-6ff7f5b667-967lx" (UID: "ba8732ec-3fe5-49af-86e1-e98bf2da100d") : secret "router-metrics-certs-default" not found
Jul 02 14:17:37.191697 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:37.191664    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle podName:ba8732ec-3fe5-49af-86e1-e98bf2da100d nodeName:}" failed. No retries permitted until 2026-07-02 14:17:37.691627278 +0000 UTC m=+65.323520208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle") pod "router-default-6ff7f5b667-967lx" (UID: "ba8732ec-3fe5-49af-86e1-e98bf2da100d") : configmap references non-existent config key: service-ca.crt
Jul 02 14:17:37.195993 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.195973    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-stats-auth\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.196080 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.196032    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-default-certificate\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.202623 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.202598    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnnf7\" (UniqueName: \"kubernetes.io/projected/ba8732ec-3fe5-49af-86e1-e98bf2da100d-kube-api-access-gnnf7\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.693116 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.693084    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.693311 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:37.693132    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:37.693311 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:37.693250    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle podName:ba8732ec-3fe5-49af-86e1-e98bf2da100d nodeName:}" failed. No retries permitted until 2026-07-02 14:17:38.693237249 +0000 UTC m=+66.325130165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle") pod "router-default-6ff7f5b667-967lx" (UID: "ba8732ec-3fe5-49af-86e1-e98bf2da100d") : configmap references non-existent config key: service-ca.crt
Jul 02 14:17:37.693311 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:37.693250    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 14:17:37.693311 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:37.693307    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs podName:ba8732ec-3fe5-49af-86e1-e98bf2da100d nodeName:}" failed. No retries permitted until 2026-07-02 14:17:38.693292496 +0000 UTC m=+66.325185416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs") pod "router-default-6ff7f5b667-967lx" (UID: "ba8732ec-3fe5-49af-86e1-e98bf2da100d") : secret "router-metrics-certs-default" not found
Jul 02 14:17:38.700566 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.700524    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:38.700566 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.700580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:17:38.701132 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.700698    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:17:38.701132 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:38.700717    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle podName:ba8732ec-3fe5-49af-86e1-e98bf2da100d nodeName:}" failed. No retries permitted until 2026-07-02 14:17:40.700695615 +0000 UTC m=+68.332588531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle") pod "router-default-6ff7f5b667-967lx" (UID: "ba8732ec-3fe5-49af-86e1-e98bf2da100d") : configmap references non-existent config key: service-ca.crt
Jul 02 14:17:38.701132 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.700783    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:38.701132 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:38.700875    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 14:17:38.701132 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:38.700905    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs podName:ba8732ec-3fe5-49af-86e1-e98bf2da100d nodeName:}" failed. No retries permitted until 2026-07-02 14:17:40.700894886 +0000 UTC m=+68.332787803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs") pod "router-default-6ff7f5b667-967lx" (UID: "ba8732ec-3fe5-49af-86e1-e98bf2da100d") : secret "router-metrics-certs-default" not found
Jul 02 14:17:38.703151 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.703131    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 14:17:38.703257 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.703172    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 14:17:38.711707 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:38.711687    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 14:17:38.711783 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:38.711730    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs podName:84655b87-ce0c-4c23-afd6-51d4f4d06657 nodeName:}" failed. No retries permitted until 2026-07-02 14:18:42.711718625 +0000 UTC m=+130.343611541 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs") pod "network-metrics-daemon-xg2xd" (UID: "84655b87-ce0c-4c23-afd6-51d4f4d06657") : secret "metrics-daemon-secret" not found
Jul 02 14:17:38.713791 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.713774    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/618bf971-9ffc-4d84-9af2-649808bc68ba-original-pull-secret\") pod \"global-pull-secret-syncer-tntl5\" (UID: \"618bf971-9ffc-4d84-9af2-649808bc68ba\") " pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:17:38.801670 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.801606    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvp2x\" (UniqueName: \"kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x\") pod \"network-check-target-vmzd7\" (UID: \"e00643be-d291-4d9d-b372-28467da96c08\") " pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:17:38.804835 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.804819    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 14:17:38.814190 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.814173    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 14:17:38.824426 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.824407    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvp2x\" (UniqueName: \"kubernetes.io/projected/e00643be-d291-4d9d-b372-28467da96c08-kube-api-access-pvp2x\") pod \"network-check-target-vmzd7\" (UID: \"e00643be-d291-4d9d-b372-28467da96c08\") " pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:17:38.980932 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.980863    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tntl5"
Jul 02 14:17:38.992743 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.992721    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q6bk5\""
Jul 02 14:17:38.999974 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:38.999948    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:17:39.003438 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:39.002848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:17:39.003438 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:39.003053    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 14:17:39.003438 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:39.003069    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-87d9c4c4d-s7r5c: secret "image-registry-tls" not found
Jul 02 14:17:39.003438 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:39.003117    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls podName:e3f8207c-088f-4d1f-998e-5935331cd1a1 nodeName:}" failed. No retries permitted until 2026-07-02 14:18:11.003099088 +0000 UTC m=+98.634992013 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls") pod "image-registry-87d9c4c4d-s7r5c" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1") : secret "image-registry-tls" not found
Jul 02 14:17:39.104088 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:39.104057    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:17:39.104213 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:39.104193    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 14:17:39.104266 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:39.104256    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls podName:fdd69d65-f10f-4a67-b47b-a9fb75528349 nodeName:}" failed. No retries permitted until 2026-07-02 14:18:11.104241683 +0000 UTC m=+98.736134601 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls") pod "dns-default-sw4qm" (UID: "fdd69d65-f10f-4a67-b47b-a9fb75528349") : secret "dns-default-metrics-tls" not found
Jul 02 14:17:39.112009 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:39.111912    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tntl5"]
Jul 02 14:17:39.114771 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:17:39.114749    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618bf971_9ffc_4d84_9af2_649808bc68ba.slice/crio-272ad498db8ddc4b3ee5033757bb5aa3bb50d30485aa2732ffc9b6db526b8d07 WatchSource:0}: Error finding container 272ad498db8ddc4b3ee5033757bb5aa3bb50d30485aa2732ffc9b6db526b8d07: Status 404 returned error can't find the container with id 272ad498db8ddc4b3ee5033757bb5aa3bb50d30485aa2732ffc9b6db526b8d07
Jul 02 14:17:39.123820 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:39.123799    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vmzd7"]
Jul 02 14:17:39.126433 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:17:39.126415    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode00643be_d291_4d9d_b372_28467da96c08.slice/crio-5327d9f5bc25cd966f0b0cf7fcd28fcac0efa2931c9118aadb2f3afdb7d9587e WatchSource:0}: Error finding container 5327d9f5bc25cd966f0b0cf7fcd28fcac0efa2931c9118aadb2f3afdb7d9587e: Status 404 returned error can't find the container with id 5327d9f5bc25cd966f0b0cf7fcd28fcac0efa2931c9118aadb2f3afdb7d9587e
Jul 02 14:17:39.204189 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:39.204156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vmzd7" event={"ID":"e00643be-d291-4d9d-b372-28467da96c08","Type":"ContainerStarted","Data":"5327d9f5bc25cd966f0b0cf7fcd28fcac0efa2931c9118aadb2f3afdb7d9587e"}
Jul 02 14:17:39.205169 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:39.205145    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tntl5" event={"ID":"618bf971-9ffc-4d84-9af2-649808bc68ba","Type":"ContainerStarted","Data":"272ad498db8ddc4b3ee5033757bb5aa3bb50d30485aa2732ffc9b6db526b8d07"}
Jul 02 14:17:40.716014 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:40.715977    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:40.716427 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:40.716144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:40.716427 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:40.716169    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle podName:ba8732ec-3fe5-49af-86e1-e98bf2da100d nodeName:}" failed. No retries permitted until 2026-07-02 14:17:44.716143281 +0000 UTC m=+72.348036201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle") pod "router-default-6ff7f5b667-967lx" (UID: "ba8732ec-3fe5-49af-86e1-e98bf2da100d") : configmap references non-existent config key: service-ca.crt
Jul 02 14:17:40.716427 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:40.716222    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 14:17:40.716427 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:40.716266    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs podName:ba8732ec-3fe5-49af-86e1-e98bf2da100d nodeName:}" failed. No retries permitted until 2026-07-02 14:17:44.716253533 +0000 UTC m=+72.348146449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs") pod "router-default-6ff7f5b667-967lx" (UID: "ba8732ec-3fe5-49af-86e1-e98bf2da100d") : secret "router-metrics-certs-default" not found
Jul 02 14:17:41.943121 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:41.943082    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bmcqq"]
Jul 02 14:17:41.945359 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:41.945339    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:41.948721 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:41.948697    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 14:17:41.948837 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:41.948751    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 14:17:41.949748 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:41.949730    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 14:17:41.949843 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:41.949750    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 14:17:41.949843 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:41.949804    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nfp8j\""
Jul 02 14:17:41.960154 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:41.960133    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bmcqq"]
Jul 02 14:17:42.027257 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.027216    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.027434 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.027281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.027434 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.027307    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4ss5\" (UniqueName: \"kubernetes.io/projected/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-api-access-w4ss5\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.027434 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.027397    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06fa0dba-ee3e-448e-90a0-130b0a6148d4-crio-socket\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.027563 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.027493    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06fa0dba-ee3e-448e-90a0-130b0a6148d4-data-volume\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.128794 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.128750    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.128981 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.128813    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.128981 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.128835    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4ss5\" (UniqueName: \"kubernetes.io/projected/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-api-access-w4ss5\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.128981 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.128886    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06fa0dba-ee3e-448e-90a0-130b0a6148d4-crio-socket\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.128981 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:42.128939    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 14:17:42.128981 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.128960    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06fa0dba-ee3e-448e-90a0-130b0a6148d4-data-volume\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.129198 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:42.128981    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 14:17:42.129198 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:42.129022    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls podName:06fa0dba-ee3e-448e-90a0-130b0a6148d4 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:42.629001858 +0000 UTC m=+70.260894811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmcqq" (UID: "06fa0dba-ee3e-448e-90a0-130b0a6148d4") : secret "insights-runtime-extractor-tls" not found
Jul 02 14:17:42.129198 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:42.129042    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm podName:06fa0dba-ee3e-448e-90a0-130b0a6148d4 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:42.629032165 +0000 UTC m=+70.260925086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmcqq" (UID: "06fa0dba-ee3e-448e-90a0-130b0a6148d4") : configmap "kube-rbac-proxy" not found
Jul 02 14:17:42.129198 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.129075    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/06fa0dba-ee3e-448e-90a0-130b0a6148d4-crio-socket\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.129417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.129307    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/06fa0dba-ee3e-448e-90a0-130b0a6148d4-data-volume\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.141024 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.140989    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4ss5\" (UniqueName: \"kubernetes.io/projected/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-api-access-w4ss5\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.634942 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.634898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.635140 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:42.634954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:42.635140 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:42.635063    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 14:17:42.635140 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:42.635108    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 14:17:42.635270 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:42.635146    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls podName:06fa0dba-ee3e-448e-90a0-130b0a6148d4 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:43.635124386 +0000 UTC m=+71.267017348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmcqq" (UID: "06fa0dba-ee3e-448e-90a0-130b0a6148d4") : secret "insights-runtime-extractor-tls" not found
Jul 02 14:17:42.635270 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:42.635167    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm podName:06fa0dba-ee3e-448e-90a0-130b0a6148d4 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:43.635156537 +0000 UTC m=+71.267049456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmcqq" (UID: "06fa0dba-ee3e-448e-90a0-130b0a6148d4") : configmap "kube-rbac-proxy" not found
Jul 02 14:17:43.643626 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:43.643590    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:43.643626 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:43.643638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:43.644344 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:43.643778    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 14:17:43.644344 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:43.643859    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls podName:06fa0dba-ee3e-448e-90a0-130b0a6148d4 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:45.643837064 +0000 UTC m=+73.275729981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmcqq" (UID: "06fa0dba-ee3e-448e-90a0-130b0a6148d4") : secret "insights-runtime-extractor-tls" not found
Jul 02 14:17:43.644344 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:43.643785    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 14:17:43.644344 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:43.643922    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm podName:06fa0dba-ee3e-448e-90a0-130b0a6148d4 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:45.643905733 +0000 UTC m=+73.275798649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmcqq" (UID: "06fa0dba-ee3e-448e-90a0-130b0a6148d4") : configmap "kube-rbac-proxy" not found
Jul 02 14:17:43.924916 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:43.924883    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qz97f_77425abb-cd5c-4da3-87bf-e267d052a799/dns-node-resolver/0.log"
Jul 02 14:17:44.218719 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:44.218628    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tntl5" event={"ID":"618bf971-9ffc-4d84-9af2-649808bc68ba","Type":"ContainerStarted","Data":"84adf58cb8a954f766ec76382d66315fbef6a284caed134a264c9c73f00b8f1e"}
Jul 02 14:17:44.235501 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:44.235240    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tntl5" podStartSLOduration=65.928174375 podStartE2EDuration="1m10.235220032s" totalImagesPullingTime="4.307045657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:17:44.234709248 +0000 UTC m=+71.866602205" watchObservedRunningTime="2026-07-02 14:17:44.235220032 +0000 UTC m=+71.867112965"
Jul 02 14:17:44.752429 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:44.752390    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:44.752919 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:44.752494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:44.752919 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:44.752529    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle podName:ba8732ec-3fe5-49af-86e1-e98bf2da100d nodeName:}" failed. No retries permitted until 2026-07-02 14:17:52.752505096 +0000 UTC m=+80.384398059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle") pod "router-default-6ff7f5b667-967lx" (UID: "ba8732ec-3fe5-49af-86e1-e98bf2da100d") : configmap references non-existent config key: service-ca.crt
Jul 02 14:17:44.752919 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:44.752594    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 14:17:44.752919 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:44.752641    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs podName:ba8732ec-3fe5-49af-86e1-e98bf2da100d nodeName:}" failed. No retries permitted until 2026-07-02 14:17:52.7526275 +0000 UTC m=+80.384520416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs") pod "router-default-6ff7f5b667-967lx" (UID: "ba8732ec-3fe5-49af-86e1-e98bf2da100d") : secret "router-metrics-certs-default" not found
Jul 02 14:17:45.128086 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:45.128044    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t7jl4_bb27d825-0583-4db1-8bee-109bbea38bdf/node-ca/0.log"
Jul 02 14:17:45.524557 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:45.524523    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5zfzw_a9e3c620-4554-4c19-aed2-8bee0a571bcc/serve-healthcheck-canary/0.log"
Jul 02 14:17:45.661345 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:45.661306    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:45.661345 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:45.661354    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:45.661560 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:45.661453    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 14:17:45.661560 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:45.661480    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 14:17:45.661560 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:45.661513    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls podName:06fa0dba-ee3e-448e-90a0-130b0a6148d4 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:49.661496883 +0000 UTC m=+77.293389801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmcqq" (UID: "06fa0dba-ee3e-448e-90a0-130b0a6148d4") : secret "insights-runtime-extractor-tls" not found
Jul 02 14:17:45.661560 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:45.661528    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm podName:06fa0dba-ee3e-448e-90a0-130b0a6148d4 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:49.66152099 +0000 UTC m=+77.293413906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmcqq" (UID: "06fa0dba-ee3e-448e-90a0-130b0a6148d4") : configmap "kube-rbac-proxy" not found
Jul 02 14:17:46.225426 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:46.225391    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vmzd7" event={"ID":"e00643be-d291-4d9d-b372-28467da96c08","Type":"ContainerStarted","Data":"ab46e031b0b0df60e87ff9328756feebe20b1f3725bee23585fdf0681c5ffc50"}
Jul 02 14:17:46.225823 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:46.225518    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:17:46.243587 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:46.243541    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vmzd7" podStartSLOduration=65.347181021 podStartE2EDuration="1m12.243528127s" totalImagesPullingTime="6.896347106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:17:46.242976204 +0000 UTC m=+73.874869145" watchObservedRunningTime="2026-07-02 14:17:46.243528127 +0000 UTC m=+73.875421103"
Jul 02 14:17:49.693186 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:49.693126    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:49.693739 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:49.693252    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 14:17:49.693739 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:49.693280    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:49.693739 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:49.693333    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm podName:06fa0dba-ee3e-448e-90a0-130b0a6148d4 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:57.693312231 +0000 UTC m=+85.325205226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bmcqq" (UID: "06fa0dba-ee3e-448e-90a0-130b0a6148d4") : configmap "kube-rbac-proxy" not found
Jul 02 14:17:49.693739 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:49.693395    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 14:17:49.693739 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:49.693452    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls podName:06fa0dba-ee3e-448e-90a0-130b0a6148d4 nodeName:}" failed. No retries permitted until 2026-07-02 14:17:57.693439823 +0000 UTC m=+85.325332743 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmcqq" (UID: "06fa0dba-ee3e-448e-90a0-130b0a6148d4") : secret "insights-runtime-extractor-tls" not found
Jul 02 14:17:52.815902 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:52.815863    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:52.816285 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:52.815923    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:17:52.816285 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:52.816006    2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 02 14:17:52.816285 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:52.816032    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle podName:ba8732ec-3fe5-49af-86e1-e98bf2da100d nodeName:}" failed. No retries permitted until 2026-07-02 14:18:08.816017505 +0000 UTC m=+96.447910421 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle") pod "router-default-6ff7f5b667-967lx" (UID: "ba8732ec-3fe5-49af-86e1-e98bf2da100d") : configmap references non-existent config key: service-ca.crt
Jul 02 14:17:52.816285 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:52.816065    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs podName:ba8732ec-3fe5-49af-86e1-e98bf2da100d nodeName:}" failed. No retries permitted until 2026-07-02 14:18:08.816051428 +0000 UTC m=+96.447944344 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs") pod "router-default-6ff7f5b667-967lx" (UID: "ba8732ec-3fe5-49af-86e1-e98bf2da100d") : secret "router-metrics-certs-default" not found
Jul 02 14:17:57.757947 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:57.757820    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:57.757947 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:57.757868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:17:57.758359 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:57.757978    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 14:17:57.758359 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:17:57.758062    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls podName:06fa0dba-ee3e-448e-90a0-130b0a6148d4 nodeName:}" failed. No retries permitted until 2026-07-02 14:18:13.758042387 +0000 UTC m=+101.389935317 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bmcqq" (UID: "06fa0dba-ee3e-448e-90a0-130b0a6148d4") : secret "insights-runtime-extractor-tls" not found
Jul 02 14:17:57.758359 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:17:57.758340    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/06fa0dba-ee3e-448e-90a0-130b0a6148d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:18:08.841397 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:08.841355    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:18:08.841831 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:08.841417    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:18:08.842007 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:08.841990    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba8732ec-3fe5-49af-86e1-e98bf2da100d-service-ca-bundle\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:18:08.843604 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:08.843585    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba8732ec-3fe5-49af-86e1-e98bf2da100d-metrics-certs\") pod \"router-default-6ff7f5b667-967lx\" (UID: \"ba8732ec-3fe5-49af-86e1-e98bf2da100d\") " pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:18:08.863519 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:08.863496    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:18:08.985051 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:08.985010    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6ff7f5b667-967lx"]
Jul 02 14:18:08.987796 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:08.987758    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba8732ec_3fe5_49af_86e1_e98bf2da100d.slice/crio-0a9c132c5ca5c2aefa0f28ff032a351acced19b09d3f286b1e73735413511628 WatchSource:0}: Error finding container 0a9c132c5ca5c2aefa0f28ff032a351acced19b09d3f286b1e73735413511628: Status 404 returned error can't find the container with id 0a9c132c5ca5c2aefa0f28ff032a351acced19b09d3f286b1e73735413511628
Jul 02 14:18:09.277854 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:09.277820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6ff7f5b667-967lx" event={"ID":"ba8732ec-3fe5-49af-86e1-e98bf2da100d","Type":"ContainerStarted","Data":"da8a7e89f6405ba65c3765ef06458ec71bca82a27ec6d07740ce71e25c5d8894"}
Jul 02 14:18:09.278026 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:09.277878    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6ff7f5b667-967lx" event={"ID":"ba8732ec-3fe5-49af-86e1-e98bf2da100d","Type":"ContainerStarted","Data":"0a9c132c5ca5c2aefa0f28ff032a351acced19b09d3f286b1e73735413511628"}
Jul 02 14:18:09.298557 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:09.298513    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6ff7f5b667-967lx" podStartSLOduration=32.298499763 podStartE2EDuration="32.298499763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:17:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:09.298376641 +0000 UTC m=+96.930269591" watchObservedRunningTime="2026-07-02 14:18:09.298499763 +0000 UTC m=+96.930392701"
Jul 02 14:18:09.864035 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:09.863998    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:18:09.866346 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:09.866320    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:18:10.280688 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:10.280663    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:18:10.281828 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:10.281806    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6ff7f5b667-967lx"
Jul 02 14:18:11.059113 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.059079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:18:11.061383 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.061361    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls\") pod \"image-registry-87d9c4c4d-s7r5c\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") " pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:18:11.096247 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.096219    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hxdbc\""
Jul 02 14:18:11.104509 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.104491    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:18:11.159886 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.159857    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:18:11.161942 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.161918    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdd69d65-f10f-4a67-b47b-a9fb75528349-metrics-tls\") pod \"dns-default-sw4qm\" (UID: \"fdd69d65-f10f-4a67-b47b-a9fb75528349\") " pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:18:11.227980 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.227952    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-87d9c4c4d-s7r5c"]
Jul 02 14:18:11.231116 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:11.231089    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f8207c_088f_4d1f_998e_5935331cd1a1.slice/crio-21747bac75664f52679d36ebe3823bc9761c854c68c59adfd6936ffc7e7b2951 WatchSource:0}: Error finding container 21747bac75664f52679d36ebe3823bc9761c854c68c59adfd6936ffc7e7b2951: Status 404 returned error can't find the container with id 21747bac75664f52679d36ebe3823bc9761c854c68c59adfd6936ffc7e7b2951
Jul 02 14:18:11.286091 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.286066    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c" event={"ID":"e3f8207c-088f-4d1f-998e-5935331cd1a1","Type":"ContainerStarted","Data":"21747bac75664f52679d36ebe3823bc9761c854c68c59adfd6936ffc7e7b2951"}
Jul 02 14:18:11.431596 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.431522    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mttc5\""
Jul 02 14:18:11.439537 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.439522    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:18:11.563121 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.563090    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sw4qm"]
Jul 02 14:18:11.566530 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:11.566502    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd69d65_f10f_4a67_b47b_a9fb75528349.slice/crio-89cae2765b984c6ae709f9c8a9228d8050e0d349249424c035517e34de01a8c1 WatchSource:0}: Error finding container 89cae2765b984c6ae709f9c8a9228d8050e0d349249424c035517e34de01a8c1: Status 404 returned error can't find the container with id 89cae2765b984c6ae709f9c8a9228d8050e0d349249424c035517e34de01a8c1
Jul 02 14:18:11.779693 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.779659    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl"]
Jul 02 14:18:11.784153 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.784134    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl"
Jul 02 14:18:11.797306 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.797283    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl"]
Jul 02 14:18:11.808183 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.808155    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 02 14:18:11.808328 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.808311    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bmmff\""
Jul 02 14:18:11.808396 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.808358    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 02 14:18:11.863887 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.863860    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/92ecf3c6-5716-4153-b81e-9ed91c847c4a-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-cngdl\" (UID: \"92ecf3c6-5716-4153-b81e-9ed91c847c4a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl"
Jul 02 14:18:11.864005 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.863910    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92ecf3c6-5716-4153-b81e-9ed91c847c4a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-cngdl\" (UID: \"92ecf3c6-5716-4153-b81e-9ed91c847c4a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl"
Jul 02 14:18:11.964340 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.964299    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/92ecf3c6-5716-4153-b81e-9ed91c847c4a-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-cngdl\" (UID: \"92ecf3c6-5716-4153-b81e-9ed91c847c4a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl"
Jul 02 14:18:11.964498 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.964349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92ecf3c6-5716-4153-b81e-9ed91c847c4a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-cngdl\" (UID: \"92ecf3c6-5716-4153-b81e-9ed91c847c4a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl"
Jul 02 14:18:11.964956 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.964932    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/92ecf3c6-5716-4153-b81e-9ed91c847c4a-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-cngdl\" (UID: \"92ecf3c6-5716-4153-b81e-9ed91c847c4a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl"
Jul 02 14:18:11.966635 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.966614    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92ecf3c6-5716-4153-b81e-9ed91c847c4a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-cngdl\" (UID: \"92ecf3c6-5716-4153-b81e-9ed91c847c4a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl"
Jul 02 14:18:11.986179 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.986157    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mkm2p"]
Jul 02 14:18:11.988922 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.988908    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mkm2p"
Jul 02 14:18:11.991468 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.991446    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 02 14:18:11.991547 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:11.991512    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hr4rd\""
Jul 02 14:18:12.003473 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:12.003449    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mkm2p"]
Jul 02 14:18:12.065415 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:12.065338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e29b482f-51dc-4297-9948-88f0419d05df-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-mkm2p\" (UID: \"e29b482f-51dc-4297-9948-88f0419d05df\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mkm2p"
Jul 02 14:18:12.092763 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:12.092739    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl"
Jul 02 14:18:12.167071 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:12.166603    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e29b482f-51dc-4297-9948-88f0419d05df-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-mkm2p\" (UID: \"e29b482f-51dc-4297-9948-88f0419d05df\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mkm2p"
Jul 02 14:18:12.169410 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:12.169381    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e29b482f-51dc-4297-9948-88f0419d05df-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-mkm2p\" (UID: \"e29b482f-51dc-4297-9948-88f0419d05df\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mkm2p"
Jul 02 14:18:12.214861 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:12.214830    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl"]
Jul 02 14:18:12.218694 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:12.218661    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ecf3c6_5716_4153_b81e_9ed91c847c4a.slice/crio-38f788c5e9381becd2f43a4b121858a494e96af0df7d6ff8c8db46987b370f0b WatchSource:0}: Error finding container 38f788c5e9381becd2f43a4b121858a494e96af0df7d6ff8c8db46987b370f0b: Status 404 returned error can't find the container with id 38f788c5e9381becd2f43a4b121858a494e96af0df7d6ff8c8db46987b370f0b
Jul 02 14:18:12.290485 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:12.290449    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c" event={"ID":"e3f8207c-088f-4d1f-998e-5935331cd1a1","Type":"ContainerStarted","Data":"c0e465e35c982d2ae214636d5b5280481b3b5d8c0d77707d1b482060172d3166"}
Jul 02 14:18:12.290674 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:12.290566    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:18:12.292132 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:12.292094    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl" event={"ID":"92ecf3c6-5716-4153-b81e-9ed91c847c4a","Type":"ContainerStarted","Data":"38f788c5e9381becd2f43a4b121858a494e96af0df7d6ff8c8db46987b370f0b"}
Jul 02 14:18:12.293267 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:12.293240    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sw4qm" event={"ID":"fdd69d65-f10f-4a67-b47b-a9fb75528349","Type":"ContainerStarted","Data":"89cae2765b984c6ae709f9c8a9228d8050e0d349249424c035517e34de01a8c1"}
Jul 02 14:18:12.297248 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:12.297217    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mkm2p"
Jul 02 14:18:12.311787 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:12.311739    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c" podStartSLOduration=98.311718444 podStartE2EDuration="1m38.311718444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:16:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:12.311027662 +0000 UTC m=+99.942920616" watchObservedRunningTime="2026-07-02 14:18:12.311718444 +0000 UTC m=+99.943611383"
Jul 02 14:18:12.433846 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:12.433815    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mkm2p"]
Jul 02 14:18:12.437240 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:12.437206    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode29b482f_51dc_4297_9948_88f0419d05df.slice/crio-308e3548b3e8ec2eb7cd1c3c2f92636bc1d4230aa153a0e3caad010c1fda8c9d WatchSource:0}: Error finding container 308e3548b3e8ec2eb7cd1c3c2f92636bc1d4230aa153a0e3caad010c1fda8c9d: Status 404 returned error can't find the container with id 308e3548b3e8ec2eb7cd1c3c2f92636bc1d4230aa153a0e3caad010c1fda8c9d
Jul 02 14:18:13.297582 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:13.297542    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mkm2p" event={"ID":"e29b482f-51dc-4297-9948-88f0419d05df","Type":"ContainerStarted","Data":"308e3548b3e8ec2eb7cd1c3c2f92636bc1d4230aa153a0e3caad010c1fda8c9d"}
Jul 02 14:18:13.779007 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:13.778966    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:18:13.781697 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:13.781666    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/06fa0dba-ee3e-448e-90a0-130b0a6148d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bmcqq\" (UID: \"06fa0dba-ee3e-448e-90a0-130b0a6148d4\") " pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:18:14.056128 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:14.055967    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bmcqq"
Jul 02 14:18:14.180146 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:14.180065    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bmcqq"]
Jul 02 14:18:14.183499 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:14.183477    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06fa0dba_ee3e_448e_90a0_130b0a6148d4.slice/crio-aa40a168fa46c8fd5976f3612490f14c5a606895e14e5b5240c5721abc421c9c WatchSource:0}: Error finding container aa40a168fa46c8fd5976f3612490f14c5a606895e14e5b5240c5721abc421c9c: Status 404 returned error can't find the container with id aa40a168fa46c8fd5976f3612490f14c5a606895e14e5b5240c5721abc421c9c
Jul 02 14:18:14.302348 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:14.302313    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmcqq" event={"ID":"06fa0dba-ee3e-448e-90a0-130b0a6148d4","Type":"ContainerStarted","Data":"aa40a168fa46c8fd5976f3612490f14c5a606895e14e5b5240c5721abc421c9c"}
Jul 02 14:18:14.303900 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:14.303868    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl" event={"ID":"92ecf3c6-5716-4153-b81e-9ed91c847c4a","Type":"ContainerStarted","Data":"d4958b1e8f274a2bd8262cebea2a39bd2df5692048cb76bd97df8582cc5607d4"}
Jul 02 14:18:14.305504 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:14.305482    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sw4qm" event={"ID":"fdd69d65-f10f-4a67-b47b-a9fb75528349","Type":"ContainerStarted","Data":"5a8c409617e0eb66e2895bdf34604256c97f7b2b50ab6d34d381dfedb56d908c"}
Jul 02 14:18:14.305610 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:14.305520    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sw4qm" event={"ID":"fdd69d65-f10f-4a67-b47b-a9fb75528349","Type":"ContainerStarted","Data":"50c437c5c099eb7535dc0d45eec32be1393419189a39a09bfbf6aa80293e9359"}
Jul 02 14:18:14.305610 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:14.305591    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:18:14.309019 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:14.308999    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mkm2p" event={"ID":"e29b482f-51dc-4297-9948-88f0419d05df","Type":"ContainerStarted","Data":"b6e23efff3e8b8a82b10ca8870fdd7a287c8134bd1d2b97034f9f7767acb1a29"}
Jul 02 14:18:14.309192 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:14.309176    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mkm2p"
Jul 02 14:18:14.313759 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:14.313740    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mkm2p"
Jul 02 14:18:14.321460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:14.321424    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-cngdl" podStartSLOduration=1.657196428 podStartE2EDuration="3.321412008s" totalImagesPullingTime="1.66421558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:14.320820636 +0000 UTC m=+101.952713584" watchObservedRunningTime="2026-07-02 14:18:14.321412008 +0000 UTC m=+101.953304945"
Jul 02 14:18:14.355393 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:14.355348    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-mkm2p" podStartSLOduration=1.849332097 podStartE2EDuration="3.355334296s" totalImagesPullingTime="1.506002199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:14.335943873 +0000 UTC m=+101.967836812" watchObservedRunningTime="2026-07-02 14:18:14.355334296 +0000 UTC m=+101.987227234"
Jul 02 14:18:14.355777 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:14.355752    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sw4qm" podStartSLOduration=65.039148954 podStartE2EDuration="1m7.355744103s" totalImagesPullingTime="2.316595149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:14.354479168 +0000 UTC m=+101.986372105" watchObservedRunningTime="2026-07-02 14:18:14.355744103 +0000 UTC m=+101.987637041"
Jul 02 14:18:15.057037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.056034    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"]
Jul 02 14:18:15.071282 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.071079    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"]
Jul 02 14:18:15.071282 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.071207    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.077093 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.077012    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dqj67\""
Jul 02 14:18:15.079029 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.079003    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 14:18:15.079229 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.079212    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 02 14:18:15.079434 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.079420    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 14:18:15.079754 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.079567    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 14:18:15.079754 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.079679    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 02 14:18:15.191394 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.191358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/725bcafe-656f-432a-bd82-e18f9ec6fa85-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-tcqdx\" (UID: \"725bcafe-656f-432a-bd82-e18f9ec6fa85\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.191584 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.191440    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/725bcafe-656f-432a-bd82-e18f9ec6fa85-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-tcqdx\" (UID: \"725bcafe-656f-432a-bd82-e18f9ec6fa85\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.191584 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.191533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxsrq\" (UniqueName: \"kubernetes.io/projected/725bcafe-656f-432a-bd82-e18f9ec6fa85-kube-api-access-zxsrq\") pod \"prometheus-operator-7b7d896497-tcqdx\" (UID: \"725bcafe-656f-432a-bd82-e18f9ec6fa85\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.191731 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.191562    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/725bcafe-656f-432a-bd82-e18f9ec6fa85-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-tcqdx\" (UID: \"725bcafe-656f-432a-bd82-e18f9ec6fa85\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.292637 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.292342    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxsrq\" (UniqueName: \"kubernetes.io/projected/725bcafe-656f-432a-bd82-e18f9ec6fa85-kube-api-access-zxsrq\") pod \"prometheus-operator-7b7d896497-tcqdx\" (UID: \"725bcafe-656f-432a-bd82-e18f9ec6fa85\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.292637 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.292388    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/725bcafe-656f-432a-bd82-e18f9ec6fa85-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-tcqdx\" (UID: \"725bcafe-656f-432a-bd82-e18f9ec6fa85\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.292637 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.292443    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/725bcafe-656f-432a-bd82-e18f9ec6fa85-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-tcqdx\" (UID: \"725bcafe-656f-432a-bd82-e18f9ec6fa85\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.292637 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.292494    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/725bcafe-656f-432a-bd82-e18f9ec6fa85-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-tcqdx\" (UID: \"725bcafe-656f-432a-bd82-e18f9ec6fa85\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.292637 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:18:15.292576    2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 02 14:18:15.292637 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:18:15.292663    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/725bcafe-656f-432a-bd82-e18f9ec6fa85-prometheus-operator-tls podName:725bcafe-656f-432a-bd82-e18f9ec6fa85 nodeName:}" failed. No retries permitted until 2026-07-02 14:18:15.79262475 +0000 UTC m=+103.424517678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/725bcafe-656f-432a-bd82-e18f9ec6fa85-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-tcqdx" (UID: "725bcafe-656f-432a-bd82-e18f9ec6fa85") : secret "prometheus-operator-tls" not found
Jul 02 14:18:15.293448 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.293297    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/725bcafe-656f-432a-bd82-e18f9ec6fa85-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-tcqdx\" (UID: \"725bcafe-656f-432a-bd82-e18f9ec6fa85\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.299528 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.299480    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/725bcafe-656f-432a-bd82-e18f9ec6fa85-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-tcqdx\" (UID: \"725bcafe-656f-432a-bd82-e18f9ec6fa85\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.306893 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.306854    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxsrq\" (UniqueName: \"kubernetes.io/projected/725bcafe-656f-432a-bd82-e18f9ec6fa85-kube-api-access-zxsrq\") pod \"prometheus-operator-7b7d896497-tcqdx\" (UID: \"725bcafe-656f-432a-bd82-e18f9ec6fa85\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.795972 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.795930    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/725bcafe-656f-432a-bd82-e18f9ec6fa85-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-tcqdx\" (UID: \"725bcafe-656f-432a-bd82-e18f9ec6fa85\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.798633 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.798608    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/725bcafe-656f-432a-bd82-e18f9ec6fa85-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-tcqdx\" (UID: \"725bcafe-656f-432a-bd82-e18f9ec6fa85\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:15.985751 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:15.985711    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"
Jul 02 14:18:17.230374 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:17.230342    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vmzd7"
Jul 02 14:18:18.534036 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:18.534011    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-tcqdx"]
Jul 02 14:18:18.537350 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:18.537320    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725bcafe_656f_432a_bd82_e18f9ec6fa85.slice/crio-f08de9f52b40c75972e16d8fe325fde7c062183eff5ce08790dc54367c264b84 WatchSource:0}: Error finding container f08de9f52b40c75972e16d8fe325fde7c062183eff5ce08790dc54367c264b84: Status 404 returned error can't find the container with id f08de9f52b40c75972e16d8fe325fde7c062183eff5ce08790dc54367c264b84
Jul 02 14:18:19.327830 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:19.327789    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmcqq" event={"ID":"06fa0dba-ee3e-448e-90a0-130b0a6148d4","Type":"ContainerStarted","Data":"bb5b4fc4b44b275599edca2db63ff1246ffaeceb3f8d6ac16aca45333ff3eaab"}
Jul 02 14:18:19.329152 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:19.329124    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx" event={"ID":"725bcafe-656f-432a-bd82-e18f9ec6fa85","Type":"ContainerStarted","Data":"f08de9f52b40c75972e16d8fe325fde7c062183eff5ce08790dc54367c264b84"}
Jul 02 14:18:20.333667 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:20.333615    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmcqq" event={"ID":"06fa0dba-ee3e-448e-90a0-130b0a6148d4","Type":"ContainerStarted","Data":"a9c9b803ea68f3718f8a152222b90dcb5f021533873e1f2caf669844c39bdc26"}
Jul 02 14:18:20.335401 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:20.335374    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx" event={"ID":"725bcafe-656f-432a-bd82-e18f9ec6fa85","Type":"ContainerStarted","Data":"9576e5cb571a55ce122828c1d9a1ed5df8ff8915831995c1e5a0aef9342d7700"}
Jul 02 14:18:20.335523 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:20.335420    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx" event={"ID":"725bcafe-656f-432a-bd82-e18f9ec6fa85","Type":"ContainerStarted","Data":"137a5101679d38692cb197867acdf3b54e1dd064c9acf9ad781a1a5c8a5ee1af"}
Jul 02 14:18:20.353692 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:20.353634    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-tcqdx" podStartSLOduration=4.176272132 podStartE2EDuration="5.35361551s" totalImagesPullingTime="1.177343378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:20.353089363 +0000 UTC m=+107.984982300" watchObservedRunningTime="2026-07-02 14:18:20.35361551 +0000 UTC m=+107.985508428"
Jul 02 14:18:22.418668 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.418623    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"]
Jul 02 14:18:22.423404 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.423381    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-gqx4g"]
Jul 02 14:18:22.423528 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.423507    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:22.426219 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.426077    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 02 14:18:22.426219 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.426113    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-k5m82\""
Jul 02 14:18:22.426390 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.426366    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 02 14:18:22.426607 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.426586    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kdsf4"]
Jul 02 14:18:22.426743 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.426718    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.429197 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.429176    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 02 14:18:22.429299 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.429166    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 02 14:18:22.429466 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.429451    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 02 14:18:22.429611 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.429595    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-smrz6\""
Jul 02 14:18:22.430621 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.430604    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.433050 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.433034    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 14:18:22.433145 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.433114    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 14:18:22.433145 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.433035    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 14:18:22.433326 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.433308    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h5vwt\""
Jul 02 14:18:22.437350 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.437328    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"]
Jul 02 14:18:22.440280 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.440243    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-gqx4g"]
Jul 02 14:18:22.547896 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.547859    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.548088 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.547903    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.548088 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.547934    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb88d99-96c3-4bbb-b289-e9709e170871-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-6h8cs\" (UID: \"cfb88d99-96c3-4bbb-b289-e9709e170871\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:22.548088 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.547953    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-wtmp\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.548088 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.547990    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfb88d99-96c3-4bbb-b289-e9709e170871-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-6h8cs\" (UID: \"cfb88d99-96c3-4bbb-b289-e9709e170871\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:22.548088 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548072    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28p7d\" (UniqueName: \"kubernetes.io/projected/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-api-access-28p7d\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.548318 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548105    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfb88d99-96c3-4bbb-b289-e9709e170871-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-6h8cs\" (UID: \"cfb88d99-96c3-4bbb-b289-e9709e170871\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:22.548318 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548129    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x5f4\" (UniqueName: \"kubernetes.io/projected/cfb88d99-96c3-4bbb-b289-e9709e170871-kube-api-access-7x5f4\") pod \"openshift-state-metrics-57f99c8b49-6h8cs\" (UID: \"cfb88d99-96c3-4bbb-b289-e9709e170871\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:22.548318 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548152    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.548318 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548201    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1c174ed2-b798-4b00-a1f1-343f50ed01af-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.548318 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548223    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11ee1987-424e-4880-bdeb-3ea527359cdf-root\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.548318 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-textfile\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.548318 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548272    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-tls\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.548318 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-accelerators-collector-config\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.548684 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548346    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11ee1987-424e-4880-bdeb-3ea527359cdf-metrics-client-ca\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.548684 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11ee1987-424e-4880-bdeb-3ea527359cdf-sys\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.548684 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548394    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.548684 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkmqm\" (UniqueName: \"kubernetes.io/projected/11ee1987-424e-4880-bdeb-3ea527359cdf-kube-api-access-zkmqm\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.548684 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.548442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c174ed2-b798-4b00-a1f1-343f50ed01af-metrics-client-ca\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.649450 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.649404    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11ee1987-424e-4880-bdeb-3ea527359cdf-root\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.649682 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.649476    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-textfile\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.649682 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.649500    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-tls\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.649682 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.649538    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-accelerators-collector-config\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.649682 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.649542    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/11ee1987-424e-4880-bdeb-3ea527359cdf-root\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.649682 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.649572    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11ee1987-424e-4880-bdeb-3ea527359cdf-metrics-client-ca\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.649682 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.649597    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11ee1987-424e-4880-bdeb-3ea527359cdf-sys\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.649682 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.649627    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.649682 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.649671    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkmqm\" (UniqueName: \"kubernetes.io/projected/11ee1987-424e-4880-bdeb-3ea527359cdf-kube-api-access-zkmqm\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.650085 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:18:22.649686    2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 14:18:22.650085 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.649704    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11ee1987-424e-4880-bdeb-3ea527359cdf-sys\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.650085 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:18:22.649757    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-tls podName:11ee1987-424e-4880-bdeb-3ea527359cdf nodeName:}" failed. No retries permitted until 2026-07-02 14:18:23.149733415 +0000 UTC m=+110.781626344 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-tls") pod "node-exporter-kdsf4" (UID: "11ee1987-424e-4880-bdeb-3ea527359cdf") : secret "node-exporter-tls" not found
Jul 02 14:18:22.650085 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:18:22.649783    2559 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 02 14:18:22.650085 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.649692    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c174ed2-b798-4b00-a1f1-343f50ed01af-metrics-client-ca\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.650085 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:18:22.649848    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-state-metrics-tls podName:1c174ed2-b798-4b00-a1f1-343f50ed01af nodeName:}" failed. No retries permitted until 2026-07-02 14:18:23.149829113 +0000 UTC m=+110.781722032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-state-metrics-tls") pod "kube-state-metrics-845b954455-gqx4g" (UID: "1c174ed2-b798-4b00-a1f1-343f50ed01af") : secret "kube-state-metrics-tls" not found
Jul 02 14:18:22.650085 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.649895    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-textfile\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.650085 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650030    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.650085 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.650518 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650123    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb88d99-96c3-4bbb-b289-e9709e170871-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-6h8cs\" (UID: \"cfb88d99-96c3-4bbb-b289-e9709e170871\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:22.650518 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650153    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-wtmp\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.650518 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfb88d99-96c3-4bbb-b289-e9709e170871-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-6h8cs\" (UID: \"cfb88d99-96c3-4bbb-b289-e9709e170871\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:22.650518 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650309    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28p7d\" (UniqueName: \"kubernetes.io/projected/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-api-access-28p7d\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.650518 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650330    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-wtmp\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.650518 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfb88d99-96c3-4bbb-b289-e9709e170871-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-6h8cs\" (UID: \"cfb88d99-96c3-4bbb-b289-e9709e170871\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:22.650518 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x5f4\" (UniqueName: \"kubernetes.io/projected/cfb88d99-96c3-4bbb-b289-e9709e170871-kube-api-access-7x5f4\") pod \"openshift-state-metrics-57f99c8b49-6h8cs\" (UID: \"cfb88d99-96c3-4bbb-b289-e9709e170871\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:22.650518 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650406    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.650518 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1c174ed2-b798-4b00-a1f1-343f50ed01af-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.650969 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650747    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-accelerators-collector-config\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.650969 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650749    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/11ee1987-424e-4880-bdeb-3ea527359cdf-metrics-client-ca\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.650969 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.650820    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1c174ed2-b798-4b00-a1f1-343f50ed01af-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.651474 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.651137    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfb88d99-96c3-4bbb-b289-e9709e170871-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-6h8cs\" (UID: \"cfb88d99-96c3-4bbb-b289-e9709e170871\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:22.651474 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.651441    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.651876 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.651849    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c174ed2-b798-4b00-a1f1-343f50ed01af-metrics-client-ca\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.653265 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.653244    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cfb88d99-96c3-4bbb-b289-e9709e170871-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-6h8cs\" (UID: \"cfb88d99-96c3-4bbb-b289-e9709e170871\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:22.653364 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.653250    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.653869 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.653850    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cfb88d99-96c3-4bbb-b289-e9709e170871-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-6h8cs\" (UID: \"cfb88d99-96c3-4bbb-b289-e9709e170871\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:22.654036 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.654014    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.663590 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.663559    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkmqm\" (UniqueName: \"kubernetes.io/projected/11ee1987-424e-4880-bdeb-3ea527359cdf-kube-api-access-zkmqm\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:22.663943 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.663915    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x5f4\" (UniqueName: \"kubernetes.io/projected/cfb88d99-96c3-4bbb-b289-e9709e170871-kube-api-access-7x5f4\") pod \"openshift-state-metrics-57f99c8b49-6h8cs\" (UID: \"cfb88d99-96c3-4bbb-b289-e9709e170871\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:22.664957 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.664938    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28p7d\" (UniqueName: \"kubernetes.io/projected/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-api-access-28p7d\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:22.735430 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:22.735351    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"
Jul 02 14:18:23.155248 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.155209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-tls\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:23.155461 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.155294    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:23.157941 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.157910    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/11ee1987-424e-4880-bdeb-3ea527359cdf-node-exporter-tls\") pod \"node-exporter-kdsf4\" (UID: \"11ee1987-424e-4880-bdeb-3ea527359cdf\") " pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:23.158079 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.158053    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c174ed2-b798-4b00-a1f1-343f50ed01af-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-gqx4g\" (UID: \"1c174ed2-b798-4b00-a1f1-343f50ed01af\") " pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:23.345107 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.345073    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g"
Jul 02 14:18:23.353082 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.353056    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kdsf4"
Jul 02 14:18:23.371256 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:23.371157    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ee1987_424e_4880_bdeb_3ea527359cdf.slice/crio-164cf582a505446136466f287788e77a2c246a030c8fc639522a309368a8637d WatchSource:0}: Error finding container 164cf582a505446136466f287788e77a2c246a030c8fc639522a309368a8637d: Status 404 returned error can't find the container with id 164cf582a505446136466f287788e77a2c246a030c8fc639522a309368a8637d
Jul 02 14:18:23.405490 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.405428    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs"]
Jul 02 14:18:23.410334 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:23.410299    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb88d99_96c3_4bbb_b289_e9709e170871.slice/crio-06b49590fc0840d8459e1c6c417f98b3346fe27dee2470c0d29a572f25b6be25 WatchSource:0}: Error finding container 06b49590fc0840d8459e1c6c417f98b3346fe27dee2470c0d29a572f25b6be25: Status 404 returned error can't find the container with id 06b49590fc0840d8459e1c6c417f98b3346fe27dee2470c0d29a572f25b6be25
Jul 02 14:18:23.506931 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.506909    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-gqx4g"]
Jul 02 14:18:23.515719 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:23.515690    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c174ed2_b798_4b00_a1f1_343f50ed01af.slice/crio-3bcaec6402415c2768eaf014d1e7d65c044db55720a768d30f7450fdd7ff73d5 WatchSource:0}: Error finding container 3bcaec6402415c2768eaf014d1e7d65c044db55720a768d30f7450fdd7ff73d5: Status 404 returned error can't find the container with id 3bcaec6402415c2768eaf014d1e7d65c044db55720a768d30f7450fdd7ff73d5
Jul 02 14:18:23.631542 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.631510    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 14:18:23.635243 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.635222    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.637895 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.637861    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 14:18:23.638034 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.637893    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 14:18:23.638034 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.637906    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 14:18:23.638034 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.637919    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 14:18:23.638034 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.637972    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 14:18:23.638034 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.637927    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 14:18:23.638034 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.637861    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 14:18:23.638288 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.638278    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 14:18:23.638339 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.638306    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 14:18:23.638391 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.638376    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7pqcl\""
Jul 02 14:18:23.659634 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.659561    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 14:18:23.759467 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.759432    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.759631 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.759482    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a88b211-24e9-48b8-aaf4-b19ceafd0806-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.759631 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.759556    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.759631 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.759588    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-web-config\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.759631 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.759609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a88b211-24e9-48b8-aaf4-b19ceafd0806-config-out\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.759821 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.759644    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.759821 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.759700    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.759821 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.759724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.759821 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.759744    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a88b211-24e9-48b8-aaf4-b19ceafd0806-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.759821 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.759769    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.759821 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.759785    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a88b211-24e9-48b8-aaf4-b19ceafd0806-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.760063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.759850    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a88b211-24e9-48b8-aaf4-b19ceafd0806-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.760063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.759872    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z75xx\" (UniqueName: \"kubernetes.io/projected/3a88b211-24e9-48b8-aaf4-b19ceafd0806-kube-api-access-z75xx\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.860350 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.860315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.860540 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.860359    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a88b211-24e9-48b8-aaf4-b19ceafd0806-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.860540 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.860410    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a88b211-24e9-48b8-aaf4-b19ceafd0806-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.860540 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.860434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z75xx\" (UniqueName: \"kubernetes.io/projected/3a88b211-24e9-48b8-aaf4-b19ceafd0806-kube-api-access-z75xx\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.860540 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.860464    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.860540 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:18:23.860519    2559 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 02 14:18:23.860833 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:18:23.860595    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-main-tls podName:3a88b211-24e9-48b8-aaf4-b19ceafd0806 nodeName:}" failed. No retries permitted until 2026-07-02 14:18:24.360574037 +0000 UTC m=+111.992466973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806") : secret "alertmanager-main-tls" not found
Jul 02 14:18:23.860833 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.860522    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a88b211-24e9-48b8-aaf4-b19ceafd0806-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.860833 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.860669    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.860833 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.860708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-web-config\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.860833 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.860743    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a88b211-24e9-48b8-aaf4-b19ceafd0806-config-out\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.860833 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.860769    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.860833 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.860796    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.860833 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.860823    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.861213 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.860850    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a88b211-24e9-48b8-aaf4-b19ceafd0806-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.861213 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.861203    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a88b211-24e9-48b8-aaf4-b19ceafd0806-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.861331 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.861215    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a88b211-24e9-48b8-aaf4-b19ceafd0806-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.861483 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.861434    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a88b211-24e9-48b8-aaf4-b19ceafd0806-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.863899 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.863855    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a88b211-24e9-48b8-aaf4-b19ceafd0806-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.864527 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.864499    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.865299 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.865245    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-config-volume\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.865749 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.865717    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.865882 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.865839    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a88b211-24e9-48b8-aaf4-b19ceafd0806-config-out\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.865997 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.865983    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.866390 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.866368    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.866727 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.866706    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-web-config\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:23.870152 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:23.870130    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z75xx\" (UniqueName: \"kubernetes.io/projected/3a88b211-24e9-48b8-aaf4-b19ceafd0806-kube-api-access-z75xx\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:24.315629 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:24.315601    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sw4qm"
Jul 02 14:18:24.354615 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:24.353949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kdsf4" event={"ID":"11ee1987-424e-4880-bdeb-3ea527359cdf","Type":"ContainerStarted","Data":"c9c9014bd4f895b3f073eef749d4ad77ae597c1f050179a19f1a5c89f1efbac3"}
Jul 02 14:18:24.354615 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:24.354011    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kdsf4" event={"ID":"11ee1987-424e-4880-bdeb-3ea527359cdf","Type":"ContainerStarted","Data":"164cf582a505446136466f287788e77a2c246a030c8fc639522a309368a8637d"}
Jul 02 14:18:24.356750 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:24.356643    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g" event={"ID":"1c174ed2-b798-4b00-a1f1-343f50ed01af","Type":"ContainerStarted","Data":"3bcaec6402415c2768eaf014d1e7d65c044db55720a768d30f7450fdd7ff73d5"}
Jul 02 14:18:24.360026 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:24.359995    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bmcqq" event={"ID":"06fa0dba-ee3e-448e-90a0-130b0a6148d4","Type":"ContainerStarted","Data":"e76658f976b9974bac12369c6e96688f7b216bc3dfebbc06717ec294b0b3d64f"}
Jul 02 14:18:24.362690 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:24.362665    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs" event={"ID":"cfb88d99-96c3-4bbb-b289-e9709e170871","Type":"ContainerStarted","Data":"e581bfbbd8d54cb87845718d7645e59dcabdb7926db454dc8903de5127d822dc"}
Jul 02 14:18:24.362800 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:24.362712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs" event={"ID":"cfb88d99-96c3-4bbb-b289-e9709e170871","Type":"ContainerStarted","Data":"fde172bd28f3a97142d90ed828af3c5d69dbd9c10130e7938b8171208b54b08e"}
Jul 02 14:18:24.362800 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:24.362733    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs" event={"ID":"cfb88d99-96c3-4bbb-b289-e9709e170871","Type":"ContainerStarted","Data":"06b49590fc0840d8459e1c6c417f98b3346fe27dee2470c0d29a572f25b6be25"}
Jul 02 14:18:24.365181 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:24.365155    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:24.367954 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:24.367927    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:24.395595 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:24.394971    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bmcqq" podStartSLOduration=34.382939429 podStartE2EDuration="43.394951014s" totalImagesPullingTime="9.012011585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:17:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:24.39340435 +0000 UTC m=+112.025297312" watchObservedRunningTime="2026-07-02 14:18:24.394951014 +0000 UTC m=+112.026843952"
Jul 02 14:18:24.544748 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:24.544714    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:18:24.885760 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:24.885728    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 14:18:25.101348 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:25.101269    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a88b211_24e9_48b8_aaf4_b19ceafd0806.slice/crio-1f99ac877852aa65ee33d031912795a27725893ca11b8431a2b960add20ca5b4 WatchSource:0}: Error finding container 1f99ac877852aa65ee33d031912795a27725893ca11b8431a2b960add20ca5b4: Status 404 returned error can't find the container with id 1f99ac877852aa65ee33d031912795a27725893ca11b8431a2b960add20ca5b4
Jul 02 14:18:25.368685 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.368601    2559 generic.go:356] "Generic (PLEG): container finished" podID="11ee1987-424e-4880-bdeb-3ea527359cdf" containerID="c9c9014bd4f895b3f073eef749d4ad77ae597c1f050179a19f1a5c89f1efbac3" exitCode=0
Jul 02 14:18:25.368810 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.368685    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kdsf4" event={"ID":"11ee1987-424e-4880-bdeb-3ea527359cdf","Type":"ContainerDied","Data":"c9c9014bd4f895b3f073eef749d4ad77ae597c1f050179a19f1a5c89f1efbac3"}
Jul 02 14:18:25.371020 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.370991    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g" event={"ID":"1c174ed2-b798-4b00-a1f1-343f50ed01af","Type":"ContainerStarted","Data":"43891b2b362a68b8fb870b36db083807675f3279762e4621022dc6217000a413"}
Jul 02 14:18:25.371156 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.371051    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g" event={"ID":"1c174ed2-b798-4b00-a1f1-343f50ed01af","Type":"ContainerStarted","Data":"268c06514c6728af5e7cfa2e3a209da3eaeb0b3ee4da3d0b2fa19df4ad390176"}
Jul 02 14:18:25.371156 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.371086    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g" event={"ID":"1c174ed2-b798-4b00-a1f1-343f50ed01af","Type":"ContainerStarted","Data":"34ed35f79235a0491923f1f90a855e648595bef1964aaa4dafc2c2cd3b2064ba"}
Jul 02 14:18:25.372476 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.372453    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerStarted","Data":"1f99ac877852aa65ee33d031912795a27725893ca11b8431a2b960add20ca5b4"}
Jul 02 14:18:25.374931 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.374904    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs" event={"ID":"cfb88d99-96c3-4bbb-b289-e9709e170871","Type":"ContainerStarted","Data":"391f08288a64dc0542ae13a8fc13c151adee408e7f62ae9aa2ff9fc3068d87df"}
Jul 02 14:18:25.410801 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.410759    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-gqx4g" podStartSLOduration=1.782166651 podStartE2EDuration="3.41074373s" totalImagesPullingTime="1.628577079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:25.409894198 +0000 UTC m=+113.041787197" watchObservedRunningTime="2026-07-02 14:18:25.41074373 +0000 UTC m=+113.042636669"
Jul 02 14:18:25.431071 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.431025    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-6h8cs" podStartSLOduration=1.8759946269999999 podStartE2EDuration="3.431006522s" totalImagesPullingTime="1.555011895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:25.429640183 +0000 UTC m=+113.061533132" watchObservedRunningTime="2026-07-02 14:18:25.431006522 +0000 UTC m=+113.062899462"
Jul 02 14:18:25.544723 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.544683    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5594996499-9gsrj"]
Jul 02 14:18:25.549106 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.549082    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.551687 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.551664    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 02 14:18:25.551807 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.551700    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-g5jnc\""
Jul 02 14:18:25.551807 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.551732    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 02 14:18:25.551807 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.551739    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 02 14:18:25.552062 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.552024    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-535cmosbm1rn2\""
Jul 02 14:18:25.552117 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.552091    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 02 14:18:25.552117 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.552096    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 02 14:18:25.563760 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.563739    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5594996499-9gsrj"]
Jul 02 14:18:25.678629 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.678549    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt5fg\" (UniqueName: \"kubernetes.io/projected/2bcb328b-5d5a-48ee-84da-35fcaa205906-kube-api-access-vt5fg\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.678629 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.678592    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.678629 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.678613    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.678930 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.678741    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-tls\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.678930 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.678806    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.678930 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.678830    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bcb328b-5d5a-48ee-84da-35fcaa205906-metrics-client-ca\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.678930 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.678865    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-grpc-tls\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.678930 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.678919    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.779672 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.779624    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt5fg\" (UniqueName: \"kubernetes.io/projected/2bcb328b-5d5a-48ee-84da-35fcaa205906-kube-api-access-vt5fg\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.779856 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.779694    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.779856 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.779820    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.779964 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.779898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-tls\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.779964 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.779940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.780075 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.779962    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bcb328b-5d5a-48ee-84da-35fcaa205906-metrics-client-ca\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.780075 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.780002    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-grpc-tls\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.780075 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.780032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.780861 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.780800    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bcb328b-5d5a-48ee-84da-35fcaa205906-metrics-client-ca\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.782829 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.782802    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.782958 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.782845    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.783146 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.783123    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-tls\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.783199 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.783181    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.783253 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.783219    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.783253 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.783226    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2bcb328b-5d5a-48ee-84da-35fcaa205906-secret-grpc-tls\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.791037 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.791014    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt5fg\" (UniqueName: \"kubernetes.io/projected/2bcb328b-5d5a-48ee-84da-35fcaa205906-kube-api-access-vt5fg\") pod \"thanos-querier-5594996499-9gsrj\" (UID: \"2bcb328b-5d5a-48ee-84da-35fcaa205906\") " pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.861491 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.861450    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:25.993099 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:25.993074    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5594996499-9gsrj"]
Jul 02 14:18:25.994939 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:25.994915    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcb328b_5d5a_48ee_84da_35fcaa205906.slice/crio-71392a2c20a684908bc4bc7966fee2acb3813947c5155deb79de7a2b217a0b81 WatchSource:0}: Error finding container 71392a2c20a684908bc4bc7966fee2acb3813947c5155deb79de7a2b217a0b81: Status 404 returned error can't find the container with id 71392a2c20a684908bc4bc7966fee2acb3813947c5155deb79de7a2b217a0b81
Jul 02 14:18:26.379867 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.379835    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5594996499-9gsrj" event={"ID":"2bcb328b-5d5a-48ee-84da-35fcaa205906","Type":"ContainerStarted","Data":"71392a2c20a684908bc4bc7966fee2acb3813947c5155deb79de7a2b217a0b81"}
Jul 02 14:18:26.381716 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.381686    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kdsf4" event={"ID":"11ee1987-424e-4880-bdeb-3ea527359cdf","Type":"ContainerStarted","Data":"41faed0e6d3fee979450fcc0e04d9e0d8f2b198896f68fefc20b999218cbe478"}
Jul 02 14:18:26.381845 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.381743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kdsf4" event={"ID":"11ee1987-424e-4880-bdeb-3ea527359cdf","Type":"ContainerStarted","Data":"6c35964a784eb53165ea2d903268a9a04d5a47986312aab728c8ea55d9fadead"}
Jul 02 14:18:26.400705 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.400624    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kdsf4" podStartSLOduration=3.461438625 podStartE2EDuration="4.400612008s" totalImagesPullingTime="856.399628ms" totalInitContainerRuntime="82.773755ms" isStatefulPod=true podCreationTimestamp="2026-07-02 14:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:26.399896918 +0000 UTC m=+114.031789856" watchObservedRunningTime="2026-07-02 14:18:26.400612008 +0000 UTC m=+114.032504945"
Jul 02 14:18:26.836133 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.836091    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"]
Jul 02 14:18:26.839483 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.839465    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.842030 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.842005    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 02 14:18:26.842030 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.842022    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dq4djnhkp8cci\""
Jul 02 14:18:26.843075 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.843053    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 02 14:18:26.843181 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.843093    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 02 14:18:26.843181 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.843105    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 14:18:26.843181 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.843135    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-4jbbm\""
Jul 02 14:18:26.850112 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.850093    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"]
Jul 02 14:18:26.889134 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.889103    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-client-ca-bundle\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.889272 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.889138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztj7k\" (UniqueName: \"kubernetes.io/projected/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-kube-api-access-ztj7k\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.889272 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.889162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-audit-log\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.889341 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.889280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-secret-metrics-server-client-certs\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.889341 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.889309    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.889341 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.889326    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-metrics-server-audit-profiles\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.889453 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.889350    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-secret-metrics-server-tls\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.989793 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.989762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-client-ca-bundle\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.989793 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.989793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztj7k\" (UniqueName: \"kubernetes.io/projected/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-kube-api-access-ztj7k\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.990022 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.989815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-audit-log\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.990022 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.989873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-secret-metrics-server-client-certs\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.990022 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.989896    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.990022 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.989911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-metrics-server-audit-profiles\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.990022 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.989931    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-secret-metrics-server-tls\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.990453 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.990420    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-audit-log\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.990856 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.990829    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.990945 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.990854    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-metrics-server-audit-profiles\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.992230 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.992208    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-client-ca-bundle\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.992333 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.992281    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-secret-metrics-server-tls\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.992388 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.992371    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-secret-metrics-server-client-certs\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:26.998703 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:26.998683    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztj7k\" (UniqueName: \"kubernetes.io/projected/6dcad3e6-c885-4c41-9a76-4f66f5a8d86e-kube-api-access-ztj7k\") pod \"metrics-server-6fc9cc7f56-5wstk\" (UID: \"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e\") " pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:27.149232 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.149158    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:27.185780 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.185748    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"]
Jul 02 14:18:27.190200 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.190176    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"
Jul 02 14:18:27.194133 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.194069    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 02 14:18:27.194340 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.194322    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4w4vv\""
Jul 02 14:18:27.194717 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.194691    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shf5k\" (UniqueName: \"kubernetes.io/projected/9f92a766-d214-4289-afed-f7792247c762-kube-api-access-shf5k\") pod \"monitoring-plugin-cd8656b8-48wjj\" (UID: \"9f92a766-d214-4289-afed-f7792247c762\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"
Jul 02 14:18:27.194870 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.194760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f92a766-d214-4289-afed-f7792247c762-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-48wjj\" (UID: \"9f92a766-d214-4289-afed-f7792247c762\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"
Jul 02 14:18:27.198993 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.198969    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"]
Jul 02 14:18:27.295245 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.295208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f92a766-d214-4289-afed-f7792247c762-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-48wjj\" (UID: \"9f92a766-d214-4289-afed-f7792247c762\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"
Jul 02 14:18:27.295412 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.295326    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shf5k\" (UniqueName: \"kubernetes.io/projected/9f92a766-d214-4289-afed-f7792247c762-kube-api-access-shf5k\") pod \"monitoring-plugin-cd8656b8-48wjj\" (UID: \"9f92a766-d214-4289-afed-f7792247c762\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"
Jul 02 14:18:27.295412 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:18:27.295392    2559 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 02 14:18:27.295538 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:18:27.295461    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f92a766-d214-4289-afed-f7792247c762-monitoring-plugin-cert podName:9f92a766-d214-4289-afed-f7792247c762 nodeName:}" failed. No retries permitted until 2026-07-02 14:18:27.795442804 +0000 UTC m=+115.427335736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9f92a766-d214-4289-afed-f7792247c762-monitoring-plugin-cert") pod "monitoring-plugin-cd8656b8-48wjj" (UID: "9f92a766-d214-4289-afed-f7792247c762") : secret "monitoring-plugin-cert" not found
Jul 02 14:18:27.296603 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.296574    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"]
Jul 02 14:18:27.299408 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:27.299389    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dcad3e6_c885_4c41_9a76_4f66f5a8d86e.slice/crio-78026b3532ed67885a69f85d31682c9fa1fa107113da827351edd6492b5ec751 WatchSource:0}: Error finding container 78026b3532ed67885a69f85d31682c9fa1fa107113da827351edd6492b5ec751: Status 404 returned error can't find the container with id 78026b3532ed67885a69f85d31682c9fa1fa107113da827351edd6492b5ec751
Jul 02 14:18:27.304869 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.304841    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shf5k\" (UniqueName: \"kubernetes.io/projected/9f92a766-d214-4289-afed-f7792247c762-kube-api-access-shf5k\") pod \"monitoring-plugin-cd8656b8-48wjj\" (UID: \"9f92a766-d214-4289-afed-f7792247c762\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"
Jul 02 14:18:27.387717 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.387683    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk" event={"ID":"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e","Type":"ContainerStarted","Data":"78026b3532ed67885a69f85d31682c9fa1fa107113da827351edd6492b5ec751"}
Jul 02 14:18:27.641952 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.641916    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6698899469-rvmmw"]
Jul 02 14:18:27.645757 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.645738    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.648703 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.648675    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 02 14:18:27.648703 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.648699    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 02 14:18:27.648867 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.648675    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 02 14:18:27.648867 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.648789    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 02 14:18:27.649005 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.648989    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 02 14:18:27.649107 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.649093    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-82pvd\""
Jul 02 14:18:27.654777 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.654760    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 02 14:18:27.659484 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.659462    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6698899469-rvmmw"]
Jul 02 14:18:27.698677 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.698638    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/221f24de-5723-4f15-a9dc-f3558f8cf1b0-secret-telemeter-client\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.698837 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.698690    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pln9w\" (UniqueName: \"kubernetes.io/projected/221f24de-5723-4f15-a9dc-f3558f8cf1b0-kube-api-access-pln9w\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.698837 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.698721    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/221f24de-5723-4f15-a9dc-f3558f8cf1b0-serving-certs-ca-bundle\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.698837 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.698784    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/221f24de-5723-4f15-a9dc-f3558f8cf1b0-metrics-client-ca\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.698837 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.698808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/221f24de-5723-4f15-a9dc-f3558f8cf1b0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.699046 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.698860    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/221f24de-5723-4f15-a9dc-f3558f8cf1b0-federate-client-tls\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.699046 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.698918    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/221f24de-5723-4f15-a9dc-f3558f8cf1b0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.699046 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.698979    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/221f24de-5723-4f15-a9dc-f3558f8cf1b0-telemeter-client-tls\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.799908 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.799868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/221f24de-5723-4f15-a9dc-f3558f8cf1b0-secret-telemeter-client\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.800085 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.799919    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pln9w\" (UniqueName: \"kubernetes.io/projected/221f24de-5723-4f15-a9dc-f3558f8cf1b0-kube-api-access-pln9w\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.800085 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.799948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/221f24de-5723-4f15-a9dc-f3558f8cf1b0-serving-certs-ca-bundle\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.800085 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.800007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f92a766-d214-4289-afed-f7792247c762-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-48wjj\" (UID: \"9f92a766-d214-4289-afed-f7792247c762\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"
Jul 02 14:18:27.800085 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.800032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/221f24de-5723-4f15-a9dc-f3558f8cf1b0-metrics-client-ca\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.800085 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.800058    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/221f24de-5723-4f15-a9dc-f3558f8cf1b0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.800327 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.800107    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/221f24de-5723-4f15-a9dc-f3558f8cf1b0-federate-client-tls\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.800327 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.800173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/221f24de-5723-4f15-a9dc-f3558f8cf1b0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.800327 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.800219    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/221f24de-5723-4f15-a9dc-f3558f8cf1b0-telemeter-client-tls\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.800985 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.800958    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/221f24de-5723-4f15-a9dc-f3558f8cf1b0-metrics-client-ca\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.801281 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.801234    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/221f24de-5723-4f15-a9dc-f3558f8cf1b0-serving-certs-ca-bundle\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.801531 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.801506    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/221f24de-5723-4f15-a9dc-f3558f8cf1b0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.803705 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.803641    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/221f24de-5723-4f15-a9dc-f3558f8cf1b0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.804006 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.803968    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/221f24de-5723-4f15-a9dc-f3558f8cf1b0-secret-telemeter-client\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.804084 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.804035    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/221f24de-5723-4f15-a9dc-f3558f8cf1b0-telemeter-client-tls\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.805093 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.805054    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/221f24de-5723-4f15-a9dc-f3558f8cf1b0-federate-client-tls\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.805236 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.805215    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9f92a766-d214-4289-afed-f7792247c762-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-48wjj\" (UID: \"9f92a766-d214-4289-afed-f7792247c762\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"
Jul 02 14:18:27.806798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.806775    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"
Jul 02 14:18:27.811142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.811055    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pln9w\" (UniqueName: \"kubernetes.io/projected/221f24de-5723-4f15-a9dc-f3558f8cf1b0-kube-api-access-pln9w\") pod \"telemeter-client-6698899469-rvmmw\" (UID: \"221f24de-5723-4f15-a9dc-f3558f8cf1b0\") " pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.961508 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.961431    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"]
Jul 02 14:18:27.962574 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:27.962529    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6698899469-rvmmw"
Jul 02 14:18:27.966689 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:27.966573    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f92a766_d214_4289_afed_f7792247c762.slice/crio-c0d737ed26a4aa7a75debe38aabb372e246e615be24fc194eec034dbf3a6c6ef WatchSource:0}: Error finding container c0d737ed26a4aa7a75debe38aabb372e246e615be24fc194eec034dbf3a6c6ef: Status 404 returned error can't find the container with id c0d737ed26a4aa7a75debe38aabb372e246e615be24fc194eec034dbf3a6c6ef
Jul 02 14:18:28.142799 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.142767    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6698899469-rvmmw"]
Jul 02 14:18:28.394144 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.394097    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj" event={"ID":"9f92a766-d214-4289-afed-f7792247c762","Type":"ContainerStarted","Data":"c0d737ed26a4aa7a75debe38aabb372e246e615be24fc194eec034dbf3a6c6ef"}
Jul 02 14:18:28.671663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.670858    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 14:18:28.675985 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.675960    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.680542 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.678613    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 14:18:28.680542 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.678964    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 14:18:28.680542 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.679167    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 14:18:28.680542 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.679357    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-945v7r60uda3p\""
Jul 02 14:18:28.680542 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.679841    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 14:18:28.680542 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.680002    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 14:18:28.680542 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.680157    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 14:18:28.680542 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.680310    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 14:18:28.681004 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.680593    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qfhcz\""
Jul 02 14:18:28.681004 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.680729    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 14:18:28.681004 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.680756    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 14:18:28.681004 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.680764    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 14:18:28.681202 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.681143    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 14:18:28.681396 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.681378    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 14:18:28.682357 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.682274    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 14:18:28.683163 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.683130    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 14:18:28.694220 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.693216    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 14:18:28.712228 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712118    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712228 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712170    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712452 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712228    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712452 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712272    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/791b6e13-aca8-4d13-8cd6-4aa39f259836-config-out\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712452 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712326    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712452 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712355    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712452 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712382    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712452 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712444    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-config\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712797 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712474    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-web-config\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712797 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712797 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712528    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712797 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712559    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712797 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712612    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712797 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712631    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712797 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712691    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/791b6e13-aca8-4d13-8cd6-4aa39f259836-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712797 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712705    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712797 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712732    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712797 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcmv9\" (UniqueName: \"kubernetes.io/projected/791b6e13-aca8-4d13-8cd6-4aa39f259836-kube-api-access-mcmv9\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712797 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.712797 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.712792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.813780 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.813744    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-config\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.813780 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.813796    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-web-config\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814102 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.813826    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814102 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.813855    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814102 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.813886    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814102 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.813925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814102 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.813944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814102 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.813968    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/791b6e13-aca8-4d13-8cd6-4aa39f259836-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814102 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.813985    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814102 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.814014    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814102 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.814038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcmv9\" (UniqueName: \"kubernetes.io/projected/791b6e13-aca8-4d13-8cd6-4aa39f259836-kube-api-access-mcmv9\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814102 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.814071    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814551 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.814114    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814551 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.814147    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814551 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.814180    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814551 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.814204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814551 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.814231    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/791b6e13-aca8-4d13-8cd6-4aa39f259836-config-out\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814551 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.814268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814551 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.814283    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814551 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.814310    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.814964 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.814943    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.815022 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.814998    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.815967 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.815825    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.815967 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.815834    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.816136 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.816096    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.816694 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.816671    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.817982 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.817939    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-config\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.819394 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.818451    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.819394 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.818802    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.819790 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.819772    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.820347 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.820269    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.820453 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.820423    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.820642 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.820619    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.821036 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.821003    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.821135 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.821051    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/791b6e13-aca8-4d13-8cd6-4aa39f259836-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.822148 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.822116    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.822244 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.822155    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/791b6e13-aca8-4d13-8cd6-4aa39f259836-config-out\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.822302 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.822275    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.822713 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.822617    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-web-config\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.825616 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.825583    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcmv9\" (UniqueName: \"kubernetes.io/projected/791b6e13-aca8-4d13-8cd6-4aa39f259836-kube-api-access-mcmv9\") pod \"prometheus-k8s-0\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:28.989710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:28.989623    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:29.179750 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:29.179722    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod221f24de_5723_4f15_a9dc_f3558f8cf1b0.slice/crio-d8b3659f0e4d5581fe083332e4625fc6aa183c9c18048442c9374f5083449802 WatchSource:0}: Error finding container d8b3659f0e4d5581fe083332e4625fc6aa183c9c18048442c9374f5083449802: Status 404 returned error can't find the container with id d8b3659f0e4d5581fe083332e4625fc6aa183c9c18048442c9374f5083449802
Jul 02 14:18:29.399700 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:29.399644    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6698899469-rvmmw" event={"ID":"221f24de-5723-4f15-a9dc-f3558f8cf1b0","Type":"ContainerStarted","Data":"d8b3659f0e4d5581fe083332e4625fc6aa183c9c18048442c9374f5083449802"}
Jul 02 14:18:29.662088 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:29.661993    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 14:18:29.662787 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:29.662759    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791b6e13_aca8_4d13_8cd6_4aa39f259836.slice/crio-1f42dd763fb5cd079875488cf441f8a17e9938b7e52a057200d40c4906c29392 WatchSource:0}: Error finding container 1f42dd763fb5cd079875488cf441f8a17e9938b7e52a057200d40c4906c29392: Status 404 returned error can't find the container with id 1f42dd763fb5cd079875488cf441f8a17e9938b7e52a057200d40c4906c29392
Jul 02 14:18:30.406731 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:30.406422    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk" event={"ID":"6dcad3e6-c885-4c41-9a76-4f66f5a8d86e","Type":"ContainerStarted","Data":"7e2ade3c4c80d10f7e8df61a369583b9bb030cfd9e89ef64ed1c29a539cefdc0"}
Jul 02 14:18:30.408164 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:30.408136    2559 generic.go:356] "Generic (PLEG): container finished" podID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerID="2ff268a5355191d2e5758bb7540531941e818bb0c0f02cd9d4ff715565157d38" exitCode=0
Jul 02 14:18:30.408269 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:30.408228    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerDied","Data":"2ff268a5355191d2e5758bb7540531941e818bb0c0f02cd9d4ff715565157d38"}
Jul 02 14:18:30.410004 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:30.409970    2559 generic.go:356] "Generic (PLEG): container finished" podID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerID="6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512" exitCode=0
Jul 02 14:18:30.410080 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:30.410060    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerDied","Data":"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"}
Jul 02 14:18:30.410146 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:30.410129    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerStarted","Data":"1f42dd763fb5cd079875488cf441f8a17e9938b7e52a057200d40c4906c29392"}
Jul 02 14:18:30.412518 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:30.412488    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5594996499-9gsrj" event={"ID":"2bcb328b-5d5a-48ee-84da-35fcaa205906","Type":"ContainerStarted","Data":"5d8e8743664e87428b0e07ea8418bcce76a1d86889e2d3be483813647223e1ad"}
Jul 02 14:18:30.412613 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:30.412545    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5594996499-9gsrj" event={"ID":"2bcb328b-5d5a-48ee-84da-35fcaa205906","Type":"ContainerStarted","Data":"b56e66c9d568d6e3ce8fa28e93bf8152a5c94d02ca2ed5d477245fa268d478e2"}
Jul 02 14:18:30.412613 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:30.412582    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5594996499-9gsrj" event={"ID":"2bcb328b-5d5a-48ee-84da-35fcaa205906","Type":"ContainerStarted","Data":"1acb9271bb32fc7e4b37561cb7579ce6b6f9d3bded4075308cf8997c25656717"}
Jul 02 14:18:30.425060 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:30.424961    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk" podStartSLOduration=2.230527363 podStartE2EDuration="4.424947317s" totalImagesPullingTime="2.194419954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:18:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:30.423644599 +0000 UTC m=+118.055537559" watchObservedRunningTime="2026-07-02 14:18:30.424947317 +0000 UTC m=+118.056840304"
Jul 02 14:18:31.111133 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:31.111095    2559 patch_prober.go:28] interesting pod/image-registry-87d9c4c4d-s7r5c container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 14:18:31.111295 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:31.111161    2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c" podUID="e3f8207c-088f-4d1f-998e-5935331cd1a1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 14:18:31.419946 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:31.419860    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj" event={"ID":"9f92a766-d214-4289-afed-f7792247c762","Type":"ContainerStarted","Data":"c408948498e7307d8f66030de57b131da5ea109852db89d1cef1b2691decdf7f"}
Jul 02 14:18:31.439288 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:31.439230    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj" podStartSLOduration=2.003621709 podStartE2EDuration="4.439209449s" totalImagesPullingTime="2.43558774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:31.437743888 +0000 UTC m=+119.069636848" watchObservedRunningTime="2026-07-02 14:18:31.439209449 +0000 UTC m=+119.071102388"
Jul 02 14:18:32.427811 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:32.427776    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5594996499-9gsrj" event={"ID":"2bcb328b-5d5a-48ee-84da-35fcaa205906","Type":"ContainerStarted","Data":"ae775821c84dc1308564688ec95c66f98b321e83f0d4d75230bd7f976917a7aa"}
Jul 02 14:18:32.428256 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:32.427994    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:32.428256 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:32.428054    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5594996499-9gsrj" event={"ID":"2bcb328b-5d5a-48ee-84da-35fcaa205906","Type":"ContainerStarted","Data":"e4f5021a9e3c21c79d14688204deba46dcbc65f58c6f99dba695e32419c99d7f"}
Jul 02 14:18:32.428256 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:32.428103    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5594996499-9gsrj" event={"ID":"2bcb328b-5d5a-48ee-84da-35fcaa205906","Type":"ContainerStarted","Data":"3a67d3ebd8fdec1e5007bca9d3569c965d83b53f7c15619d4685dc35c687b094"}
Jul 02 14:18:32.430125 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:32.430097    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6698899469-rvmmw" event={"ID":"221f24de-5723-4f15-a9dc-f3558f8cf1b0","Type":"ContainerStarted","Data":"f35161f22066a9bce5b8cc5d2ffea0ee972308d923e7ea76cf223e416c38d181"}
Jul 02 14:18:32.430261 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:32.430154    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6698899469-rvmmw" event={"ID":"221f24de-5723-4f15-a9dc-f3558f8cf1b0","Type":"ContainerStarted","Data":"b75c6cc64a3b053b1f36741ddac1d9018d186f82572ef72a5d5d3d2a4a0b0c5d"}
Jul 02 14:18:32.430261 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:32.430184    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6698899469-rvmmw" event={"ID":"221f24de-5723-4f15-a9dc-f3558f8cf1b0","Type":"ContainerStarted","Data":"8d4c52374a1ae25bbfa96c24c2431e1ef57a24f1361c0e335d4a7e43be0bf73b"}
Jul 02 14:18:32.430369 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:32.430356    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"
Jul 02 14:18:32.435927 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:32.435902    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-48wjj"
Jul 02 14:18:32.455722 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:32.455669    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5594996499-9gsrj" podStartSLOduration=2.59889805 podStartE2EDuration="7.455639839s" totalImagesPullingTime="4.856741789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:18:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:32.453273717 +0000 UTC m=+120.085166657" watchObservedRunningTime="2026-07-02 14:18:32.455639839 +0000 UTC m=+120.087532776"
Jul 02 14:18:32.493151 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:32.493095    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6698899469-rvmmw" podStartSLOduration=3.006002553 podStartE2EDuration="5.493078885s" totalImagesPullingTime="2.487076332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:32.49081738 +0000 UTC m=+120.122710356" watchObservedRunningTime="2026-07-02 14:18:32.493078885 +0000 UTC m=+120.124971839"
Jul 02 14:18:33.303385 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:33.303294    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:18:33.756855 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:33.756824    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-87d9c4c4d-s7r5c"]
Jul 02 14:18:34.441973 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:34.441949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerStarted","Data":"fda9cbb6cf13c27b3b37f5b4fb18aba73043e89b3f8fc728b46b9be7863fd7ed"}
Jul 02 14:18:34.442061 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:34.442008    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerStarted","Data":"4cb93a30e59c35e351ce49b4c410c48bb03c1135f6c71cd23f8aa7bb54784e62"}
Jul 02 14:18:34.444146 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:34.444120    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerStarted","Data":"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"}
Jul 02 14:18:34.444222 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:34.444204    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerStarted","Data":"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"}
Jul 02 14:18:35.451437 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:35.451401    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerStarted","Data":"43d257875992e2fbb4320cd23a993a2115c8f3df6074a43e438fa0d3db707050"}
Jul 02 14:18:35.451858 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:35.451475    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerStarted","Data":"82e6b4fb070985afd0c2eadcf3339cdffc76c4a54bbc9ea80a9233160f7df18f"}
Jul 02 14:18:35.451858 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:35.451519    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerStarted","Data":"340fce40a4cdcc422b1fac02c53d8b276313ea4059b8893def72f82bead97ef1"}
Jul 02 14:18:35.451858 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:35.451553    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerStarted","Data":"4b1ece74fd9fbfe17d6a39f4f934d01a7550675480dedcd94f64c9d8ac405b4d"}
Jul 02 14:18:35.454533 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:35.454508    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerStarted","Data":"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"}
Jul 02 14:18:35.454664 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:35.454560    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerStarted","Data":"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"}
Jul 02 14:18:35.454664 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:35.454584    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerStarted","Data":"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"}
Jul 02 14:18:35.454664 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:35.454608    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerStarted","Data":"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"}
Jul 02 14:18:35.490532 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:35.490484    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.232414818 podStartE2EDuration="12.490469864s" totalImagesPullingTime="8.230447306s" totalInitContainerRuntime="27.60774ms" isStatefulPod=false podCreationTimestamp="2026-07-02 14:18:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:35.489051479 +0000 UTC m=+123.120944418" watchObservedRunningTime="2026-07-02 14:18:35.490469864 +0000 UTC m=+123.122362808"
Jul 02 14:18:35.527905 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:35.527854    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.629716399 podStartE2EDuration="7.527836348s" totalImagesPullingTime="3.874783038s" totalInitContainerRuntime="23.336911ms" isStatefulPod=false podCreationTimestamp="2026-07-02 14:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:35.526976251 +0000 UTC m=+123.158869191" watchObservedRunningTime="2026-07-02 14:18:35.527836348 +0000 UTC m=+123.159729286"
Jul 02 14:18:38.440668 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:38.440626    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5594996499-9gsrj"
Jul 02 14:18:38.990472 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:38.990440    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:18:42.758130 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:42.758087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:18:42.760672 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:42.760634    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84655b87-ce0c-4c23-afd6-51d4f4d06657-metrics-certs\") pod \"network-metrics-daemon-xg2xd\" (UID: \"84655b87-ce0c-4c23-afd6-51d4f4d06657\") " pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:18:42.898692 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:42.898663    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8mqz5\""
Jul 02 14:18:42.906901 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:42.906880    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xg2xd"
Jul 02 14:18:43.045159 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:43.045133    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xg2xd"]
Jul 02 14:18:43.047864 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:18:43.047838    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84655b87_ce0c_4c23_afd6_51d4f4d06657.slice/crio-fa54aac93c3468d099972799c58a5e2391fae5e0fe6e61af18952d27f53da098 WatchSource:0}: Error finding container fa54aac93c3468d099972799c58a5e2391fae5e0fe6e61af18952d27f53da098: Status 404 returned error can't find the container with id fa54aac93c3468d099972799c58a5e2391fae5e0fe6e61af18952d27f53da098
Jul 02 14:18:43.495830 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:43.495745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xg2xd" event={"ID":"84655b87-ce0c-4c23-afd6-51d4f4d06657","Type":"ContainerStarted","Data":"fa54aac93c3468d099972799c58a5e2391fae5e0fe6e61af18952d27f53da098"}
Jul 02 14:18:45.508364 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:45.508323    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xg2xd" event={"ID":"84655b87-ce0c-4c23-afd6-51d4f4d06657","Type":"ContainerStarted","Data":"a44aef9f104d591c96dfbd719ea9d25085047e6cdd469cd3c4f968081eb0018c"}
Jul 02 14:18:45.508806 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:45.508387    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xg2xd" event={"ID":"84655b87-ce0c-4c23-afd6-51d4f4d06657","Type":"ContainerStarted","Data":"72eef3f6445b498aefbf4ae67b4fa1a491bb40273fc81591e8abc8187125e2e0"}
Jul 02 14:18:45.527958 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:45.527907    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xg2xd" podStartSLOduration=129.983793157 podStartE2EDuration="2m11.527890576s" totalImagesPullingTime="1.544097419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:18:45.526303275 +0000 UTC m=+133.158196235" watchObservedRunningTime="2026-07-02 14:18:45.527890576 +0000 UTC m=+133.159783513"
Jul 02 14:18:47.150237 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:47.150199    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:47.150622 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:47.150514    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:18:58.779082 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:58.779016    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c" podUID="e3f8207c-088f-4d1f-998e-5935331cd1a1" containerName="registry" containerID="cri-o://c0e465e35c982d2ae214636d5b5280481b3b5d8c0d77707d1b482060172d3166" gracePeriod=30
Jul 02 14:18:59.022377 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.022350    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:18:59.208806 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.208720    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-certificates\") pod \"e3f8207c-088f-4d1f-998e-5935331cd1a1\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") "
Jul 02 14:18:59.208957 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.208839    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3f8207c-088f-4d1f-998e-5935331cd1a1-installation-pull-secrets\") pod \"e3f8207c-088f-4d1f-998e-5935331cd1a1\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") "
Jul 02 14:18:59.208957 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.208893    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3f8207c-088f-4d1f-998e-5935331cd1a1-ca-trust-extracted\") pod \"e3f8207c-088f-4d1f-998e-5935331cd1a1\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") "
Jul 02 14:18:59.208957 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.208922    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3f8207c-088f-4d1f-998e-5935331cd1a1-image-registry-private-configuration\") pod \"e3f8207c-088f-4d1f-998e-5935331cd1a1\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") "
Jul 02 14:18:59.209131 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.209108    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls\") pod \"e3f8207c-088f-4d1f-998e-5935331cd1a1\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") "
Jul 02 14:18:59.209177 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.209163    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-bound-sa-token\") pod \"e3f8207c-088f-4d1f-998e-5935331cd1a1\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") "
Jul 02 14:18:59.209226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.209209    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4g5k\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-kube-api-access-j4g5k\") pod \"e3f8207c-088f-4d1f-998e-5935331cd1a1\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") "
Jul 02 14:18:59.209277 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.209250    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3f8207c-088f-4d1f-998e-5935331cd1a1-trusted-ca\") pod \"e3f8207c-088f-4d1f-998e-5935331cd1a1\" (UID: \"e3f8207c-088f-4d1f-998e-5935331cd1a1\") "
Jul 02 14:18:59.209333 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.209187    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e3f8207c-088f-4d1f-998e-5935331cd1a1" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:18:59.209555 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.209532    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-certificates\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:18:59.210066 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.210031    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3f8207c-088f-4d1f-998e-5935331cd1a1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e3f8207c-088f-4d1f-998e-5935331cd1a1" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:18:59.211606 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.211577    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e3f8207c-088f-4d1f-998e-5935331cd1a1" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 14:18:59.211716 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.211599    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3f8207c-088f-4d1f-998e-5935331cd1a1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e3f8207c-088f-4d1f-998e-5935331cd1a1" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:18:59.211716 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.211624    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e3f8207c-088f-4d1f-998e-5935331cd1a1" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 14:18:59.211716 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.211701    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3f8207c-088f-4d1f-998e-5935331cd1a1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e3f8207c-088f-4d1f-998e-5935331cd1a1" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:18:59.211824 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.211782    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-kube-api-access-j4g5k" (OuterVolumeSpecName: "kube-api-access-j4g5k") pod "e3f8207c-088f-4d1f-998e-5935331cd1a1" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1"). InnerVolumeSpecName "kube-api-access-j4g5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 14:18:59.220042 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.220010    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3f8207c-088f-4d1f-998e-5935331cd1a1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e3f8207c-088f-4d1f-998e-5935331cd1a1" (UID: "e3f8207c-088f-4d1f-998e-5935331cd1a1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 14:18:59.310209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.310173    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3f8207c-088f-4d1f-998e-5935331cd1a1-ca-trust-extracted\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:18:59.310209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.310206    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3f8207c-088f-4d1f-998e-5935331cd1a1-image-registry-private-configuration\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:18:59.310209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.310216    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-registry-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:18:59.310437 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.310226    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-bound-sa-token\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:18:59.310437 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.310234    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4g5k\" (UniqueName: \"kubernetes.io/projected/e3f8207c-088f-4d1f-998e-5935331cd1a1-kube-api-access-j4g5k\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:18:59.310437 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.310242    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3f8207c-088f-4d1f-998e-5935331cd1a1-trusted-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:18:59.310437 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.310250    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3f8207c-088f-4d1f-998e-5935331cd1a1-installation-pull-secrets\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:18:59.573854 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.573819    2559 generic.go:356] "Generic (PLEG): container finished" podID="e3f8207c-088f-4d1f-998e-5935331cd1a1" containerID="c0e465e35c982d2ae214636d5b5280481b3b5d8c0d77707d1b482060172d3166" exitCode=0
Jul 02 14:18:59.573854 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.573856    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c"
Jul 02 14:18:59.574056 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.573905    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c" event={"ID":"e3f8207c-088f-4d1f-998e-5935331cd1a1","Type":"ContainerDied","Data":"c0e465e35c982d2ae214636d5b5280481b3b5d8c0d77707d1b482060172d3166"}
Jul 02 14:18:59.574056 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.573979    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-87d9c4c4d-s7r5c" event={"ID":"e3f8207c-088f-4d1f-998e-5935331cd1a1","Type":"ContainerDied","Data":"21747bac75664f52679d36ebe3823bc9761c854c68c59adfd6936ffc7e7b2951"}
Jul 02 14:18:59.574056 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.574012    2559 scope.go:117] "RemoveContainer" containerID="c0e465e35c982d2ae214636d5b5280481b3b5d8c0d77707d1b482060172d3166"
Jul 02 14:18:59.583950 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.583933    2559 scope.go:117] "RemoveContainer" containerID="c0e465e35c982d2ae214636d5b5280481b3b5d8c0d77707d1b482060172d3166"
Jul 02 14:18:59.584192 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:18:59.584174    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0e465e35c982d2ae214636d5b5280481b3b5d8c0d77707d1b482060172d3166\": container with ID starting with c0e465e35c982d2ae214636d5b5280481b3b5d8c0d77707d1b482060172d3166 not found: ID does not exist" containerID="c0e465e35c982d2ae214636d5b5280481b3b5d8c0d77707d1b482060172d3166"
Jul 02 14:18:59.584259 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.584200    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0e465e35c982d2ae214636d5b5280481b3b5d8c0d77707d1b482060172d3166"} err="failed to get container status \"c0e465e35c982d2ae214636d5b5280481b3b5d8c0d77707d1b482060172d3166\": rpc error: code = NotFound desc = could not find container \"c0e465e35c982d2ae214636d5b5280481b3b5d8c0d77707d1b482060172d3166\": container with ID starting with c0e465e35c982d2ae214636d5b5280481b3b5d8c0d77707d1b482060172d3166 not found: ID does not exist"
Jul 02 14:18:59.596919 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.596891    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-87d9c4c4d-s7r5c"]
Jul 02 14:18:59.603427 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:18:59.603406    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-87d9c4c4d-s7r5c"]
Jul 02 14:19:00.971104 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:00.971070    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3f8207c-088f-4d1f-998e-5935331cd1a1" path="/var/lib/kubelet/pods/e3f8207c-088f-4d1f-998e-5935331cd1a1/volumes"
Jul 02 14:19:07.155116 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:07.155085    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:19:07.158864 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:07.158845    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6fc9cc7f56-5wstk"
Jul 02 14:19:28.990118 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:28.990009    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:29.005534 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:29.005505    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:29.724670 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:29.724630    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:42.829906 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:42.829871    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 14:19:42.830406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:42.830166    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="alertmanager" containerID="cri-o://4cb93a30e59c35e351ce49b4c410c48bb03c1135f6c71cd23f8aa7bb54784e62" gracePeriod=120
Jul 02 14:19:42.830406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:42.830232    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="kube-rbac-proxy-metric" containerID="cri-o://82e6b4fb070985afd0c2eadcf3339cdffc76c4a54bbc9ea80a9233160f7df18f" gracePeriod=120
Jul 02 14:19:42.830406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:42.830260    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="config-reloader" containerID="cri-o://fda9cbb6cf13c27b3b37f5b4fb18aba73043e89b3f8fc728b46b9be7863fd7ed" gracePeriod=120
Jul 02 14:19:42.830406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:42.830299    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="kube-rbac-proxy" containerID="cri-o://340fce40a4cdcc422b1fac02c53d8b276313ea4059b8893def72f82bead97ef1" gracePeriod=120
Jul 02 14:19:42.830406 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:42.830323    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="prom-label-proxy" containerID="cri-o://43d257875992e2fbb4320cd23a993a2115c8f3df6074a43e438fa0d3db707050" gracePeriod=120
Jul 02 14:19:42.830677 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:42.830255    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="kube-rbac-proxy-web" containerID="cri-o://4b1ece74fd9fbfe17d6a39f4f934d01a7550675480dedcd94f64c9d8ac405b4d" gracePeriod=120
Jul 02 14:19:43.767167 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:43.767130    2559 generic.go:356] "Generic (PLEG): container finished" podID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerID="43d257875992e2fbb4320cd23a993a2115c8f3df6074a43e438fa0d3db707050" exitCode=0
Jul 02 14:19:43.767167 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:43.767155    2559 generic.go:356] "Generic (PLEG): container finished" podID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerID="82e6b4fb070985afd0c2eadcf3339cdffc76c4a54bbc9ea80a9233160f7df18f" exitCode=0
Jul 02 14:19:43.767167 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:43.767164    2559 generic.go:356] "Generic (PLEG): container finished" podID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerID="340fce40a4cdcc422b1fac02c53d8b276313ea4059b8893def72f82bead97ef1" exitCode=0
Jul 02 14:19:43.767167 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:43.767170    2559 generic.go:356] "Generic (PLEG): container finished" podID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerID="fda9cbb6cf13c27b3b37f5b4fb18aba73043e89b3f8fc728b46b9be7863fd7ed" exitCode=0
Jul 02 14:19:43.767167 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:43.767179    2559 generic.go:356] "Generic (PLEG): container finished" podID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerID="4cb93a30e59c35e351ce49b4c410c48bb03c1135f6c71cd23f8aa7bb54784e62" exitCode=0
Jul 02 14:19:43.767498 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:43.767198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerDied","Data":"43d257875992e2fbb4320cd23a993a2115c8f3df6074a43e438fa0d3db707050"}
Jul 02 14:19:43.767498 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:43.767258    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerDied","Data":"82e6b4fb070985afd0c2eadcf3339cdffc76c4a54bbc9ea80a9233160f7df18f"}
Jul 02 14:19:43.767498 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:43.767283    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerDied","Data":"340fce40a4cdcc422b1fac02c53d8b276313ea4059b8893def72f82bead97ef1"}
Jul 02 14:19:43.767498 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:43.767309    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerDied","Data":"fda9cbb6cf13c27b3b37f5b4fb18aba73043e89b3f8fc728b46b9be7863fd7ed"}
Jul 02 14:19:43.767498 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:43.767333    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerDied","Data":"4cb93a30e59c35e351ce49b4c410c48bb03c1135f6c71cd23f8aa7bb54784e62"}
Jul 02 14:19:44.080259 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.080194    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.206764 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.206725    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-main-tls\") pod \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") "
Jul 02 14:19:44.206764 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.206765    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a88b211-24e9-48b8-aaf4-b19ceafd0806-alertmanager-main-db\") pod \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") "
Jul 02 14:19:44.206983 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.206787    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-web-config\") pod \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") "
Jul 02 14:19:44.206983 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.206813    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") "
Jul 02 14:19:44.206983 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.206858    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a88b211-24e9-48b8-aaf4-b19ceafd0806-tls-assets\") pod \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") "
Jul 02 14:19:44.206983 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.206883    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a88b211-24e9-48b8-aaf4-b19ceafd0806-alertmanager-trusted-ca-bundle\") pod \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") "
Jul 02 14:19:44.206983 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.206933    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy-web\") pod \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") "
Jul 02 14:19:44.207237 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.207094    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a88b211-24e9-48b8-aaf4-b19ceafd0806-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3a88b211-24e9-48b8-aaf4-b19ceafd0806" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 14:19:44.207294 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.207236    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z75xx\" (UniqueName: \"kubernetes.io/projected/3a88b211-24e9-48b8-aaf4-b19ceafd0806-kube-api-access-z75xx\") pod \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") "
Jul 02 14:19:44.207350 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.207293    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a88b211-24e9-48b8-aaf4-b19ceafd0806-config-out\") pod \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") "
Jul 02 14:19:44.207350 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.207323    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-cluster-tls-config\") pod \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") "
Jul 02 14:19:44.207350 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.207319    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a88b211-24e9-48b8-aaf4-b19ceafd0806-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3a88b211-24e9-48b8-aaf4-b19ceafd0806" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:19:44.207503 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.207361    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a88b211-24e9-48b8-aaf4-b19ceafd0806-metrics-client-ca\") pod \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") "
Jul 02 14:19:44.207503 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.207402    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-config-volume\") pod \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") "
Jul 02 14:19:44.207503 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.207438    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy\") pod \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\" (UID: \"3a88b211-24e9-48b8-aaf4-b19ceafd0806\") "
Jul 02 14:19:44.207854 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.207767    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3a88b211-24e9-48b8-aaf4-b19ceafd0806-alertmanager-main-db\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:44.207854 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.207794    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a88b211-24e9-48b8-aaf4-b19ceafd0806-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:44.209554 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.209527    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3a88b211-24e9-48b8-aaf4-b19ceafd0806" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:44.210026 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.209823    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a88b211-24e9-48b8-aaf4-b19ceafd0806-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3a88b211-24e9-48b8-aaf4-b19ceafd0806" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:19:44.210026 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.209828    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a88b211-24e9-48b8-aaf4-b19ceafd0806-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3a88b211-24e9-48b8-aaf4-b19ceafd0806" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 14:19:44.210298 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.210175    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3a88b211-24e9-48b8-aaf4-b19ceafd0806" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:44.210298 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.210218    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a88b211-24e9-48b8-aaf4-b19ceafd0806-config-out" (OuterVolumeSpecName: "config-out") pod "3a88b211-24e9-48b8-aaf4-b19ceafd0806" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 14:19:44.210298 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.210247    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a88b211-24e9-48b8-aaf4-b19ceafd0806-kube-api-access-z75xx" (OuterVolumeSpecName: "kube-api-access-z75xx") pod "3a88b211-24e9-48b8-aaf4-b19ceafd0806" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806"). InnerVolumeSpecName "kube-api-access-z75xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 14:19:44.210298 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.210271    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3a88b211-24e9-48b8-aaf4-b19ceafd0806" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:44.210564 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.210434    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3a88b211-24e9-48b8-aaf4-b19ceafd0806" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:44.211560 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.211537    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-config-volume" (OuterVolumeSpecName: "config-volume") pod "3a88b211-24e9-48b8-aaf4-b19ceafd0806" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:44.215129 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.215107    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3a88b211-24e9-48b8-aaf4-b19ceafd0806" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:44.220798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.220779    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-web-config" (OuterVolumeSpecName: "web-config") pod "3a88b211-24e9-48b8-aaf4-b19ceafd0806" (UID: "3a88b211-24e9-48b8-aaf4-b19ceafd0806"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:44.308421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.308367    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-main-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:44.308421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.308415    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-web-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:44.308421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.308426    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:44.308421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.308435    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3a88b211-24e9-48b8-aaf4-b19ceafd0806-tls-assets\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:44.308722 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.308444    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:44.308722 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.308453    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z75xx\" (UniqueName: \"kubernetes.io/projected/3a88b211-24e9-48b8-aaf4-b19ceafd0806-kube-api-access-z75xx\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:44.308722 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.308462    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3a88b211-24e9-48b8-aaf4-b19ceafd0806-config-out\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:44.308722 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.308470    2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-cluster-tls-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:44.308722 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.308478    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a88b211-24e9-48b8-aaf4-b19ceafd0806-metrics-client-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:44.308722 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.308486    2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-config-volume\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:44.308722 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.308493    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a88b211-24e9-48b8-aaf4-b19ceafd0806-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:44.774608 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.774574    2559 generic.go:356] "Generic (PLEG): container finished" podID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerID="4b1ece74fd9fbfe17d6a39f4f934d01a7550675480dedcd94f64c9d8ac405b4d" exitCode=0
Jul 02 14:19:44.774792 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.774679    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.774792 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.774677    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerDied","Data":"4b1ece74fd9fbfe17d6a39f4f934d01a7550675480dedcd94f64c9d8ac405b4d"}
Jul 02 14:19:44.774792 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.774763    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3a88b211-24e9-48b8-aaf4-b19ceafd0806","Type":"ContainerDied","Data":"1f99ac877852aa65ee33d031912795a27725893ca11b8431a2b960add20ca5b4"}
Jul 02 14:19:44.774905 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.774813    2559 scope.go:117] "RemoveContainer" containerID="43d257875992e2fbb4320cd23a993a2115c8f3df6074a43e438fa0d3db707050"
Jul 02 14:19:44.783383 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.783363    2559 scope.go:117] "RemoveContainer" containerID="82e6b4fb070985afd0c2eadcf3339cdffc76c4a54bbc9ea80a9233160f7df18f"
Jul 02 14:19:44.790026 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.790009    2559 scope.go:117] "RemoveContainer" containerID="340fce40a4cdcc422b1fac02c53d8b276313ea4059b8893def72f82bead97ef1"
Jul 02 14:19:44.796613 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.796595    2559 scope.go:117] "RemoveContainer" containerID="4b1ece74fd9fbfe17d6a39f4f934d01a7550675480dedcd94f64c9d8ac405b4d"
Jul 02 14:19:44.800967 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.800949    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 14:19:44.804540 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.804522    2559 scope.go:117] "RemoveContainer" containerID="fda9cbb6cf13c27b3b37f5b4fb18aba73043e89b3f8fc728b46b9be7863fd7ed"
Jul 02 14:19:44.805226 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.805207    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 14:19:44.811864 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.811846    2559 scope.go:117] "RemoveContainer" containerID="4cb93a30e59c35e351ce49b4c410c48bb03c1135f6c71cd23f8aa7bb54784e62"
Jul 02 14:19:44.818842 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.818823    2559 scope.go:117] "RemoveContainer" containerID="2ff268a5355191d2e5758bb7540531941e818bb0c0f02cd9d4ff715565157d38"
Jul 02 14:19:44.825734 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.825713    2559 scope.go:117] "RemoveContainer" containerID="43d257875992e2fbb4320cd23a993a2115c8f3df6074a43e438fa0d3db707050"
Jul 02 14:19:44.826081 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:44.826012    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43d257875992e2fbb4320cd23a993a2115c8f3df6074a43e438fa0d3db707050\": container with ID starting with 43d257875992e2fbb4320cd23a993a2115c8f3df6074a43e438fa0d3db707050 not found: ID does not exist" containerID="43d257875992e2fbb4320cd23a993a2115c8f3df6074a43e438fa0d3db707050"
Jul 02 14:19:44.826081 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.826055    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43d257875992e2fbb4320cd23a993a2115c8f3df6074a43e438fa0d3db707050"} err="failed to get container status \"43d257875992e2fbb4320cd23a993a2115c8f3df6074a43e438fa0d3db707050\": rpc error: code = NotFound desc = could not find container \"43d257875992e2fbb4320cd23a993a2115c8f3df6074a43e438fa0d3db707050\": container with ID starting with 43d257875992e2fbb4320cd23a993a2115c8f3df6074a43e438fa0d3db707050 not found: ID does not exist"
Jul 02 14:19:44.826269 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.826089    2559 scope.go:117] "RemoveContainer" containerID="82e6b4fb070985afd0c2eadcf3339cdffc76c4a54bbc9ea80a9233160f7df18f"
Jul 02 14:19:44.826412 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:44.826387    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82e6b4fb070985afd0c2eadcf3339cdffc76c4a54bbc9ea80a9233160f7df18f\": container with ID starting with 82e6b4fb070985afd0c2eadcf3339cdffc76c4a54bbc9ea80a9233160f7df18f not found: ID does not exist" containerID="82e6b4fb070985afd0c2eadcf3339cdffc76c4a54bbc9ea80a9233160f7df18f"
Jul 02 14:19:44.826500 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.826424    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e6b4fb070985afd0c2eadcf3339cdffc76c4a54bbc9ea80a9233160f7df18f"} err="failed to get container status \"82e6b4fb070985afd0c2eadcf3339cdffc76c4a54bbc9ea80a9233160f7df18f\": rpc error: code = NotFound desc = could not find container \"82e6b4fb070985afd0c2eadcf3339cdffc76c4a54bbc9ea80a9233160f7df18f\": container with ID starting with 82e6b4fb070985afd0c2eadcf3339cdffc76c4a54bbc9ea80a9233160f7df18f not found: ID does not exist"
Jul 02 14:19:44.826500 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.826449    2559 scope.go:117] "RemoveContainer" containerID="340fce40a4cdcc422b1fac02c53d8b276313ea4059b8893def72f82bead97ef1"
Jul 02 14:19:44.826869 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:44.826851    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"340fce40a4cdcc422b1fac02c53d8b276313ea4059b8893def72f82bead97ef1\": container with ID starting with 340fce40a4cdcc422b1fac02c53d8b276313ea4059b8893def72f82bead97ef1 not found: ID does not exist" containerID="340fce40a4cdcc422b1fac02c53d8b276313ea4059b8893def72f82bead97ef1"
Jul 02 14:19:44.826932 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.826874    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"340fce40a4cdcc422b1fac02c53d8b276313ea4059b8893def72f82bead97ef1"} err="failed to get container status \"340fce40a4cdcc422b1fac02c53d8b276313ea4059b8893def72f82bead97ef1\": rpc error: code = NotFound desc = could not find container \"340fce40a4cdcc422b1fac02c53d8b276313ea4059b8893def72f82bead97ef1\": container with ID starting with 340fce40a4cdcc422b1fac02c53d8b276313ea4059b8893def72f82bead97ef1 not found: ID does not exist"
Jul 02 14:19:44.826932 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.826891    2559 scope.go:117] "RemoveContainer" containerID="4b1ece74fd9fbfe17d6a39f4f934d01a7550675480dedcd94f64c9d8ac405b4d"
Jul 02 14:19:44.827133 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:44.827108    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b1ece74fd9fbfe17d6a39f4f934d01a7550675480dedcd94f64c9d8ac405b4d\": container with ID starting with 4b1ece74fd9fbfe17d6a39f4f934d01a7550675480dedcd94f64c9d8ac405b4d not found: ID does not exist" containerID="4b1ece74fd9fbfe17d6a39f4f934d01a7550675480dedcd94f64c9d8ac405b4d"
Jul 02 14:19:44.827188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.827130    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b1ece74fd9fbfe17d6a39f4f934d01a7550675480dedcd94f64c9d8ac405b4d"} err="failed to get container status \"4b1ece74fd9fbfe17d6a39f4f934d01a7550675480dedcd94f64c9d8ac405b4d\": rpc error: code = NotFound desc = could not find container \"4b1ece74fd9fbfe17d6a39f4f934d01a7550675480dedcd94f64c9d8ac405b4d\": container with ID starting with 4b1ece74fd9fbfe17d6a39f4f934d01a7550675480dedcd94f64c9d8ac405b4d not found: ID does not exist"
Jul 02 14:19:44.827188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.827145    2559 scope.go:117] "RemoveContainer" containerID="fda9cbb6cf13c27b3b37f5b4fb18aba73043e89b3f8fc728b46b9be7863fd7ed"
Jul 02 14:19:44.827383 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:44.827369    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fda9cbb6cf13c27b3b37f5b4fb18aba73043e89b3f8fc728b46b9be7863fd7ed\": container with ID starting with fda9cbb6cf13c27b3b37f5b4fb18aba73043e89b3f8fc728b46b9be7863fd7ed not found: ID does not exist" containerID="fda9cbb6cf13c27b3b37f5b4fb18aba73043e89b3f8fc728b46b9be7863fd7ed"
Jul 02 14:19:44.827427 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.827386    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fda9cbb6cf13c27b3b37f5b4fb18aba73043e89b3f8fc728b46b9be7863fd7ed"} err="failed to get container status \"fda9cbb6cf13c27b3b37f5b4fb18aba73043e89b3f8fc728b46b9be7863fd7ed\": rpc error: code = NotFound desc = could not find container \"fda9cbb6cf13c27b3b37f5b4fb18aba73043e89b3f8fc728b46b9be7863fd7ed\": container with ID starting with fda9cbb6cf13c27b3b37f5b4fb18aba73043e89b3f8fc728b46b9be7863fd7ed not found: ID does not exist"
Jul 02 14:19:44.827427 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.827397    2559 scope.go:117] "RemoveContainer" containerID="4cb93a30e59c35e351ce49b4c410c48bb03c1135f6c71cd23f8aa7bb54784e62"
Jul 02 14:19:44.827594 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:44.827578    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cb93a30e59c35e351ce49b4c410c48bb03c1135f6c71cd23f8aa7bb54784e62\": container with ID starting with 4cb93a30e59c35e351ce49b4c410c48bb03c1135f6c71cd23f8aa7bb54784e62 not found: ID does not exist" containerID="4cb93a30e59c35e351ce49b4c410c48bb03c1135f6c71cd23f8aa7bb54784e62"
Jul 02 14:19:44.827663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.827603    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cb93a30e59c35e351ce49b4c410c48bb03c1135f6c71cd23f8aa7bb54784e62"} err="failed to get container status \"4cb93a30e59c35e351ce49b4c410c48bb03c1135f6c71cd23f8aa7bb54784e62\": rpc error: code = NotFound desc = could not find container \"4cb93a30e59c35e351ce49b4c410c48bb03c1135f6c71cd23f8aa7bb54784e62\": container with ID starting with 4cb93a30e59c35e351ce49b4c410c48bb03c1135f6c71cd23f8aa7bb54784e62 not found: ID does not exist"
Jul 02 14:19:44.827663 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.827626    2559 scope.go:117] "RemoveContainer" containerID="2ff268a5355191d2e5758bb7540531941e818bb0c0f02cd9d4ff715565157d38"
Jul 02 14:19:44.827885 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:44.827869    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ff268a5355191d2e5758bb7540531941e818bb0c0f02cd9d4ff715565157d38\": container with ID starting with 2ff268a5355191d2e5758bb7540531941e818bb0c0f02cd9d4ff715565157d38 not found: ID does not exist" containerID="2ff268a5355191d2e5758bb7540531941e818bb0c0f02cd9d4ff715565157d38"
Jul 02 14:19:44.827939 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.827889    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ff268a5355191d2e5758bb7540531941e818bb0c0f02cd9d4ff715565157d38"} err="failed to get container status \"2ff268a5355191d2e5758bb7540531941e818bb0c0f02cd9d4ff715565157d38\": rpc error: code = NotFound desc = could not find container \"2ff268a5355191d2e5758bb7540531941e818bb0c0f02cd9d4ff715565157d38\": container with ID starting with 2ff268a5355191d2e5758bb7540531941e818bb0c0f02cd9d4ff715565157d38 not found: ID does not exist"
Jul 02 14:19:44.836282 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836259    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 14:19:44.836641 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836623    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="kube-rbac-proxy-web"
Jul 02 14:19:44.836641 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836640    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="kube-rbac-proxy-web"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836674    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="kube-rbac-proxy-metric"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836681    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="kube-rbac-proxy-metric"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836691    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="prom-label-proxy"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836696    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="prom-label-proxy"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836706    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3f8207c-088f-4d1f-998e-5935331cd1a1" containerName="registry"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836711    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3f8207c-088f-4d1f-998e-5935331cd1a1" containerName="registry"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836723    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="init-config-reloader"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836729    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="init-config-reloader"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836737    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="config-reloader"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836745    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="config-reloader"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836760    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="alertmanager"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836766    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="alertmanager"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836773    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="kube-rbac-proxy"
Jul 02 14:19:44.836785 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836778    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="kube-rbac-proxy"
Jul 02 14:19:44.837418 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836836    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="prom-label-proxy"
Jul 02 14:19:44.837418 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836845    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="config-reloader"
Jul 02 14:19:44.837418 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836852    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="alertmanager"
Jul 02 14:19:44.837418 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836858    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3f8207c-088f-4d1f-998e-5935331cd1a1" containerName="registry"
Jul 02 14:19:44.837418 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836864    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="kube-rbac-proxy"
Jul 02 14:19:44.837418 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836871    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="kube-rbac-proxy-web"
Jul 02 14:19:44.837418 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.836877    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" containerName="kube-rbac-proxy-metric"
Jul 02 14:19:44.840631 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.840612    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.843285 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.843258    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 14:19:44.843369 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.843258    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7pqcl\""
Jul 02 14:19:44.843717 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.843700    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 14:19:44.843801 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.843724    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 14:19:44.843801 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.843740    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 14:19:44.843801 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.843783    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 14:19:44.843946 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.843739    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 14:19:44.843946 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.843817    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 14:19:44.844369 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.844351    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 14:19:44.848458 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.848438    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 14:19:44.855114 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.855092    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 14:19:44.914991 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.914963    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.915138 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.914996    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.915138 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.915013    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e53dbba-4171-4783-b27d-acfde6034572-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.915138 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.915037    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.915138 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.915054    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-web-config\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.915138 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.915081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e53dbba-4171-4783-b27d-acfde6034572-config-out\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.915138 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.915097    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.915138 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.915112    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sm4d\" (UniqueName: \"kubernetes.io/projected/3e53dbba-4171-4783-b27d-acfde6034572-kube-api-access-8sm4d\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.915372 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.915206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e53dbba-4171-4783-b27d-acfde6034572-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.915372 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.915242    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.915372 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.915259    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e53dbba-4171-4783-b27d-acfde6034572-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.915372 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.915276    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.915372 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.915308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e53dbba-4171-4783-b27d-acfde6034572-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:44.976947 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:44.976912    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a88b211-24e9-48b8-aaf4-b19ceafd0806" path="/var/lib/kubelet/pods/3a88b211-24e9-48b8-aaf4-b19ceafd0806/volumes"
Jul 02 14:19:45.016176 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.016140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.016325 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.016178    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sm4d\" (UniqueName: \"kubernetes.io/projected/3e53dbba-4171-4783-b27d-acfde6034572-kube-api-access-8sm4d\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.016325 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.016223    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e53dbba-4171-4783-b27d-acfde6034572-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.016325 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.016250    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.016325 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.016269    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e53dbba-4171-4783-b27d-acfde6034572-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.016325 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.016286    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.016325 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.016315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e53dbba-4171-4783-b27d-acfde6034572-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.016622 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.016346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.016622 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.016386    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.016622 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.016411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e53dbba-4171-4783-b27d-acfde6034572-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.016622 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.016449    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.016622 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.016472    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-web-config\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.016622 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.016526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e53dbba-4171-4783-b27d-acfde6034572-config-out\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.017118 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.017083    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e53dbba-4171-4783-b27d-acfde6034572-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.017619 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.017268    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e53dbba-4171-4783-b27d-acfde6034572-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.017619 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.017382    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e53dbba-4171-4783-b27d-acfde6034572-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.019167 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.019144    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e53dbba-4171-4783-b27d-acfde6034572-config-out\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.019894 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.019452    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.019894 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.019463    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.019894 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.019693    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.019894 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.019848    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.019894 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.019888    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.020197 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.019993    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e53dbba-4171-4783-b27d-acfde6034572-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.020197 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.020182    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.021208 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.021189    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e53dbba-4171-4783-b27d-acfde6034572-web-config\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.025791 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.025744    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sm4d\" (UniqueName: \"kubernetes.io/projected/3e53dbba-4171-4783-b27d-acfde6034572-kube-api-access-8sm4d\") pod \"alertmanager-main-0\" (UID: \"3e53dbba-4171-4783-b27d-acfde6034572\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.150665 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.150619    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 14:19:45.289265 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.289182    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 14:19:45.292692 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:19:45.292621    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e53dbba_4171_4783_b27d_acfde6034572.slice/crio-5c5422e9dcc2164757d47d4f89ed27f337c6881540e66992d3785f2a8b1143c9 WatchSource:0}: Error finding container 5c5422e9dcc2164757d47d4f89ed27f337c6881540e66992d3785f2a8b1143c9: Status 404 returned error can't find the container with id 5c5422e9dcc2164757d47d4f89ed27f337c6881540e66992d3785f2a8b1143c9
Jul 02 14:19:45.780769 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.780737    2559 generic.go:356] "Generic (PLEG): container finished" podID="3e53dbba-4171-4783-b27d-acfde6034572" containerID="a0f116ad6508506681ba21043f9f1bdf49db5095d04c2b40e61f7352cd2616fa" exitCode=0
Jul 02 14:19:45.780905 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.780812    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e53dbba-4171-4783-b27d-acfde6034572","Type":"ContainerDied","Data":"a0f116ad6508506681ba21043f9f1bdf49db5095d04c2b40e61f7352cd2616fa"}
Jul 02 14:19:45.780905 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:45.780877    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e53dbba-4171-4783-b27d-acfde6034572","Type":"ContainerStarted","Data":"5c5422e9dcc2164757d47d4f89ed27f337c6881540e66992d3785f2a8b1143c9"}
Jul 02 14:19:46.788234 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:46.788200    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e53dbba-4171-4783-b27d-acfde6034572","Type":"ContainerStarted","Data":"2bd6fd5fccb0620e7553caff847d2eb5918255214022d5c84ac71480d64b0e03"}
Jul 02 14:19:46.788590 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:46.788265    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e53dbba-4171-4783-b27d-acfde6034572","Type":"ContainerStarted","Data":"b04fab190475cef414b54bed550cd1eb50ddc432ca818f3c7568c75130daee39"}
Jul 02 14:19:46.788590 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:46.788290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e53dbba-4171-4783-b27d-acfde6034572","Type":"ContainerStarted","Data":"1fa5c3ed9fa8fcf3b88e3b726f68f03bb84862f195d0afbcf526d67c9b5e6339"}
Jul 02 14:19:46.788590 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:46.788322    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e53dbba-4171-4783-b27d-acfde6034572","Type":"ContainerStarted","Data":"d3e6185b38d2b9e2ec12193791596773235df2e1f02d75d63a299456fb2f538a"}
Jul 02 14:19:46.788590 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:46.788346    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e53dbba-4171-4783-b27d-acfde6034572","Type":"ContainerStarted","Data":"d15ac0f498a07007cc9ae711b4b3373e751b705e918dcd70804b5ec2868c9fb4"}
Jul 02 14:19:46.788590 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:46.788367    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e53dbba-4171-4783-b27d-acfde6034572","Type":"ContainerStarted","Data":"3c5c5c69b46edc47598c3eb74a02c03a090883ecb9246e15c574476ed31f5e86"}
Jul 02 14:19:46.819023 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:46.818976    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.80568739 podStartE2EDuration="2.818960108s" totalImagesPullingTime="0s" totalInitContainerRuntime="13.272718ms" isStatefulPod=false podCreationTimestamp="2026-07-02 14:19:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:19:46.818007011 +0000 UTC m=+194.449899970" watchObservedRunningTime="2026-07-02 14:19:46.818960108 +0000 UTC m=+194.450853046"
Jul 02 14:19:47.106543 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.106450    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 14:19:47.107130 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.107089    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="prometheus" containerID="cri-o://1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0" gracePeriod=600
Jul 02 14:19:47.107318 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.107281    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="thanos-sidecar" containerID="cri-o://c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019" gracePeriod=600
Jul 02 14:19:47.107501 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.107159    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="config-reloader" containerID="cri-o://2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374" gracePeriod=600
Jul 02 14:19:47.107596 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.107133    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="kube-rbac-proxy-web" containerID="cri-o://52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17" gracePeriod=600
Jul 02 14:19:47.107670 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.107142    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="kube-rbac-proxy-thanos" containerID="cri-o://efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127" gracePeriod=600
Jul 02 14:19:47.107670 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.107133    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="kube-rbac-proxy" containerID="cri-o://00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502" gracePeriod=600
Jul 02 14:19:47.566765 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.566737    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.646788 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.646705    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/791b6e13-aca8-4d13-8cd6-4aa39f259836-config-out\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.646788 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.646739    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-kubelet-serving-ca-bundle\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.646962 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.646854    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-config\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.646962 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.646888    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-serving-certs-ca-bundle\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.646962 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.646922    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-0\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.646962 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.646947    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-thanos-prometheus-http-client-file\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647155 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.646980    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-db\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647155 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647017    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-2\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647155 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647056    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-metrics-client-certs\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647155 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647099    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-web-config\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647155 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647105    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:19:47.647155 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647128    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-tls\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647493 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647226    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcmv9\" (UniqueName: \"kubernetes.io/projected/791b6e13-aca8-4d13-8cd6-4aa39f259836-kube-api-access-mcmv9\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647493 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647275    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/791b6e13-aca8-4d13-8cd6-4aa39f259836-tls-assets\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647493 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647299    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:19:47.647493 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647311    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-trusted-ca-bundle\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647493 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647445    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647493 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647478    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-1\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647822 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647519    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-grpc-tls\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647822 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647544    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-metrics-client-ca\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647822 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647575    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-kube-rbac-proxy\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647822 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647608    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"791b6e13-aca8-4d13-8cd6-4aa39f259836\" (UID: \"791b6e13-aca8-4d13-8cd6-4aa39f259836\") "
Jul 02 14:19:47.647822 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647613    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:19:47.648064 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647932    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.648064 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647950    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.648064 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.647965    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.648204 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.648085    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:19:47.648939 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.648774    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 14:19:47.649856 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.649368    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/791b6e13-aca8-4d13-8cd6-4aa39f259836-config-out" (OuterVolumeSpecName: "config-out") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 14:19:47.649856 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.649764    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:47.649856 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.649773    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:19:47.649856 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.649790    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-config" (OuterVolumeSpecName: "config") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:47.650387 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.650232    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/791b6e13-aca8-4d13-8cd6-4aa39f259836-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 14:19:47.650485 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.650408    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:19:47.650485 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.650447    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:19:47.650591 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.650517    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:47.650644 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.650617    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/791b6e13-aca8-4d13-8cd6-4aa39f259836-kube-api-access-mcmv9" (OuterVolumeSpecName: "kube-api-access-mcmv9") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "kube-api-access-mcmv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 14:19:47.650759 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.650732    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:47.651334 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.651310    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:47.651961 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.651939    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:47.652152 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.652128    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:47.652332 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.652317    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:47.662305 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.662286    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-web-config" (OuterVolumeSpecName: "web-config") pod "791b6e13-aca8-4d13-8cd6-4aa39f259836" (UID: "791b6e13-aca8-4d13-8cd6-4aa39f259836"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:19:47.749195 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749165    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749195 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749190    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749195 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749202    2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-grpc-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749213    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-configmap-metrics-client-ca\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749227    2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-kube-rbac-proxy\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749238    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749248    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/791b6e13-aca8-4d13-8cd6-4aa39f259836-config-out\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749256    2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749263    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749271    2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749279    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-db\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749289    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/791b6e13-aca8-4d13-8cd6-4aa39f259836-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749302    2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-metrics-client-certs\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749334    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-web-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749343    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/791b6e13-aca8-4d13-8cd6-4aa39f259836-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749350    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcmv9\" (UniqueName: \"kubernetes.io/projected/791b6e13-aca8-4d13-8cd6-4aa39f259836-kube-api-access-mcmv9\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.749417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.749358    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/791b6e13-aca8-4d13-8cd6-4aa39f259836-tls-assets\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:19:47.795610 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795580    2559 generic.go:356] "Generic (PLEG): container finished" podID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerID="efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127" exitCode=0
Jul 02 14:19:47.795610 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795603    2559 generic.go:356] "Generic (PLEG): container finished" podID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerID="00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502" exitCode=0
Jul 02 14:19:47.795610 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795608    2559 generic.go:356] "Generic (PLEG): container finished" podID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerID="52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17" exitCode=0
Jul 02 14:19:47.795610 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795614    2559 generic.go:356] "Generic (PLEG): container finished" podID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerID="c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019" exitCode=0
Jul 02 14:19:47.796173 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795625    2559 generic.go:356] "Generic (PLEG): container finished" podID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerID="2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374" exitCode=0
Jul 02 14:19:47.796173 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795635    2559 generic.go:356] "Generic (PLEG): container finished" podID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerID="1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0" exitCode=0
Jul 02 14:19:47.796173 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795668    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.796173 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795670    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerDied","Data":"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"}
Jul 02 14:19:47.796173 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795764    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerDied","Data":"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"}
Jul 02 14:19:47.796173 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795793    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerDied","Data":"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"}
Jul 02 14:19:47.796173 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerDied","Data":"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"}
Jul 02 14:19:47.796173 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795829    2559 scope.go:117] "RemoveContainer" containerID="efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"
Jul 02 14:19:47.796173 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795845    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerDied","Data":"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"}
Jul 02 14:19:47.796173 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795870    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerDied","Data":"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"}
Jul 02 14:19:47.796173 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.795894    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"791b6e13-aca8-4d13-8cd6-4aa39f259836","Type":"ContainerDied","Data":"1f42dd763fb5cd079875488cf441f8a17e9938b7e52a057200d40c4906c29392"}
Jul 02 14:19:47.804568 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.804549    2559 scope.go:117] "RemoveContainer" containerID="00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"
Jul 02 14:19:47.811475 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.811459    2559 scope.go:117] "RemoveContainer" containerID="52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"
Jul 02 14:19:47.819795 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.819775    2559 scope.go:117] "RemoveContainer" containerID="c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"
Jul 02 14:19:47.826353 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.826338    2559 scope.go:117] "RemoveContainer" containerID="2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"
Jul 02 14:19:47.832707 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.832682    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 14:19:47.834343 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.834328    2559 scope.go:117] "RemoveContainer" containerID="1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"
Jul 02 14:19:47.837505 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.837484    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 14:19:47.842579 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.842559    2559 scope.go:117] "RemoveContainer" containerID="6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"
Jul 02 14:19:47.850805 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.850784    2559 scope.go:117] "RemoveContainer" containerID="efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"
Jul 02 14:19:47.851078 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:47.851061    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127\": container with ID starting with efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127 not found: ID does not exist" containerID="efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"
Jul 02 14:19:47.851118 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.851089    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"} err="failed to get container status \"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127\": rpc error: code = NotFound desc = could not find container \"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127\": container with ID starting with efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127 not found: ID does not exist"
Jul 02 14:19:47.851118 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.851108    2559 scope.go:117] "RemoveContainer" containerID="00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"
Jul 02 14:19:47.851376 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:47.851361    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502\": container with ID starting with 00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502 not found: ID does not exist" containerID="00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"
Jul 02 14:19:47.851427 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.851380    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"} err="failed to get container status \"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502\": rpc error: code = NotFound desc = could not find container \"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502\": container with ID starting with 00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502 not found: ID does not exist"
Jul 02 14:19:47.851427 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.851392    2559 scope.go:117] "RemoveContainer" containerID="52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"
Jul 02 14:19:47.851615 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:47.851601    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17\": container with ID starting with 52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17 not found: ID does not exist" containerID="52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"
Jul 02 14:19:47.851688 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.851620    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"} err="failed to get container status \"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17\": rpc error: code = NotFound desc = could not find container \"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17\": container with ID starting with 52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17 not found: ID does not exist"
Jul 02 14:19:47.851688 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.851636    2559 scope.go:117] "RemoveContainer" containerID="c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"
Jul 02 14:19:47.851905 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:47.851886    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019\": container with ID starting with c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019 not found: ID does not exist" containerID="c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"
Jul 02 14:19:47.851961 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.851911    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"} err="failed to get container status \"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019\": rpc error: code = NotFound desc = could not find container \"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019\": container with ID starting with c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019 not found: ID does not exist"
Jul 02 14:19:47.851961 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.851926    2559 scope.go:117] "RemoveContainer" containerID="2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"
Jul 02 14:19:47.852175 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:47.852159    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374\": container with ID starting with 2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374 not found: ID does not exist" containerID="2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"
Jul 02 14:19:47.852233 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.852177    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"} err="failed to get container status \"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374\": rpc error: code = NotFound desc = could not find container \"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374\": container with ID starting with 2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374 not found: ID does not exist"
Jul 02 14:19:47.852233 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.852189    2559 scope.go:117] "RemoveContainer" containerID="1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"
Jul 02 14:19:47.852409 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:47.852395    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0\": container with ID starting with 1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0 not found: ID does not exist" containerID="1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"
Jul 02 14:19:47.852450 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.852412    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"} err="failed to get container status \"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0\": rpc error: code = NotFound desc = could not find container \"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0\": container with ID starting with 1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0 not found: ID does not exist"
Jul 02 14:19:47.852450 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.852424    2559 scope.go:117] "RemoveContainer" containerID="6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"
Jul 02 14:19:47.852683 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:19:47.852663    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512\": container with ID starting with 6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512 not found: ID does not exist" containerID="6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"
Jul 02 14:19:47.852759 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.852692    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"} err="failed to get container status \"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512\": rpc error: code = NotFound desc = could not find container \"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512\": container with ID starting with 6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512 not found: ID does not exist"
Jul 02 14:19:47.852759 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.852712    2559 scope.go:117] "RemoveContainer" containerID="efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"
Jul 02 14:19:47.852982 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.852964    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"} err="failed to get container status \"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127\": rpc error: code = NotFound desc = could not find container \"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127\": container with ID starting with efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127 not found: ID does not exist"
Jul 02 14:19:47.853049 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.852983    2559 scope.go:117] "RemoveContainer" containerID="00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"
Jul 02 14:19:47.853224 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.853204    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"} err="failed to get container status \"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502\": rpc error: code = NotFound desc = could not find container \"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502\": container with ID starting with 00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502 not found: ID does not exist"
Jul 02 14:19:47.853292 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.853226    2559 scope.go:117] "RemoveContainer" containerID="52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"
Jul 02 14:19:47.853460 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.853441    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"} err="failed to get container status \"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17\": rpc error: code = NotFound desc = could not find container \"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17\": container with ID starting with 52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17 not found: ID does not exist"
Jul 02 14:19:47.853528 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.853462    2559 scope.go:117] "RemoveContainer" containerID="c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"
Jul 02 14:19:47.853699 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.853682    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"} err="failed to get container status \"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019\": rpc error: code = NotFound desc = could not find container \"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019\": container with ID starting with c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019 not found: ID does not exist"
Jul 02 14:19:47.853774 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.853700    2559 scope.go:117] "RemoveContainer" containerID="2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"
Jul 02 14:19:47.853913 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.853877    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"} err="failed to get container status \"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374\": rpc error: code = NotFound desc = could not find container \"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374\": container with ID starting with 2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374 not found: ID does not exist"
Jul 02 14:19:47.853913 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.853911    2559 scope.go:117] "RemoveContainer" containerID="1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"
Jul 02 14:19:47.854122 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.854097    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"} err="failed to get container status \"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0\": rpc error: code = NotFound desc = could not find container \"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0\": container with ID starting with 1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0 not found: ID does not exist"
Jul 02 14:19:47.854163 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.854127    2559 scope.go:117] "RemoveContainer" containerID="6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"
Jul 02 14:19:47.854341 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.854322    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"} err="failed to get container status \"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512\": rpc error: code = NotFound desc = could not find container \"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512\": container with ID starting with 6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512 not found: ID does not exist"
Jul 02 14:19:47.854393 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.854342    2559 scope.go:117] "RemoveContainer" containerID="efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"
Jul 02 14:19:47.854585 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.854564    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"} err="failed to get container status \"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127\": rpc error: code = NotFound desc = could not find container \"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127\": container with ID starting with efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127 not found: ID does not exist"
Jul 02 14:19:47.854689 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.854586    2559 scope.go:117] "RemoveContainer" containerID="00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"
Jul 02 14:19:47.854845 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.854828    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"} err="failed to get container status \"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502\": rpc error: code = NotFound desc = could not find container \"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502\": container with ID starting with 00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502 not found: ID does not exist"
Jul 02 14:19:47.854894 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.854846    2559 scope.go:117] "RemoveContainer" containerID="52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"
Jul 02 14:19:47.855063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.855036    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"} err="failed to get container status \"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17\": rpc error: code = NotFound desc = could not find container \"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17\": container with ID starting with 52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17 not found: ID does not exist"
Jul 02 14:19:47.855063 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.855055    2559 scope.go:117] "RemoveContainer" containerID="c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"
Jul 02 14:19:47.855240 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.855222    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"} err="failed to get container status \"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019\": rpc error: code = NotFound desc = could not find container \"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019\": container with ID starting with c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019 not found: ID does not exist"
Jul 02 14:19:47.855294 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.855241    2559 scope.go:117] "RemoveContainer" containerID="2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"
Jul 02 14:19:47.855475 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.855461    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"} err="failed to get container status \"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374\": rpc error: code = NotFound desc = could not find container \"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374\": container with ID starting with 2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374 not found: ID does not exist"
Jul 02 14:19:47.855522 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.855475    2559 scope.go:117] "RemoveContainer" containerID="1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"
Jul 02 14:19:47.855698 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.855681    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"} err="failed to get container status \"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0\": rpc error: code = NotFound desc = could not find container \"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0\": container with ID starting with 1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0 not found: ID does not exist"
Jul 02 14:19:47.855746 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.855698    2559 scope.go:117] "RemoveContainer" containerID="6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"
Jul 02 14:19:47.855921 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.855899    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"} err="failed to get container status \"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512\": rpc error: code = NotFound desc = could not find container \"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512\": container with ID starting with 6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512 not found: ID does not exist"
Jul 02 14:19:47.855921 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.855916    2559 scope.go:117] "RemoveContainer" containerID="efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"
Jul 02 14:19:47.856140 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.856115    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"} err="failed to get container status \"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127\": rpc error: code = NotFound desc = could not find container \"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127\": container with ID starting with efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127 not found: ID does not exist"
Jul 02 14:19:47.856140 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.856136    2559 scope.go:117] "RemoveContainer" containerID="00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"
Jul 02 14:19:47.856353 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.856335    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"} err="failed to get container status \"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502\": rpc error: code = NotFound desc = could not find container \"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502\": container with ID starting with 00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502 not found: ID does not exist"
Jul 02 14:19:47.856417 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.856355    2559 scope.go:117] "RemoveContainer" containerID="52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"
Jul 02 14:19:47.856543 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.856526    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"} err="failed to get container status \"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17\": rpc error: code = NotFound desc = could not find container \"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17\": container with ID starting with 52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17 not found: ID does not exist"
Jul 02 14:19:47.856603 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.856544    2559 scope.go:117] "RemoveContainer" containerID="c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"
Jul 02 14:19:47.856813 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.856795    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"} err="failed to get container status \"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019\": rpc error: code = NotFound desc = could not find container \"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019\": container with ID starting with c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019 not found: ID does not exist"
Jul 02 14:19:47.856886 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.856814    2559 scope.go:117] "RemoveContainer" containerID="2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"
Jul 02 14:19:47.857006 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.856989    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"} err="failed to get container status \"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374\": rpc error: code = NotFound desc = could not find container \"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374\": container with ID starting with 2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374 not found: ID does not exist"
Jul 02 14:19:47.857062 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.857007    2559 scope.go:117] "RemoveContainer" containerID="1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"
Jul 02 14:19:47.857267 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.857249    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"} err="failed to get container status \"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0\": rpc error: code = NotFound desc = could not find container \"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0\": container with ID starting with 1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0 not found: ID does not exist"
Jul 02 14:19:47.857320 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.857268    2559 scope.go:117] "RemoveContainer" containerID="6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"
Jul 02 14:19:47.857471 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.857452    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"} err="failed to get container status \"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512\": rpc error: code = NotFound desc = could not find container \"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512\": container with ID starting with 6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512 not found: ID does not exist"
Jul 02 14:19:47.857519 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.857473    2559 scope.go:117] "RemoveContainer" containerID="efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"
Jul 02 14:19:47.857711 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.857692    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"} err="failed to get container status \"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127\": rpc error: code = NotFound desc = could not find container \"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127\": container with ID starting with efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127 not found: ID does not exist"
Jul 02 14:19:47.857801 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.857712    2559 scope.go:117] "RemoveContainer" containerID="00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"
Jul 02 14:19:47.857937 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.857917    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"} err="failed to get container status \"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502\": rpc error: code = NotFound desc = could not find container \"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502\": container with ID starting with 00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502 not found: ID does not exist"
Jul 02 14:19:47.857982 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.857938    2559 scope.go:117] "RemoveContainer" containerID="52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"
Jul 02 14:19:47.858169 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.858142    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"} err="failed to get container status \"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17\": rpc error: code = NotFound desc = could not find container \"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17\": container with ID starting with 52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17 not found: ID does not exist"
Jul 02 14:19:47.858169 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.858160    2559 scope.go:117] "RemoveContainer" containerID="c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"
Jul 02 14:19:47.858387 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.858370    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"} err="failed to get container status \"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019\": rpc error: code = NotFound desc = could not find container \"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019\": container with ID starting with c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019 not found: ID does not exist"
Jul 02 14:19:47.858439 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.858386    2559 scope.go:117] "RemoveContainer" containerID="2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"
Jul 02 14:19:47.858608 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.858592    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"} err="failed to get container status \"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374\": rpc error: code = NotFound desc = could not find container \"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374\": container with ID starting with 2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374 not found: ID does not exist"
Jul 02 14:19:47.858688 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.858610    2559 scope.go:117] "RemoveContainer" containerID="1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"
Jul 02 14:19:47.858866 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.858849    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"} err="failed to get container status \"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0\": rpc error: code = NotFound desc = could not find container \"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0\": container with ID starting with 1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0 not found: ID does not exist"
Jul 02 14:19:47.858912 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.858867    2559 scope.go:117] "RemoveContainer" containerID="6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"
Jul 02 14:19:47.859075 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.859055    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"} err="failed to get container status \"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512\": rpc error: code = NotFound desc = could not find container \"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512\": container with ID starting with 6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512 not found: ID does not exist"
Jul 02 14:19:47.859075 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.859071    2559 scope.go:117] "RemoveContainer" containerID="efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"
Jul 02 14:19:47.859282 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.859264    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127"} err="failed to get container status \"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127\": rpc error: code = NotFound desc = could not find container \"efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127\": container with ID starting with efdc93a6885402f36c500ca07051d0553d58b4654fbad99e829d926645ad5127 not found: ID does not exist"
Jul 02 14:19:47.859355 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.859283    2559 scope.go:117] "RemoveContainer" containerID="00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"
Jul 02 14:19:47.859517 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.859497    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502"} err="failed to get container status \"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502\": rpc error: code = NotFound desc = could not find container \"00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502\": container with ID starting with 00be8b54b3fd746c9e9f29fb8551fce87f241c2d4ba1813f626120a285e4a502 not found: ID does not exist"
Jul 02 14:19:47.859517 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.859516    2559 scope.go:117] "RemoveContainer" containerID="52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"
Jul 02 14:19:47.859779 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.859759    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17"} err="failed to get container status \"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17\": rpc error: code = NotFound desc = could not find container \"52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17\": container with ID starting with 52567af2dd01805bfde0477a0ce361caee9fa0d2f1c85af74f338205b6ee3c17 not found: ID does not exist"
Jul 02 14:19:47.859826 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.859780    2559 scope.go:117] "RemoveContainer" containerID="c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"
Jul 02 14:19:47.860016 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.859997    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019"} err="failed to get container status \"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019\": rpc error: code = NotFound desc = could not find container \"c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019\": container with ID starting with c399649347410e9af4ec301527b567c886aa5728a967a7a629be24dc03a2b019 not found: ID does not exist"
Jul 02 14:19:47.860080 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.860017    2559 scope.go:117] "RemoveContainer" containerID="2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"
Jul 02 14:19:47.860240 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.860220    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374"} err="failed to get container status \"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374\": rpc error: code = NotFound desc = could not find container \"2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374\": container with ID starting with 2bd8fde214e5af63d484499c6b934827c39d1cd7ea124efc6f013df7622cc374 not found: ID does not exist"
Jul 02 14:19:47.860413 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.860241    2559 scope.go:117] "RemoveContainer" containerID="1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"
Jul 02 14:19:47.860550 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.860524    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0"} err="failed to get container status \"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0\": rpc error: code = NotFound desc = could not find container \"1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0\": container with ID starting with 1162af7bb2d403d3eca136aef7e9996f37bfb2b65d83b18cb02220a06a49e2c0 not found: ID does not exist"
Jul 02 14:19:47.860626 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.860553    2559 scope.go:117] "RemoveContainer" containerID="6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"
Jul 02 14:19:47.860848 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.860827    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512"} err="failed to get container status \"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512\": rpc error: code = NotFound desc = could not find container \"6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512\": container with ID starting with 6cb58f9e879b5a838433b128d898aac8e7d24b3e04446f05bc4b8108a4dba512 not found: ID does not exist"
Jul 02 14:19:47.872870 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.872844    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 14:19:47.873173 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873162    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="prometheus"
Jul 02 14:19:47.873224 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873175    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="prometheus"
Jul 02 14:19:47.873224 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873193    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="thanos-sidecar"
Jul 02 14:19:47.873224 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873199    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="thanos-sidecar"
Jul 02 14:19:47.873224 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873204    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="kube-rbac-proxy-web"
Jul 02 14:19:47.873224 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873210    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="kube-rbac-proxy-web"
Jul 02 14:19:47.873224 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873216    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="config-reloader"
Jul 02 14:19:47.873224 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873221    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="config-reloader"
Jul 02 14:19:47.873421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873229    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="kube-rbac-proxy"
Jul 02 14:19:47.873421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873234    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="kube-rbac-proxy"
Jul 02 14:19:47.873421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873242    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="init-config-reloader"
Jul 02 14:19:47.873421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873247    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="init-config-reloader"
Jul 02 14:19:47.873421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873257    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="kube-rbac-proxy-thanos"
Jul 02 14:19:47.873421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873262    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="kube-rbac-proxy-thanos"
Jul 02 14:19:47.873421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873312    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="kube-rbac-proxy-web"
Jul 02 14:19:47.873421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873320    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="thanos-sidecar"
Jul 02 14:19:47.873421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873328    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="kube-rbac-proxy"
Jul 02 14:19:47.873421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873334    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="prometheus"
Jul 02 14:19:47.873421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873339    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="config-reloader"
Jul 02 14:19:47.873421 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.873343    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" containerName="kube-rbac-proxy-thanos"
Jul 02 14:19:47.879219 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.879197    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.883030 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.883007    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 14:19:47.883130 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.883086    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 14:19:47.883210 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.883152    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 14:19:47.883403 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.883390    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qfhcz\""
Jul 02 14:19:47.883710 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.883696    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 14:19:47.883815 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.883802    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 14:19:47.883871 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.883846    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 14:19:47.883923 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.883890    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 14:19:47.883923 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.883895    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 14:19:47.883923 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.883909    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-945v7r60uda3p\""
Jul 02 14:19:47.884055 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.883949    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 14:19:47.884133 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.884119    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 14:19:47.884245 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.884206    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 14:19:47.889080 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.889060    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 14:19:47.890080 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.890064    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 14:19:47.893798 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.893782    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 14:19:47.897145 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.897093    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 14:19:47.950944 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.950915    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.950944 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.950946    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.950988    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-config\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951041    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951086    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951142 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951128    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951315 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3da50a58-ffc4-497d-86a9-49fe03aa0717-config-out\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951315 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951169    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-web-config\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951315 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951185    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951315 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951207    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951315 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qvv5\" (UniqueName: \"kubernetes.io/projected/3da50a58-ffc4-497d-86a9-49fe03aa0717-kube-api-access-2qvv5\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951315 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951283    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951487 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951320    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951487 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951343    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951487 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951487 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951396    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951487 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951421    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:47.951487 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:47.951445    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3da50a58-ffc4-497d-86a9-49fe03aa0717-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.052841 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.052806    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.052841 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.052844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053138 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.052862    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053138 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.052879    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053138 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.052901    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053307 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053122    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3da50a58-ffc4-497d-86a9-49fe03aa0717-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053307 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053209    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053307 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053240    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053459 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053310    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053459 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053338    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-config\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053459 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053372    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053459 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053400    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053459 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053422    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053459 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053810 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053487    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3da50a58-ffc4-497d-86a9-49fe03aa0717-config-out\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053810 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053523    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-web-config\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053810 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053547    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053810 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053810 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053619    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qvv5\" (UniqueName: \"kubernetes.io/projected/3da50a58-ffc4-497d-86a9-49fe03aa0717-kube-api-access-2qvv5\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053810 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053682    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.053810 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053698    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.054183 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053900    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.054183 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.054082    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.056195 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.056167    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3da50a58-ffc4-497d-86a9-49fe03aa0717-config-out\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.056358 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.056230    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.056358 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.056255    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.056358 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.053590    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.056542 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.056438    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.056542 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.056511    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.056734 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.056637    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.056734 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.056692    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.057038 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.057011    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-config\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.057154 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.057056    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3da50a58-ffc4-497d-86a9-49fe03aa0717-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.057642 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.057612    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.057791 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.057679    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.058549 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.058524    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.058833 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.058810    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.059098 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.059080    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3da50a58-ffc4-497d-86a9-49fe03aa0717-web-config\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.059407 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.059388    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3da50a58-ffc4-497d-86a9-49fe03aa0717-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.066955 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.066938    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qvv5\" (UniqueName: \"kubernetes.io/projected/3da50a58-ffc4-497d-86a9-49fe03aa0717-kube-api-access-2qvv5\") pod \"prometheus-k8s-0\" (UID: \"3da50a58-ffc4-497d-86a9-49fe03aa0717\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.190190 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.190097    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:19:48.329992 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.329949    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 14:19:48.332042 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:19:48.332012    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da50a58_ffc4_497d_86a9_49fe03aa0717.slice/crio-8bcfa17cea16d9d0eedddc6a61ef37d3c3f141470253792a2a56016027d8b470 WatchSource:0}: Error finding container 8bcfa17cea16d9d0eedddc6a61ef37d3c3f141470253792a2a56016027d8b470: Status 404 returned error can't find the container with id 8bcfa17cea16d9d0eedddc6a61ef37d3c3f141470253792a2a56016027d8b470
Jul 02 14:19:48.801398 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.801368    2559 generic.go:356] "Generic (PLEG): container finished" podID="3da50a58-ffc4-497d-86a9-49fe03aa0717" containerID="6fb204e6c7a074435e9a68ed0ac95d548fe83b0c3490261bbb10d20908d57685" exitCode=0
Jul 02 14:19:48.801841 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.801465    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3da50a58-ffc4-497d-86a9-49fe03aa0717","Type":"ContainerDied","Data":"6fb204e6c7a074435e9a68ed0ac95d548fe83b0c3490261bbb10d20908d57685"}
Jul 02 14:19:48.801841 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.801546    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3da50a58-ffc4-497d-86a9-49fe03aa0717","Type":"ContainerStarted","Data":"8bcfa17cea16d9d0eedddc6a61ef37d3c3f141470253792a2a56016027d8b470"}
Jul 02 14:19:48.974565 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:48.974529    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="791b6e13-aca8-4d13-8cd6-4aa39f259836" path="/var/lib/kubelet/pods/791b6e13-aca8-4d13-8cd6-4aa39f259836/volumes"
Jul 02 14:19:49.813177 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:49.813135    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3da50a58-ffc4-497d-86a9-49fe03aa0717","Type":"ContainerStarted","Data":"92c1d828c98c0ca1be0887ea04510f46b41480ae89d34fc32dc2066167c4c799"}
Jul 02 14:19:49.813519 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:49.813202    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3da50a58-ffc4-497d-86a9-49fe03aa0717","Type":"ContainerStarted","Data":"1400d40c19fe750aa59d765173942e2842840232e7ddf7b2c9bf8287a980784e"}
Jul 02 14:19:49.813519 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:49.813235    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3da50a58-ffc4-497d-86a9-49fe03aa0717","Type":"ContainerStarted","Data":"f6dfe5da239200e0422bdd0da7b2f3b0be3b9dfc32fe7ed31df2f30bb60c6b0e"}
Jul 02 14:19:49.813519 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:49.813259    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3da50a58-ffc4-497d-86a9-49fe03aa0717","Type":"ContainerStarted","Data":"6bf5dc2c468ae2790364a34b36ebba62a08c1f2a492bfd0f8bdd0977eb1bc42a"}
Jul 02 14:19:49.813519 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:49.813287    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3da50a58-ffc4-497d-86a9-49fe03aa0717","Type":"ContainerStarted","Data":"b9cd109235cec8f2d554b7d40f21219676d41c30cf043202cd5d7f983cddedaa"}
Jul 02 14:19:49.813519 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:49.813320    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3da50a58-ffc4-497d-86a9-49fe03aa0717","Type":"ContainerStarted","Data":"20046e297c421826b1575da5afbd5d09150d63d725cf59f94346fc351373ca7f"}
Jul 02 14:19:49.844713 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:49.844637    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.822782751 podStartE2EDuration="2.844621714s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.838963ms" isStatefulPod=false podCreationTimestamp="2026-07-02 14:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:19:49.843125283 +0000 UTC m=+197.475018242" watchObservedRunningTime="2026-07-02 14:19:49.844621714 +0000 UTC m=+197.476514652"
Jul 02 14:19:53.190606 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:19:53.190564    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:20:48.190577 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:20:48.190539    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:20:48.205951 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:20:48.205921    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:20:49.069792 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:20:49.069763    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 14:21:32.910144 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:21:32.910119    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 14:24:04.357910 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.357833    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-j2pt8"]
Jul 02 14:24:04.361544 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.361523    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-j2pt8"
Jul 02 14:24:04.364443 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.364418    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-tgwzl\""
Jul 02 14:24:04.364892 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.364872    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 02 14:24:04.365579 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.365556    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 02 14:24:04.365731 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.365712    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 02 14:24:04.371472 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.371451    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-j2pt8"]
Jul 02 14:24:04.458632 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.458595    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef41d75-1911-4d3a-bd2f-a1b089a487b4-model-cache\") pod \"s3-init-j2pt8\" (UID: \"3ef41d75-1911-4d3a-bd2f-a1b089a487b4\") " pod="kserve/s3-init-j2pt8"
Jul 02 14:24:04.458822 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.458685    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8hd9\" (UniqueName: \"kubernetes.io/projected/3ef41d75-1911-4d3a-bd2f-a1b089a487b4-kube-api-access-l8hd9\") pod \"s3-init-j2pt8\" (UID: \"3ef41d75-1911-4d3a-bd2f-a1b089a487b4\") " pod="kserve/s3-init-j2pt8"
Jul 02 14:24:04.559317 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.559284    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8hd9\" (UniqueName: \"kubernetes.io/projected/3ef41d75-1911-4d3a-bd2f-a1b089a487b4-kube-api-access-l8hd9\") pod \"s3-init-j2pt8\" (UID: \"3ef41d75-1911-4d3a-bd2f-a1b089a487b4\") " pod="kserve/s3-init-j2pt8"
Jul 02 14:24:04.559475 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.559357    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef41d75-1911-4d3a-bd2f-a1b089a487b4-model-cache\") pod \"s3-init-j2pt8\" (UID: \"3ef41d75-1911-4d3a-bd2f-a1b089a487b4\") " pod="kserve/s3-init-j2pt8"
Jul 02 14:24:04.559741 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.559725    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef41d75-1911-4d3a-bd2f-a1b089a487b4-model-cache\") pod \"s3-init-j2pt8\" (UID: \"3ef41d75-1911-4d3a-bd2f-a1b089a487b4\") " pod="kserve/s3-init-j2pt8"
Jul 02 14:24:04.569489 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.569468    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8hd9\" (UniqueName: \"kubernetes.io/projected/3ef41d75-1911-4d3a-bd2f-a1b089a487b4-kube-api-access-l8hd9\") pod \"s3-init-j2pt8\" (UID: \"3ef41d75-1911-4d3a-bd2f-a1b089a487b4\") " pod="kserve/s3-init-j2pt8"
Jul 02 14:24:04.682252 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.682180    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-j2pt8"
Jul 02 14:24:04.812549 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.812519    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-j2pt8"]
Jul 02 14:24:04.814956 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:24:04.814933    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ef41d75_1911_4d3a_bd2f_a1b089a487b4.slice/crio-6b545e7755ca1f229c11c14b280364582da5617e2b389c4f5c60c21035b04e1e WatchSource:0}: Error finding container 6b545e7755ca1f229c11c14b280364582da5617e2b389c4f5c60c21035b04e1e: Status 404 returned error can't find the container with id 6b545e7755ca1f229c11c14b280364582da5617e2b389c4f5c60c21035b04e1e
Jul 02 14:24:04.816823 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.816806    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 14:24:04.829905 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:04.829881    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-j2pt8" event={"ID":"3ef41d75-1911-4d3a-bd2f-a1b089a487b4","Type":"ContainerStarted","Data":"6b545e7755ca1f229c11c14b280364582da5617e2b389c4f5c60c21035b04e1e"}
Jul 02 14:24:08.851628 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:08.851588    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-j2pt8" event={"ID":"3ef41d75-1911-4d3a-bd2f-a1b089a487b4","Type":"ContainerStarted","Data":"768a7d1fa1dd60d20696db0d96706f7480463731dd251d42a58cc85ce797d6eb"}
Jul 02 14:24:10.861608 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:10.861576    2559 generic.go:356] "Generic (PLEG): container finished" podID="3ef41d75-1911-4d3a-bd2f-a1b089a487b4" containerID="768a7d1fa1dd60d20696db0d96706f7480463731dd251d42a58cc85ce797d6eb" exitCode=0
Jul 02 14:24:10.862014 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:10.861669    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-j2pt8" event={"ID":"3ef41d75-1911-4d3a-bd2f-a1b089a487b4","Type":"ContainerDied","Data":"768a7d1fa1dd60d20696db0d96706f7480463731dd251d42a58cc85ce797d6eb"}
Jul 02 14:24:15.886231 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:15.886194    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-j2pt8" event={"ID":"3ef41d75-1911-4d3a-bd2f-a1b089a487b4","Type":"ContainerStarted","Data":"30e266d9adb7140dc5676be9800508bc92d12b4d8b5b8b9fc798cd25aacf8684"}
Jul 02 14:24:15.903787 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:24:15.903739    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-j2pt8" podStartSLOduration=2.223524228 podStartE2EDuration="11.903723981s" totalImagesPullingTime="8.108807645s" totalInitContainerRuntime="1.571392108s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:24:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:24:15.903154416 +0000 UTC m=+463.535047354" watchObservedRunningTime="2026-07-02 14:24:15.903723981 +0000 UTC m=+463.535616918"
Jul 02 14:25:21.156484 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:21.156450    2559 generic.go:356] "Generic (PLEG): container finished" podID="3ef41d75-1911-4d3a-bd2f-a1b089a487b4" containerID="30e266d9adb7140dc5676be9800508bc92d12b4d8b5b8b9fc798cd25aacf8684" exitCode=0
Jul 02 14:25:21.156920 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:21.156499    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-j2pt8" event={"ID":"3ef41d75-1911-4d3a-bd2f-a1b089a487b4","Type":"ContainerDied","Data":"30e266d9adb7140dc5676be9800508bc92d12b4d8b5b8b9fc798cd25aacf8684"}
Jul 02 14:25:22.287995 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:22.287969    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-j2pt8"
Jul 02 14:25:22.342848 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:22.342812    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef41d75-1911-4d3a-bd2f-a1b089a487b4-model-cache\") pod \"3ef41d75-1911-4d3a-bd2f-a1b089a487b4\" (UID: \"3ef41d75-1911-4d3a-bd2f-a1b089a487b4\") "
Jul 02 14:25:22.343019 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:22.342852    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8hd9\" (UniqueName: \"kubernetes.io/projected/3ef41d75-1911-4d3a-bd2f-a1b089a487b4-kube-api-access-l8hd9\") pod \"3ef41d75-1911-4d3a-bd2f-a1b089a487b4\" (UID: \"3ef41d75-1911-4d3a-bd2f-a1b089a487b4\") "
Jul 02 14:25:22.345014 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:22.344985    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ef41d75-1911-4d3a-bd2f-a1b089a487b4-kube-api-access-l8hd9" (OuterVolumeSpecName: "kube-api-access-l8hd9") pod "3ef41d75-1911-4d3a-bd2f-a1b089a487b4" (UID: "3ef41d75-1911-4d3a-bd2f-a1b089a487b4"). InnerVolumeSpecName "kube-api-access-l8hd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 14:25:22.361414 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:22.361389    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ef41d75-1911-4d3a-bd2f-a1b089a487b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "3ef41d75-1911-4d3a-bd2f-a1b089a487b4" (UID: "3ef41d75-1911-4d3a-bd2f-a1b089a487b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 14:25:22.444204 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:22.444135    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ef41d75-1911-4d3a-bd2f-a1b089a487b4-model-cache\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:25:22.444204 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:22.444157    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8hd9\" (UniqueName: \"kubernetes.io/projected/3ef41d75-1911-4d3a-bd2f-a1b089a487b4-kube-api-access-l8hd9\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:25:23.171265 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:23.171222    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-j2pt8" event={"ID":"3ef41d75-1911-4d3a-bd2f-a1b089a487b4","Type":"ContainerDied","Data":"6b545e7755ca1f229c11c14b280364582da5617e2b389c4f5c60c21035b04e1e"}
Jul 02 14:25:23.171265 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:23.171262    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b545e7755ca1f229c11c14b280364582da5617e2b389c4f5c60c21035b04e1e"
Jul 02 14:25:23.171265 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:23.171232    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-j2pt8"
Jul 02 14:25:35.229193 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.229119    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"]
Jul 02 14:25:35.229540 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.229453    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ef41d75-1911-4d3a-bd2f-a1b089a487b4" containerName="s3-init"
Jul 02 14:25:35.229540 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.229464    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ef41d75-1911-4d3a-bd2f-a1b089a487b4" containerName="s3-init"
Jul 02 14:25:35.229540 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.229477    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ef41d75-1911-4d3a-bd2f-a1b089a487b4" containerName="download-hf-model"
Jul 02 14:25:35.229540 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.229482    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ef41d75-1911-4d3a-bd2f-a1b089a487b4" containerName="download-hf-model"
Jul 02 14:25:35.229716 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.229552    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ef41d75-1911-4d3a-bd2f-a1b089a487b4" containerName="s3-init"
Jul 02 14:25:35.232645 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.232629    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.235290 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.235266    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 02 14:25:35.235434 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.235399    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-fn24b\""
Jul 02 14:25:35.235434 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.235413    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 02 14:25:35.235434 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.235421    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\""
Jul 02 14:25:35.235597 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.235430    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\""
Jul 02 14:25:35.235672 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.235642    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 02 14:25:35.236465 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.236450    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 02 14:25:35.245221 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.245201    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"]
Jul 02 14:25:35.350772 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.350737    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c4c5f264-e7f2-42b8-8791-2f83394a4322-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.350949 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.350798    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c4c5f264-e7f2-42b8-8791-2f83394a4322-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.350949 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.350825    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c4c5f264-e7f2-42b8-8791-2f83394a4322-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.350949 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.350875    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kqfq\" (UniqueName: \"kubernetes.io/projected/c4c5f264-e7f2-42b8-8791-2f83394a4322-kube-api-access-2kqfq\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.350949 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.350896    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c4c5f264-e7f2-42b8-8791-2f83394a4322-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.451926 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.451888    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c4c5f264-e7f2-42b8-8791-2f83394a4322-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.452104 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.451939    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c4c5f264-e7f2-42b8-8791-2f83394a4322-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.452104 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.451987    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kqfq\" (UniqueName: \"kubernetes.io/projected/c4c5f264-e7f2-42b8-8791-2f83394a4322-kube-api-access-2kqfq\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.452104 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.452007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c4c5f264-e7f2-42b8-8791-2f83394a4322-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.452104 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.452054    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c4c5f264-e7f2-42b8-8791-2f83394a4322-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.452320 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:25:35.452157    2559 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 02 14:25:35.452320 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:25:35.452224    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c5f264-e7f2-42b8-8791-2f83394a4322-proxy-tls podName:c4c5f264-e7f2-42b8-8791-2f83394a4322 nodeName:}" failed. No retries permitted until 2026-07-02 14:25:35.952201338 +0000 UTC m=+543.584094256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c4c5f264-e7f2-42b8-8791-2f83394a4322-proxy-tls") pod "isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" (UID: "c4c5f264-e7f2-42b8-8791-2f83394a4322") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found
Jul 02 14:25:35.452494 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.452469    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c4c5f264-e7f2-42b8-8791-2f83394a4322-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.452719 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.452699    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c4c5f264-e7f2-42b8-8791-2f83394a4322-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.452804 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.452781    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c4c5f264-e7f2-42b8-8791-2f83394a4322-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.463149 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.463119    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kqfq\" (UniqueName: \"kubernetes.io/projected/c4c5f264-e7f2-42b8-8791-2f83394a4322-kube-api-access-2kqfq\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.539875 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.539847    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"]
Jul 02 14:25:35.543585 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.543568    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.545891 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.545872    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\""
Jul 02 14:25:35.545996 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.545914    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\""
Jul 02 14:25:35.555360 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.555334    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"]
Jul 02 14:25:35.654462 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.654433    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5df30d29-772b-4747-8181-b2610772dfd8-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.654641 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.654480    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5df30d29-772b-4747-8181-b2610772dfd8-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.654641 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.654538    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5df30d29-772b-4747-8181-b2610772dfd8-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.654641 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.654578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttxtl\" (UniqueName: \"kubernetes.io/projected/5df30d29-772b-4747-8181-b2610772dfd8-kube-api-access-ttxtl\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.654837 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.654714    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5df30d29-772b-4747-8181-b2610772dfd8-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.725045 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.725012    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"]
Jul 02 14:25:35.728545 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.728530    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.731076 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.731054    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\""
Jul 02 14:25:35.731283 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.731260    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\""
Jul 02 14:25:35.740885 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.740866    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"]
Jul 02 14:25:35.755543 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.755519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5df30d29-772b-4747-8181-b2610772dfd8-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.755674 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.755565    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5df30d29-772b-4747-8181-b2610772dfd8-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.755674 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.755600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5df30d29-772b-4747-8181-b2610772dfd8-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.755674 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.755638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5df30d29-772b-4747-8181-b2610772dfd8-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.755881 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.755860    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttxtl\" (UniqueName: \"kubernetes.io/projected/5df30d29-772b-4747-8181-b2610772dfd8-kube-api-access-ttxtl\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.756140 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.756117    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5df30d29-772b-4747-8181-b2610772dfd8-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.756438 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.756417    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5df30d29-772b-4747-8181-b2610772dfd8-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.756573 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.756551    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5df30d29-772b-4747-8181-b2610772dfd8-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.758199 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.758180    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5df30d29-772b-4747-8181-b2610772dfd8-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.764766 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.764748    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttxtl\" (UniqueName: \"kubernetes.io/projected/5df30d29-772b-4747-8181-b2610772dfd8-kube-api-access-ttxtl\") pod \"isvc-xgboost-graph-predictor-555fc69d56-wrtz5\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.854407 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.854327    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:25:35.856642 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.856623    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f347f490-0755-4416-bec9-0877c3b74d06-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.856783 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.856691    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f347f490-0755-4416-bec9-0877c3b74d06-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.856783 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.856715    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f347f490-0755-4416-bec9-0877c3b74d06-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.856783 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.856740    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8tf8\" (UniqueName: \"kubernetes.io/projected/f347f490-0755-4416-bec9-0877c3b74d06-kube-api-access-d8tf8\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.856889 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.856795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f347f490-0755-4416-bec9-0877c3b74d06-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.957847 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.957816    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f347f490-0755-4416-bec9-0877c3b74d06-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.958004 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.957868    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c4c5f264-e7f2-42b8-8791-2f83394a4322-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.958004 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.957891    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f347f490-0755-4416-bec9-0877c3b74d06-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.958004 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.957938    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f347f490-0755-4416-bec9-0877c3b74d06-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.958004 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.957974    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f347f490-0755-4416-bec9-0877c3b74d06-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.958219 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.958011    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8tf8\" (UniqueName: \"kubernetes.io/projected/f347f490-0755-4416-bec9-0877c3b74d06-kube-api-access-d8tf8\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.958359 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.958326    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f347f490-0755-4416-bec9-0877c3b74d06-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.958444 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:25:35.958363    2559 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-serving-cert: secret "isvc-sklearn-graph-2-predictor-serving-cert" not found
Jul 02 14:25:35.958444 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:25:35.958424    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f347f490-0755-4416-bec9-0877c3b74d06-proxy-tls podName:f347f490-0755-4416-bec9-0877c3b74d06 nodeName:}" failed. No retries permitted until 2026-07-02 14:25:36.45840461 +0000 UTC m=+544.090297530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f347f490-0755-4416-bec9-0877c3b74d06-proxy-tls") pod "isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" (UID: "f347f490-0755-4416-bec9-0877c3b74d06") : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found
Jul 02 14:25:35.958667 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.958615    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f347f490-0755-4416-bec9-0877c3b74d06-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.958803 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.958781    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f347f490-0755-4416-bec9-0877c3b74d06-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.960705 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.960681    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c4c5f264-e7f2-42b8-8791-2f83394a4322-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:35.970207 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.970186    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8tf8\" (UniqueName: \"kubernetes.io/projected/f347f490-0755-4416-bec9-0877c3b74d06-kube-api-access-d8tf8\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:35.986059 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:35.986031    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"]
Jul 02 14:25:35.988452 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:25:35.988431    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df30d29_772b_4747_8181_b2610772dfd8.slice/crio-6e07df193d52a3a904e48bd72e047cb9298f1184542cf06ec7cd45080d422803 WatchSource:0}: Error finding container 6e07df193d52a3a904e48bd72e047cb9298f1184542cf06ec7cd45080d422803: Status 404 returned error can't find the container with id 6e07df193d52a3a904e48bd72e047cb9298f1184542cf06ec7cd45080d422803
Jul 02 14:25:36.142500 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:36.142415    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:25:36.228209 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:36.228176    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" event={"ID":"5df30d29-772b-4747-8181-b2610772dfd8","Type":"ContainerStarted","Data":"fc2f68ff4f3cb9b48b00ff23e970c6cd2906f03684f6d5173219aadcfd65f4bc"}
Jul 02 14:25:36.228342 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:36.228251    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" event={"ID":"5df30d29-772b-4747-8181-b2610772dfd8","Type":"ContainerStarted","Data":"6e07df193d52a3a904e48bd72e047cb9298f1184542cf06ec7cd45080d422803"}
Jul 02 14:25:36.277939 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:36.277903    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"]
Jul 02 14:25:36.281694 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:25:36.281666    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c5f264_e7f2_42b8_8791_2f83394a4322.slice/crio-5ed87d35f54e3aa0a3b520936bc39064a50110562f130d1ec8ed7238741a0a09 WatchSource:0}: Error finding container 5ed87d35f54e3aa0a3b520936bc39064a50110562f130d1ec8ed7238741a0a09: Status 404 returned error can't find the container with id 5ed87d35f54e3aa0a3b520936bc39064a50110562f130d1ec8ed7238741a0a09
Jul 02 14:25:36.462998 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:36.462909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f347f490-0755-4416-bec9-0877c3b74d06-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:36.465509 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:36.465477    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f347f490-0755-4416-bec9-0877c3b74d06-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:36.638298 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:36.638264    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:25:36.773582 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:36.773512    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"]
Jul 02 14:25:36.776168 ip-10-0-143-132 kubenswrapper[2559]: W0702 14:25:36.776144    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf347f490_0755_4416_bec9_0877c3b74d06.slice/crio-fb452faa123f1dfbf0632d894431f3ca49d4664eb30ed91db6e0c0cc6b02132c WatchSource:0}: Error finding container fb452faa123f1dfbf0632d894431f3ca49d4664eb30ed91db6e0c0cc6b02132c: Status 404 returned error can't find the container with id fb452faa123f1dfbf0632d894431f3ca49d4664eb30ed91db6e0c0cc6b02132c
Jul 02 14:25:37.234084 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:37.234045    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" event={"ID":"f347f490-0755-4416-bec9-0877c3b74d06","Type":"ContainerStarted","Data":"c9fd3c95ba124af1a4c35bf2f18650040c1d8ace4601e9a61751f6e203aeb8e4"}
Jul 02 14:25:37.234285 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:37.234122    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" event={"ID":"f347f490-0755-4416-bec9-0877c3b74d06","Type":"ContainerStarted","Data":"fb452faa123f1dfbf0632d894431f3ca49d4664eb30ed91db6e0c0cc6b02132c"}
Jul 02 14:25:37.235581 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:37.235545    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" event={"ID":"c4c5f264-e7f2-42b8-8791-2f83394a4322","Type":"ContainerStarted","Data":"f53641e19e0574d1fa1eb0a814f23b56fdc6aa19834a489f2034168befbca4bf"}
Jul 02 14:25:37.235693 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:37.235609    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" event={"ID":"c4c5f264-e7f2-42b8-8791-2f83394a4322","Type":"ContainerStarted","Data":"5ed87d35f54e3aa0a3b520936bc39064a50110562f130d1ec8ed7238741a0a09"}
Jul 02 14:25:40.250846 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:40.250817    2559 generic.go:356] "Generic (PLEG): container finished" podID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerID="f53641e19e0574d1fa1eb0a814f23b56fdc6aa19834a489f2034168befbca4bf" exitCode=0
Jul 02 14:25:40.251230 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:40.250889    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" event={"ID":"c4c5f264-e7f2-42b8-8791-2f83394a4322","Type":"ContainerDied","Data":"f53641e19e0574d1fa1eb0a814f23b56fdc6aa19834a489f2034168befbca4bf"}
Jul 02 14:25:40.252566 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:40.252463    2559 generic.go:356] "Generic (PLEG): container finished" podID="5df30d29-772b-4747-8181-b2610772dfd8" containerID="fc2f68ff4f3cb9b48b00ff23e970c6cd2906f03684f6d5173219aadcfd65f4bc" exitCode=0
Jul 02 14:25:40.252566 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:40.252521    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" event={"ID":"5df30d29-772b-4747-8181-b2610772dfd8","Type":"ContainerDied","Data":"fc2f68ff4f3cb9b48b00ff23e970c6cd2906f03684f6d5173219aadcfd65f4bc"}
Jul 02 14:25:41.270667 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:41.269804    2559 generic.go:356] "Generic (PLEG): container finished" podID="f347f490-0755-4416-bec9-0877c3b74d06" containerID="c9fd3c95ba124af1a4c35bf2f18650040c1d8ace4601e9a61751f6e203aeb8e4" exitCode=0
Jul 02 14:25:41.270667 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:25:41.269923    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" event={"ID":"f347f490-0755-4416-bec9-0877c3b74d06","Type":"ContainerDied","Data":"c9fd3c95ba124af1a4c35bf2f18650040c1d8ace4601e9a61751f6e203aeb8e4"}
Jul 02 14:26:08.476151 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:08.476012    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" event={"ID":"5df30d29-772b-4747-8181-b2610772dfd8","Type":"ContainerStarted","Data":"b0e200fd13c44eafc9f4238c37594566c8ed8b4845e65e0495d89ae4af16dcd7"}
Jul 02 14:26:08.479203 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:08.478936    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" event={"ID":"f347f490-0755-4416-bec9-0877c3b74d06","Type":"ContainerStarted","Data":"f03ae2e5d18b03737ab1d2b10d1cdc401310c879b9f506db4e4f53a174f75e42"}
Jul 02 14:26:08.481964 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:08.481940    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" event={"ID":"c4c5f264-e7f2-42b8-8791-2f83394a4322","Type":"ContainerStarted","Data":"b1c161c5a18cfb5c507f380e74c3ef77a930778fe149db627106a0612b917c30"}
Jul 02 14:26:11.503050 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:11.503017    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" event={"ID":"5df30d29-772b-4747-8181-b2610772dfd8","Type":"ContainerStarted","Data":"bcf7eb0ed6987bd661831e8c794e1983951c2703b0c5ce8e4433991063a2ec25"}
Jul 02 14:26:11.503517 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:11.503084    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:26:11.503517 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:11.503117    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:26:11.504231 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:11.504206    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 02 14:26:11.505225 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:11.505203    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" event={"ID":"f347f490-0755-4416-bec9-0877c3b74d06","Type":"ContainerStarted","Data":"196fda34adde34132457430e4676ea9bda17b5ca1b2bf798e62a582312b389ec"}
Jul 02 14:26:11.505358 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:11.505341    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:26:11.507284 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:11.507264    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" event={"ID":"c4c5f264-e7f2-42b8-8791-2f83394a4322","Type":"ContainerStarted","Data":"1a37a14b1d3230545e72dff1d23f6b6ba44ee5c7971a1ec48b6d0dd25c5859ec"}
Jul 02 14:26:11.507404 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:11.507388    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:26:11.507466 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:11.507427    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:26:11.508530 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:11.508505    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 02 14:26:11.522738 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:11.522693    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" podStartSLOduration=2.608911116 podStartE2EDuration="36.522675764s" totalImagesPullingTime="30.198432142s" totalInitContainerRuntime="3.715332506s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:25:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:26:11.521907868 +0000 UTC m=+579.153800827" watchObservedRunningTime="2026-07-02 14:26:11.522675764 +0000 UTC m=+579.154568698"
Jul 02 14:26:11.547473 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:11.547431    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podStartSLOduration=3.908949087 podStartE2EDuration="36.547416525s" totalImagesPullingTime="29.162953141s" totalInitContainerRuntime="3.475514297s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:25:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:26:11.546416627 +0000 UTC m=+579.178309565" watchObservedRunningTime="2026-07-02 14:26:11.547416525 +0000 UTC m=+579.179309462"
Jul 02 14:26:11.572533 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:11.572476    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podStartSLOduration=2.534458699 podStartE2EDuration="36.572456105s" totalImagesPullingTime="30.181296581s" totalInitContainerRuntime="3.856700825s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:25:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:26:11.570249857 +0000 UTC m=+579.202142818" watchObservedRunningTime="2026-07-02 14:26:11.572456105 +0000 UTC m=+579.204349043"
Jul 02 14:26:12.511826 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:12.511779    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 02 14:26:12.512284 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:12.511785    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 02 14:26:12.512284 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:12.511986    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:26:12.512986 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:12.512957    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 02 14:26:13.516407 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:13.516367    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 02 14:26:17.516304 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:17.516275    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:26:17.516884 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:17.516852    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 02 14:26:17.517178 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:17.517157    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:26:17.517857 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:17.517828    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 02 14:26:18.520646 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:18.520619    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:26:18.521198 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:18.521169    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 02 14:26:27.517645 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:27.517605    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 02 14:26:27.518095 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:27.517855    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 02 14:26:28.521583 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:28.521545    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 02 14:26:37.517265 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:37.517225    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 02 14:26:37.518457 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:37.518431    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 02 14:26:38.522035 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:38.521991    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 02 14:26:47.517545 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:47.517508    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 02 14:26:47.518053 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:47.517912    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 02 14:26:48.521464 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:48.521420    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 02 14:26:57.517584 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:57.517502    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 02 14:26:57.517974 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:57.517915    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 02 14:26:58.521436 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:26:58.521400    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 02 14:27:07.517723 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:27:07.517686    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 02 14:27:07.518111 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:27:07.517907    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 02 14:27:08.521830 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:27:08.521790    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 02 14:27:17.517247 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:27:17.517211    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 02 14:27:17.518832 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:27:17.518813    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:27:18.521116 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:27:18.521078    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 02 14:27:27.517685 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:27:27.517640    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:27:28.522537 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:27:28.522510    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:28:05.312606 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:05.312573    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"]
Jul 02 14:28:05.313144 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:05.312833    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kserve-container" containerID="cri-o://b0e200fd13c44eafc9f4238c37594566c8ed8b4845e65e0495d89ae4af16dcd7" gracePeriod=30
Jul 02 14:28:05.313144 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:05.312867    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kube-rbac-proxy" containerID="cri-o://bcf7eb0ed6987bd661831e8c794e1983951c2703b0c5ce8e4433991063a2ec25" gracePeriod=30
Jul 02 14:28:05.368970 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:05.368941    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"]
Jul 02 14:28:05.369230 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:05.369203    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container" containerID="cri-o://f03ae2e5d18b03737ab1d2b10d1cdc401310c879b9f506db4e4f53a174f75e42" gracePeriod=30
Jul 02 14:28:05.369338 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:05.369268    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kube-rbac-proxy" containerID="cri-o://196fda34adde34132457430e4676ea9bda17b5ca1b2bf798e62a582312b389ec" gracePeriod=30
Jul 02 14:28:05.444888 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:05.444857    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"]
Jul 02 14:28:05.445130 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:05.445102    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container" containerID="cri-o://b1c161c5a18cfb5c507f380e74c3ef77a930778fe149db627106a0612b917c30" gracePeriod=30
Jul 02 14:28:05.445277 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:05.445129    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kube-rbac-proxy" containerID="cri-o://1a37a14b1d3230545e72dff1d23f6b6ba44ee5c7971a1ec48b6d0dd25c5859ec" gracePeriod=30
Jul 02 14:28:06.020643 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:06.020608    2559 generic.go:356] "Generic (PLEG): container finished" podID="f347f490-0755-4416-bec9-0877c3b74d06" containerID="196fda34adde34132457430e4676ea9bda17b5ca1b2bf798e62a582312b389ec" exitCode=2
Jul 02 14:28:06.020845 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:06.020684    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" event={"ID":"f347f490-0755-4416-bec9-0877c3b74d06","Type":"ContainerDied","Data":"196fda34adde34132457430e4676ea9bda17b5ca1b2bf798e62a582312b389ec"}
Jul 02 14:28:06.022784 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:06.022762    2559 generic.go:356] "Generic (PLEG): container finished" podID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerID="1a37a14b1d3230545e72dff1d23f6b6ba44ee5c7971a1ec48b6d0dd25c5859ec" exitCode=2
Jul 02 14:28:06.022921 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:06.022843    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" event={"ID":"c4c5f264-e7f2-42b8-8791-2f83394a4322","Type":"ContainerDied","Data":"1a37a14b1d3230545e72dff1d23f6b6ba44ee5c7971a1ec48b6d0dd25c5859ec"}
Jul 02 14:28:06.024738 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:06.024717    2559 generic.go:356] "Generic (PLEG): container finished" podID="5df30d29-772b-4747-8181-b2610772dfd8" containerID="bcf7eb0ed6987bd661831e8c794e1983951c2703b0c5ce8e4433991063a2ec25" exitCode=2
Jul 02 14:28:06.024842 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:06.024763    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" event={"ID":"5df30d29-772b-4747-8181-b2610772dfd8","Type":"ContainerDied","Data":"bcf7eb0ed6987bd661831e8c794e1983951c2703b0c5ce8e4433991063a2ec25"}
Jul 02 14:28:07.512757 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:07.512715    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.25:8643/healthz\": dial tcp 10.132.0.25:8643: connect: connection refused"
Jul 02 14:28:07.513152 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:07.512721    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.26:8643/healthz\": dial tcp 10.132.0.26:8643: connect: connection refused"
Jul 02 14:28:07.517216 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:07.517195    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused"
Jul 02 14:28:07.518466 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:07.518442    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.26:8080: connect: connection refused"
Jul 02 14:28:08.517366 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:08.517326    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.27:8643/healthz\": dial tcp 10.132.0.27:8643: connect: connection refused"
Jul 02 14:28:08.521745 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:08.521719    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.27:8080: connect: connection refused"
Jul 02 14:28:09.653985 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.653960    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:28:09.763992 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.763963    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttxtl\" (UniqueName: \"kubernetes.io/projected/5df30d29-772b-4747-8181-b2610772dfd8-kube-api-access-ttxtl\") pod \"5df30d29-772b-4747-8181-b2610772dfd8\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") "
Jul 02 14:28:09.764181 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.764024    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5df30d29-772b-4747-8181-b2610772dfd8-cabundle-cert\") pod \"5df30d29-772b-4747-8181-b2610772dfd8\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") "
Jul 02 14:28:09.764181 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.764079    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5df30d29-772b-4747-8181-b2610772dfd8-proxy-tls\") pod \"5df30d29-772b-4747-8181-b2610772dfd8\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") "
Jul 02 14:28:09.764181 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.764109    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5df30d29-772b-4747-8181-b2610772dfd8-kserve-provision-location\") pod \"5df30d29-772b-4747-8181-b2610772dfd8\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") "
Jul 02 14:28:09.764181 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.764140    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5df30d29-772b-4747-8181-b2610772dfd8-kube-rbac-proxy-sar-config\") pod \"5df30d29-772b-4747-8181-b2610772dfd8\" (UID: \"5df30d29-772b-4747-8181-b2610772dfd8\") "
Jul 02 14:28:09.764431 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.764384    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5df30d29-772b-4747-8181-b2610772dfd8-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "5df30d29-772b-4747-8181-b2610772dfd8" (UID: "5df30d29-772b-4747-8181-b2610772dfd8"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:28:09.764521 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.764392    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df30d29-772b-4747-8181-b2610772dfd8-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "5df30d29-772b-4747-8181-b2610772dfd8" (UID: "5df30d29-772b-4747-8181-b2610772dfd8"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 14:28:09.764588 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.764559    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5df30d29-772b-4747-8181-b2610772dfd8-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "5df30d29-772b-4747-8181-b2610772dfd8" (UID: "5df30d29-772b-4747-8181-b2610772dfd8"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:28:09.766393 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.766370    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5df30d29-772b-4747-8181-b2610772dfd8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5df30d29-772b-4747-8181-b2610772dfd8" (UID: "5df30d29-772b-4747-8181-b2610772dfd8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:28:09.766393 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.766371    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5df30d29-772b-4747-8181-b2610772dfd8-kube-api-access-ttxtl" (OuterVolumeSpecName: "kube-api-access-ttxtl") pod "5df30d29-772b-4747-8181-b2610772dfd8" (UID: "5df30d29-772b-4747-8181-b2610772dfd8"). InnerVolumeSpecName "kube-api-access-ttxtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 14:28:09.865105 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.865074    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttxtl\" (UniqueName: \"kubernetes.io/projected/5df30d29-772b-4747-8181-b2610772dfd8-kube-api-access-ttxtl\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:09.865105 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.865101    2559 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/5df30d29-772b-4747-8181-b2610772dfd8-cabundle-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:09.865105 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.865110    2559 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5df30d29-772b-4747-8181-b2610772dfd8-proxy-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:09.865330 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.865118    2559 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5df30d29-772b-4747-8181-b2610772dfd8-kserve-provision-location\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:09.865330 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:09.865130    2559 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/5df30d29-772b-4747-8181-b2610772dfd8-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:10.045280 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.045193    2559 generic.go:356] "Generic (PLEG): container finished" podID="5df30d29-772b-4747-8181-b2610772dfd8" containerID="b0e200fd13c44eafc9f4238c37594566c8ed8b4845e65e0495d89ae4af16dcd7" exitCode=0
Jul 02 14:28:10.045280 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.045240    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"
Jul 02 14:28:10.045505 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.045276    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" event={"ID":"5df30d29-772b-4747-8181-b2610772dfd8","Type":"ContainerDied","Data":"b0e200fd13c44eafc9f4238c37594566c8ed8b4845e65e0495d89ae4af16dcd7"}
Jul 02 14:28:10.045505 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.045347    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5" event={"ID":"5df30d29-772b-4747-8181-b2610772dfd8","Type":"ContainerDied","Data":"6e07df193d52a3a904e48bd72e047cb9298f1184542cf06ec7cd45080d422803"}
Jul 02 14:28:10.045505 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.045386    2559 scope.go:117] "RemoveContainer" containerID="bcf7eb0ed6987bd661831e8c794e1983951c2703b0c5ce8e4433991063a2ec25"
Jul 02 14:28:10.054511 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.054491    2559 scope.go:117] "RemoveContainer" containerID="b0e200fd13c44eafc9f4238c37594566c8ed8b4845e65e0495d89ae4af16dcd7"
Jul 02 14:28:10.061840 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.061816    2559 scope.go:117] "RemoveContainer" containerID="fc2f68ff4f3cb9b48b00ff23e970c6cd2906f03684f6d5173219aadcfd65f4bc"
Jul 02 14:28:10.068875 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.068861    2559 scope.go:117] "RemoveContainer" containerID="bcf7eb0ed6987bd661831e8c794e1983951c2703b0c5ce8e4433991063a2ec25"
Jul 02 14:28:10.069156 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:28:10.069121    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcf7eb0ed6987bd661831e8c794e1983951c2703b0c5ce8e4433991063a2ec25\": container with ID starting with bcf7eb0ed6987bd661831e8c794e1983951c2703b0c5ce8e4433991063a2ec25 not found: ID does not exist" containerID="bcf7eb0ed6987bd661831e8c794e1983951c2703b0c5ce8e4433991063a2ec25"
Jul 02 14:28:10.069244 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.069155    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf7eb0ed6987bd661831e8c794e1983951c2703b0c5ce8e4433991063a2ec25"} err="failed to get container status \"bcf7eb0ed6987bd661831e8c794e1983951c2703b0c5ce8e4433991063a2ec25\": rpc error: code = NotFound desc = could not find container \"bcf7eb0ed6987bd661831e8c794e1983951c2703b0c5ce8e4433991063a2ec25\": container with ID starting with bcf7eb0ed6987bd661831e8c794e1983951c2703b0c5ce8e4433991063a2ec25 not found: ID does not exist"
Jul 02 14:28:10.069244 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.069178    2559 scope.go:117] "RemoveContainer" containerID="b0e200fd13c44eafc9f4238c37594566c8ed8b4845e65e0495d89ae4af16dcd7"
Jul 02 14:28:10.069447 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:28:10.069418    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0e200fd13c44eafc9f4238c37594566c8ed8b4845e65e0495d89ae4af16dcd7\": container with ID starting with b0e200fd13c44eafc9f4238c37594566c8ed8b4845e65e0495d89ae4af16dcd7 not found: ID does not exist" containerID="b0e200fd13c44eafc9f4238c37594566c8ed8b4845e65e0495d89ae4af16dcd7"
Jul 02 14:28:10.069501 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.069452    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0e200fd13c44eafc9f4238c37594566c8ed8b4845e65e0495d89ae4af16dcd7"} err="failed to get container status \"b0e200fd13c44eafc9f4238c37594566c8ed8b4845e65e0495d89ae4af16dcd7\": rpc error: code = NotFound desc = could not find container \"b0e200fd13c44eafc9f4238c37594566c8ed8b4845e65e0495d89ae4af16dcd7\": container with ID starting with b0e200fd13c44eafc9f4238c37594566c8ed8b4845e65e0495d89ae4af16dcd7 not found: ID does not exist"
Jul 02 14:28:10.069501 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.069468    2559 scope.go:117] "RemoveContainer" containerID="fc2f68ff4f3cb9b48b00ff23e970c6cd2906f03684f6d5173219aadcfd65f4bc"
Jul 02 14:28:10.069711 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:28:10.069686    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc2f68ff4f3cb9b48b00ff23e970c6cd2906f03684f6d5173219aadcfd65f4bc\": container with ID starting with fc2f68ff4f3cb9b48b00ff23e970c6cd2906f03684f6d5173219aadcfd65f4bc not found: ID does not exist" containerID="fc2f68ff4f3cb9b48b00ff23e970c6cd2906f03684f6d5173219aadcfd65f4bc"
Jul 02 14:28:10.069799 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.069715    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc2f68ff4f3cb9b48b00ff23e970c6cd2906f03684f6d5173219aadcfd65f4bc"} err="failed to get container status \"fc2f68ff4f3cb9b48b00ff23e970c6cd2906f03684f6d5173219aadcfd65f4bc\": rpc error: code = NotFound desc = could not find container \"fc2f68ff4f3cb9b48b00ff23e970c6cd2906f03684f6d5173219aadcfd65f4bc\": container with ID starting with fc2f68ff4f3cb9b48b00ff23e970c6cd2906f03684f6d5173219aadcfd65f4bc not found: ID does not exist"
Jul 02 14:28:10.072450 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.072430    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"]
Jul 02 14:28:10.079169 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.079147    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-wrtz5"]
Jul 02 14:28:10.309701 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.309678    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:28:10.370188 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.370165    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f347f490-0755-4416-bec9-0877c3b74d06-kserve-provision-location\") pod \"f347f490-0755-4416-bec9-0877c3b74d06\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") "
Jul 02 14:28:10.370332 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.370220    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f347f490-0755-4416-bec9-0877c3b74d06-cabundle-cert\") pod \"f347f490-0755-4416-bec9-0877c3b74d06\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") "
Jul 02 14:28:10.370332 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.370251    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8tf8\" (UniqueName: \"kubernetes.io/projected/f347f490-0755-4416-bec9-0877c3b74d06-kube-api-access-d8tf8\") pod \"f347f490-0755-4416-bec9-0877c3b74d06\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") "
Jul 02 14:28:10.370332 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.370292    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f347f490-0755-4416-bec9-0877c3b74d06-proxy-tls\") pod \"f347f490-0755-4416-bec9-0877c3b74d06\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") "
Jul 02 14:28:10.370472 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.370336    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f347f490-0755-4416-bec9-0877c3b74d06-kube-rbac-proxy-sar-config\") pod \"f347f490-0755-4416-bec9-0877c3b74d06\" (UID: \"f347f490-0755-4416-bec9-0877c3b74d06\") "
Jul 02 14:28:10.370685 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.370636    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f347f490-0755-4416-bec9-0877c3b74d06-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "f347f490-0755-4416-bec9-0877c3b74d06" (UID: "f347f490-0755-4416-bec9-0877c3b74d06"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:28:10.370784 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.370671    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f347f490-0755-4416-bec9-0877c3b74d06-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "f347f490-0755-4416-bec9-0877c3b74d06" (UID: "f347f490-0755-4416-bec9-0877c3b74d06"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 14:28:10.370784 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.370768    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f347f490-0755-4416-bec9-0877c3b74d06-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f347f490-0755-4416-bec9-0877c3b74d06" (UID: "f347f490-0755-4416-bec9-0877c3b74d06"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:28:10.372340 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.372319    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f347f490-0755-4416-bec9-0877c3b74d06-kube-api-access-d8tf8" (OuterVolumeSpecName: "kube-api-access-d8tf8") pod "f347f490-0755-4416-bec9-0877c3b74d06" (UID: "f347f490-0755-4416-bec9-0877c3b74d06"). InnerVolumeSpecName "kube-api-access-d8tf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 14:28:10.372390 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.372321    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f347f490-0755-4416-bec9-0877c3b74d06-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f347f490-0755-4416-bec9-0877c3b74d06" (UID: "f347f490-0755-4416-bec9-0877c3b74d06"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:28:10.471964 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.471934    2559 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f347f490-0755-4416-bec9-0877c3b74d06-cabundle-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:10.471964 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.471960    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8tf8\" (UniqueName: \"kubernetes.io/projected/f347f490-0755-4416-bec9-0877c3b74d06-kube-api-access-d8tf8\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:10.471964 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.471969    2559 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f347f490-0755-4416-bec9-0877c3b74d06-proxy-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:10.472167 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.471980    2559 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f347f490-0755-4416-bec9-0877c3b74d06-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:10.472167 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.471990    2559 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f347f490-0755-4416-bec9-0877c3b74d06-kserve-provision-location\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:10.977342 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.977297    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5df30d29-772b-4747-8181-b2610772dfd8" path="/var/lib/kubelet/pods/5df30d29-772b-4747-8181-b2610772dfd8/volumes"
Jul 02 14:28:10.992708 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:10.992688    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:28:11.051539 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.051505    2559 generic.go:356] "Generic (PLEG): container finished" podID="f347f490-0755-4416-bec9-0877c3b74d06" containerID="f03ae2e5d18b03737ab1d2b10d1cdc401310c879b9f506db4e4f53a174f75e42" exitCode=0
Jul 02 14:28:11.051725 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.051584    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"
Jul 02 14:28:11.051725 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.051583    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" event={"ID":"f347f490-0755-4416-bec9-0877c3b74d06","Type":"ContainerDied","Data":"f03ae2e5d18b03737ab1d2b10d1cdc401310c879b9f506db4e4f53a174f75e42"}
Jul 02 14:28:11.051842 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.051750    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4" event={"ID":"f347f490-0755-4416-bec9-0877c3b74d06","Type":"ContainerDied","Data":"fb452faa123f1dfbf0632d894431f3ca49d4664eb30ed91db6e0c0cc6b02132c"}
Jul 02 14:28:11.051842 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.051800    2559 scope.go:117] "RemoveContainer" containerID="196fda34adde34132457430e4676ea9bda17b5ca1b2bf798e62a582312b389ec"
Jul 02 14:28:11.053637 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.053611    2559 generic.go:356] "Generic (PLEG): container finished" podID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerID="b1c161c5a18cfb5c507f380e74c3ef77a930778fe149db627106a0612b917c30" exitCode=0
Jul 02 14:28:11.053866 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.053682    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" event={"ID":"c4c5f264-e7f2-42b8-8791-2f83394a4322","Type":"ContainerDied","Data":"b1c161c5a18cfb5c507f380e74c3ef77a930778fe149db627106a0612b917c30"}
Jul 02 14:28:11.053866 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.053699    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"
Jul 02 14:28:11.053866 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.053757    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd" event={"ID":"c4c5f264-e7f2-42b8-8791-2f83394a4322","Type":"ContainerDied","Data":"5ed87d35f54e3aa0a3b520936bc39064a50110562f130d1ec8ed7238741a0a09"}
Jul 02 14:28:11.060018 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.060002    2559 scope.go:117] "RemoveContainer" containerID="f03ae2e5d18b03737ab1d2b10d1cdc401310c879b9f506db4e4f53a174f75e42"
Jul 02 14:28:11.067170 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.067153    2559 scope.go:117] "RemoveContainer" containerID="c9fd3c95ba124af1a4c35bf2f18650040c1d8ace4601e9a61751f6e203aeb8e4"
Jul 02 14:28:11.074390 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.074375    2559 scope.go:117] "RemoveContainer" containerID="196fda34adde34132457430e4676ea9bda17b5ca1b2bf798e62a582312b389ec"
Jul 02 14:28:11.074688 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:28:11.074669    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"196fda34adde34132457430e4676ea9bda17b5ca1b2bf798e62a582312b389ec\": container with ID starting with 196fda34adde34132457430e4676ea9bda17b5ca1b2bf798e62a582312b389ec not found: ID does not exist" containerID="196fda34adde34132457430e4676ea9bda17b5ca1b2bf798e62a582312b389ec"
Jul 02 14:28:11.074742 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.074697    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"196fda34adde34132457430e4676ea9bda17b5ca1b2bf798e62a582312b389ec"} err="failed to get container status \"196fda34adde34132457430e4676ea9bda17b5ca1b2bf798e62a582312b389ec\": rpc error: code = NotFound desc = could not find container \"196fda34adde34132457430e4676ea9bda17b5ca1b2bf798e62a582312b389ec\": container with ID starting with 196fda34adde34132457430e4676ea9bda17b5ca1b2bf798e62a582312b389ec not found: ID does not exist"
Jul 02 14:28:11.074742 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.074715    2559 scope.go:117] "RemoveContainer" containerID="f03ae2e5d18b03737ab1d2b10d1cdc401310c879b9f506db4e4f53a174f75e42"
Jul 02 14:28:11.074963 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:28:11.074944    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f03ae2e5d18b03737ab1d2b10d1cdc401310c879b9f506db4e4f53a174f75e42\": container with ID starting with f03ae2e5d18b03737ab1d2b10d1cdc401310c879b9f506db4e4f53a174f75e42 not found: ID does not exist" containerID="f03ae2e5d18b03737ab1d2b10d1cdc401310c879b9f506db4e4f53a174f75e42"
Jul 02 14:28:11.075004 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.074969    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03ae2e5d18b03737ab1d2b10d1cdc401310c879b9f506db4e4f53a174f75e42"} err="failed to get container status \"f03ae2e5d18b03737ab1d2b10d1cdc401310c879b9f506db4e4f53a174f75e42\": rpc error: code = NotFound desc = could not find container \"f03ae2e5d18b03737ab1d2b10d1cdc401310c879b9f506db4e4f53a174f75e42\": container with ID starting with f03ae2e5d18b03737ab1d2b10d1cdc401310c879b9f506db4e4f53a174f75e42 not found: ID does not exist"
Jul 02 14:28:11.075004 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.074984    2559 scope.go:117] "RemoveContainer" containerID="c9fd3c95ba124af1a4c35bf2f18650040c1d8ace4601e9a61751f6e203aeb8e4"
Jul 02 14:28:11.075137 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.075122    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"]
Jul 02 14:28:11.075197 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:28:11.075179    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9fd3c95ba124af1a4c35bf2f18650040c1d8ace4601e9a61751f6e203aeb8e4\": container with ID starting with c9fd3c95ba124af1a4c35bf2f18650040c1d8ace4601e9a61751f6e203aeb8e4 not found: ID does not exist" containerID="c9fd3c95ba124af1a4c35bf2f18650040c1d8ace4601e9a61751f6e203aeb8e4"
Jul 02 14:28:11.075239 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.075202    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9fd3c95ba124af1a4c35bf2f18650040c1d8ace4601e9a61751f6e203aeb8e4"} err="failed to get container status \"c9fd3c95ba124af1a4c35bf2f18650040c1d8ace4601e9a61751f6e203aeb8e4\": rpc error: code = NotFound desc = could not find container \"c9fd3c95ba124af1a4c35bf2f18650040c1d8ace4601e9a61751f6e203aeb8e4\": container with ID starting with c9fd3c95ba124af1a4c35bf2f18650040c1d8ace4601e9a61751f6e203aeb8e4 not found: ID does not exist"
Jul 02 14:28:11.075239 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.075213    2559 scope.go:117] "RemoveContainer" containerID="1a37a14b1d3230545e72dff1d23f6b6ba44ee5c7971a1ec48b6d0dd25c5859ec"
Jul 02 14:28:11.077301 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.077284    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c4c5f264-e7f2-42b8-8791-2f83394a4322-cabundle-cert\") pod \"c4c5f264-e7f2-42b8-8791-2f83394a4322\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") "
Jul 02 14:28:11.077363 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.077321    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c4c5f264-e7f2-42b8-8791-2f83394a4322-proxy-tls\") pod \"c4c5f264-e7f2-42b8-8791-2f83394a4322\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") "
Jul 02 14:28:11.077363 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.077347    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c4c5f264-e7f2-42b8-8791-2f83394a4322-kube-rbac-proxy-sar-config\") pod \"c4c5f264-e7f2-42b8-8791-2f83394a4322\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") "
Jul 02 14:28:11.077477 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.077384    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c4c5f264-e7f2-42b8-8791-2f83394a4322-kserve-provision-location\") pod \"c4c5f264-e7f2-42b8-8791-2f83394a4322\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") "
Jul 02 14:28:11.077477 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.077430    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kqfq\" (UniqueName: \"kubernetes.io/projected/c4c5f264-e7f2-42b8-8791-2f83394a4322-kube-api-access-2kqfq\") pod \"c4c5f264-e7f2-42b8-8791-2f83394a4322\" (UID: \"c4c5f264-e7f2-42b8-8791-2f83394a4322\") "
Jul 02 14:28:11.077722 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.077696    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4c5f264-e7f2-42b8-8791-2f83394a4322-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "c4c5f264-e7f2-42b8-8791-2f83394a4322" (UID: "c4c5f264-e7f2-42b8-8791-2f83394a4322"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:28:11.077800 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.077727    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4c5f264-e7f2-42b8-8791-2f83394a4322-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c4c5f264-e7f2-42b8-8791-2f83394a4322" (UID: "c4c5f264-e7f2-42b8-8791-2f83394a4322"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 14:28:11.077800 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.077781    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4c5f264-e7f2-42b8-8791-2f83394a4322-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c4c5f264-e7f2-42b8-8791-2f83394a4322" (UID: "c4c5f264-e7f2-42b8-8791-2f83394a4322"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 14:28:11.077921 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.077905    2559 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c4c5f264-e7f2-42b8-8791-2f83394a4322-kserve-provision-location\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:11.077976 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.077929    2559 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c4c5f264-e7f2-42b8-8791-2f83394a4322-cabundle-cert\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:11.079314 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.079290    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4c5f264-e7f2-42b8-8791-2f83394a4322-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c4c5f264-e7f2-42b8-8791-2f83394a4322" (UID: "c4c5f264-e7f2-42b8-8791-2f83394a4322"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 14:28:11.079473 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.079452    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4c5f264-e7f2-42b8-8791-2f83394a4322-kube-api-access-2kqfq" (OuterVolumeSpecName: "kube-api-access-2kqfq") pod "c4c5f264-e7f2-42b8-8791-2f83394a4322" (UID: "c4c5f264-e7f2-42b8-8791-2f83394a4322"). InnerVolumeSpecName "kube-api-access-2kqfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 14:28:11.082415 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.082398    2559 scope.go:117] "RemoveContainer" containerID="b1c161c5a18cfb5c507f380e74c3ef77a930778fe149db627106a0612b917c30"
Jul 02 14:28:11.089399 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.089384    2559 scope.go:117] "RemoveContainer" containerID="f53641e19e0574d1fa1eb0a814f23b56fdc6aa19834a489f2034168befbca4bf"
Jul 02 14:28:11.096305 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.096290    2559 scope.go:117] "RemoveContainer" containerID="1a37a14b1d3230545e72dff1d23f6b6ba44ee5c7971a1ec48b6d0dd25c5859ec"
Jul 02 14:28:11.096562 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:28:11.096544    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a37a14b1d3230545e72dff1d23f6b6ba44ee5c7971a1ec48b6d0dd25c5859ec\": container with ID starting with 1a37a14b1d3230545e72dff1d23f6b6ba44ee5c7971a1ec48b6d0dd25c5859ec not found: ID does not exist" containerID="1a37a14b1d3230545e72dff1d23f6b6ba44ee5c7971a1ec48b6d0dd25c5859ec"
Jul 02 14:28:11.096612 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.096570    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a37a14b1d3230545e72dff1d23f6b6ba44ee5c7971a1ec48b6d0dd25c5859ec"} err="failed to get container status \"1a37a14b1d3230545e72dff1d23f6b6ba44ee5c7971a1ec48b6d0dd25c5859ec\": rpc error: code = NotFound desc = could not find container \"1a37a14b1d3230545e72dff1d23f6b6ba44ee5c7971a1ec48b6d0dd25c5859ec\": container with ID starting with 1a37a14b1d3230545e72dff1d23f6b6ba44ee5c7971a1ec48b6d0dd25c5859ec not found: ID does not exist"
Jul 02 14:28:11.096612 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.096585    2559 scope.go:117] "RemoveContainer" containerID="b1c161c5a18cfb5c507f380e74c3ef77a930778fe149db627106a0612b917c30"
Jul 02 14:28:11.096612 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.096587    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc64bd448-nh4b4"]
Jul 02 14:28:11.096838 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:28:11.096822    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1c161c5a18cfb5c507f380e74c3ef77a930778fe149db627106a0612b917c30\": container with ID starting with b1c161c5a18cfb5c507f380e74c3ef77a930778fe149db627106a0612b917c30 not found: ID does not exist" containerID="b1c161c5a18cfb5c507f380e74c3ef77a930778fe149db627106a0612b917c30"
Jul 02 14:28:11.096877 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.096849    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1c161c5a18cfb5c507f380e74c3ef77a930778fe149db627106a0612b917c30"} err="failed to get container status \"b1c161c5a18cfb5c507f380e74c3ef77a930778fe149db627106a0612b917c30\": rpc error: code = NotFound desc = could not find container \"b1c161c5a18cfb5c507f380e74c3ef77a930778fe149db627106a0612b917c30\": container with ID starting with b1c161c5a18cfb5c507f380e74c3ef77a930778fe149db627106a0612b917c30 not found: ID does not exist"
Jul 02 14:28:11.096877 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.096865    2559 scope.go:117] "RemoveContainer" containerID="f53641e19e0574d1fa1eb0a814f23b56fdc6aa19834a489f2034168befbca4bf"
Jul 02 14:28:11.097110 ip-10-0-143-132 kubenswrapper[2559]: E0702 14:28:11.097090    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f53641e19e0574d1fa1eb0a814f23b56fdc6aa19834a489f2034168befbca4bf\": container with ID starting with f53641e19e0574d1fa1eb0a814f23b56fdc6aa19834a489f2034168befbca4bf not found: ID does not exist" containerID="f53641e19e0574d1fa1eb0a814f23b56fdc6aa19834a489f2034168befbca4bf"
Jul 02 14:28:11.097157 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.097108    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f53641e19e0574d1fa1eb0a814f23b56fdc6aa19834a489f2034168befbca4bf"} err="failed to get container status \"f53641e19e0574d1fa1eb0a814f23b56fdc6aa19834a489f2034168befbca4bf\": rpc error: code = NotFound desc = could not find container \"f53641e19e0574d1fa1eb0a814f23b56fdc6aa19834a489f2034168befbca4bf\": container with ID starting with f53641e19e0574d1fa1eb0a814f23b56fdc6aa19834a489f2034168befbca4bf not found: ID does not exist"
Jul 02 14:28:11.179078 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.179051    2559 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c4c5f264-e7f2-42b8-8791-2f83394a4322-proxy-tls\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:11.179078 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.179076    2559 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c4c5f264-e7f2-42b8-8791-2f83394a4322-kube-rbac-proxy-sar-config\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:11.179256 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.179086    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kqfq\" (UniqueName: \"kubernetes.io/projected/c4c5f264-e7f2-42b8-8791-2f83394a4322-kube-api-access-2kqfq\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 14:28:11.378384 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.378348    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"]
Jul 02 14:28:11.383515 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:11.383490    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5b4cb68696-qzgmd"]
Jul 02 14:28:12.972489 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:12.972452    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" path="/var/lib/kubelet/pods/c4c5f264-e7f2-42b8-8791-2f83394a4322/volumes"
Jul 02 14:28:12.973034 ip-10-0-143-132 kubenswrapper[2559]: I0702 14:28:12.973017    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f347f490-0755-4416-bec9-0877c3b74d06" path="/var/lib/kubelet/pods/f347f490-0755-4416-bec9-0877c3b74d06/volumes"
Jul 02 15:05:29.983986 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.983956    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jvlpb/must-gather-k9p2j"]
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984295    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kserve-container"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984307    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kserve-container"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984319    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kube-rbac-proxy"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984325    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kube-rbac-proxy"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984334    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="storage-initializer"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984340    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="storage-initializer"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984345    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984350    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984364    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984368    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984376    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="storage-initializer"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984381    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="storage-initializer"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984386    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kube-rbac-proxy"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984392    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kube-rbac-proxy"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984398    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kube-rbac-proxy"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984403    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kube-rbac-proxy"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984412    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="storage-initializer"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984417    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="storage-initializer"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984462    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kserve-container"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984468    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kube-rbac-proxy"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984474    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4c5f264-e7f2-42b8-8791-2f83394a4322" containerName="kserve-container"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984481    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kube-rbac-proxy"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984490    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f347f490-0755-4416-bec9-0877c3b74d06" containerName="kserve-container"
Jul 02 15:05:29.986550 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.984496    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5df30d29-772b-4747-8181-b2610772dfd8" containerName="kube-rbac-proxy"
Jul 02 15:05:29.987537 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.987429    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jvlpb/must-gather-k9p2j"
Jul 02 15:05:29.990134 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.990109    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jvlpb\"/\"kube-root-ca.crt\""
Jul 02 15:05:29.990258 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.990175    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jvlpb\"/\"openshift-service-ca.crt\""
Jul 02 15:05:29.990258 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.990238    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jvlpb\"/\"default-dockercfg-q8vr2\""
Jul 02 15:05:29.996169 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:29.996150    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jvlpb/must-gather-k9p2j"]
Jul 02 15:05:30.130488 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:30.130452    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52tbt\" (UniqueName: \"kubernetes.io/projected/c7bed740-74e0-49bb-89cf-394aee8efa9a-kube-api-access-52tbt\") pod \"must-gather-k9p2j\" (UID: \"c7bed740-74e0-49bb-89cf-394aee8efa9a\") " pod="openshift-must-gather-jvlpb/must-gather-k9p2j"
Jul 02 15:05:30.130699 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:30.130507    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7bed740-74e0-49bb-89cf-394aee8efa9a-must-gather-output\") pod \"must-gather-k9p2j\" (UID: \"c7bed740-74e0-49bb-89cf-394aee8efa9a\") " pod="openshift-must-gather-jvlpb/must-gather-k9p2j"
Jul 02 15:05:30.231345 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:30.231317    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52tbt\" (UniqueName: \"kubernetes.io/projected/c7bed740-74e0-49bb-89cf-394aee8efa9a-kube-api-access-52tbt\") pod \"must-gather-k9p2j\" (UID: \"c7bed740-74e0-49bb-89cf-394aee8efa9a\") " pod="openshift-must-gather-jvlpb/must-gather-k9p2j"
Jul 02 15:05:30.231471 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:30.231369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7bed740-74e0-49bb-89cf-394aee8efa9a-must-gather-output\") pod \"must-gather-k9p2j\" (UID: \"c7bed740-74e0-49bb-89cf-394aee8efa9a\") " pod="openshift-must-gather-jvlpb/must-gather-k9p2j"
Jul 02 15:05:30.231724 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:30.231707    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7bed740-74e0-49bb-89cf-394aee8efa9a-must-gather-output\") pod \"must-gather-k9p2j\" (UID: \"c7bed740-74e0-49bb-89cf-394aee8efa9a\") " pod="openshift-must-gather-jvlpb/must-gather-k9p2j"
Jul 02 15:05:30.240305 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:30.240244    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52tbt\" (UniqueName: \"kubernetes.io/projected/c7bed740-74e0-49bb-89cf-394aee8efa9a-kube-api-access-52tbt\") pod \"must-gather-k9p2j\" (UID: \"c7bed740-74e0-49bb-89cf-394aee8efa9a\") " pod="openshift-must-gather-jvlpb/must-gather-k9p2j"
Jul 02 15:05:30.309509 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:30.309487    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jvlpb/must-gather-k9p2j"
Jul 02 15:05:30.433706 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:30.433685    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jvlpb/must-gather-k9p2j"]
Jul 02 15:05:30.436154 ip-10-0-143-132 kubenswrapper[2559]: W0702 15:05:30.436129    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7bed740_74e0_49bb_89cf_394aee8efa9a.slice/crio-1bd8bbf291acf052bd30f95ab355287b0029a729501d0390ad682bc1082d2136 WatchSource:0}: Error finding container 1bd8bbf291acf052bd30f95ab355287b0029a729501d0390ad682bc1082d2136: Status 404 returned error can't find the container with id 1bd8bbf291acf052bd30f95ab355287b0029a729501d0390ad682bc1082d2136
Jul 02 15:05:30.438100 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:30.438085    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 15:05:31.058239 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:31.058205    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jvlpb/must-gather-k9p2j" event={"ID":"c7bed740-74e0-49bb-89cf-394aee8efa9a","Type":"ContainerStarted","Data":"1bd8bbf291acf052bd30f95ab355287b0029a729501d0390ad682bc1082d2136"}
Jul 02 15:05:38.094323 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:38.094290    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jvlpb/must-gather-k9p2j" event={"ID":"c7bed740-74e0-49bb-89cf-394aee8efa9a","Type":"ContainerStarted","Data":"5f3f61517b552d282af62b0e09e106d3331d0200b604f19596c7031cd8f74d0e"}
Jul 02 15:05:38.094754 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:38.094336    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jvlpb/must-gather-k9p2j" event={"ID":"c7bed740-74e0-49bb-89cf-394aee8efa9a","Type":"ContainerStarted","Data":"257c971f677fb188dd067c7fffd07f45442d92de5e7a32242177e8a0872541df"}
Jul 02 15:05:38.126073 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:05:38.126029    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jvlpb/must-gather-k9p2j" podStartSLOduration=2.077356313 podStartE2EDuration="9.126014626s" totalImagesPullingTime="7.048658313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:05:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:05:38.124887798 +0000 UTC m=+2945.756780737" watchObservedRunningTime="2026-07-02 15:05:38.126014626 +0000 UTC m=+2945.757907563"
Jul 02 15:06:00.200866 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:00.200831    2559 generic.go:356] "Generic (PLEG): container finished" podID="c7bed740-74e0-49bb-89cf-394aee8efa9a" containerID="257c971f677fb188dd067c7fffd07f45442d92de5e7a32242177e8a0872541df" exitCode=0
Jul 02 15:06:00.201333 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:00.200908    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jvlpb/must-gather-k9p2j" event={"ID":"c7bed740-74e0-49bb-89cf-394aee8efa9a","Type":"ContainerDied","Data":"257c971f677fb188dd067c7fffd07f45442d92de5e7a32242177e8a0872541df"}
Jul 02 15:06:00.201333 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:00.201224    2559 scope.go:117] "RemoveContainer" containerID="257c971f677fb188dd067c7fffd07f45442d92de5e7a32242177e8a0872541df"
Jul 02 15:06:00.650247 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:00.650201    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jvlpb_must-gather-k9p2j_c7bed740-74e0-49bb-89cf-394aee8efa9a/gather/0.log"
Jul 02 15:06:01.298973 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.298930    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rvcf4/must-gather-w2bcs"]
Jul 02 15:06:01.302160 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.302143    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rvcf4/must-gather-w2bcs"
Jul 02 15:06:01.304845 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.304815    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rvcf4\"/\"openshift-service-ca.crt\""
Jul 02 15:06:01.304981 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.304871    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rvcf4\"/\"default-dockercfg-xczzd\""
Jul 02 15:06:01.304981 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.304916    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rvcf4\"/\"kube-root-ca.crt\""
Jul 02 15:06:01.311373 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.311348    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rvcf4/must-gather-w2bcs"]
Jul 02 15:06:01.400417 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.400374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq6mn\" (UniqueName: \"kubernetes.io/projected/636ff76d-3139-410a-a921-28a274dd2606-kube-api-access-dq6mn\") pod \"must-gather-w2bcs\" (UID: \"636ff76d-3139-410a-a921-28a274dd2606\") " pod="openshift-must-gather-rvcf4/must-gather-w2bcs"
Jul 02 15:06:01.400590 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.400452    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/636ff76d-3139-410a-a921-28a274dd2606-must-gather-output\") pod \"must-gather-w2bcs\" (UID: \"636ff76d-3139-410a-a921-28a274dd2606\") " pod="openshift-must-gather-rvcf4/must-gather-w2bcs"
Jul 02 15:06:01.501608 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.501555    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq6mn\" (UniqueName: \"kubernetes.io/projected/636ff76d-3139-410a-a921-28a274dd2606-kube-api-access-dq6mn\") pod \"must-gather-w2bcs\" (UID: \"636ff76d-3139-410a-a921-28a274dd2606\") " pod="openshift-must-gather-rvcf4/must-gather-w2bcs"
Jul 02 15:06:01.501836 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.501689    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/636ff76d-3139-410a-a921-28a274dd2606-must-gather-output\") pod \"must-gather-w2bcs\" (UID: \"636ff76d-3139-410a-a921-28a274dd2606\") " pod="openshift-must-gather-rvcf4/must-gather-w2bcs"
Jul 02 15:06:01.502020 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.502001    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/636ff76d-3139-410a-a921-28a274dd2606-must-gather-output\") pod \"must-gather-w2bcs\" (UID: \"636ff76d-3139-410a-a921-28a274dd2606\") " pod="openshift-must-gather-rvcf4/must-gather-w2bcs"
Jul 02 15:06:01.511167 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.511140    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq6mn\" (UniqueName: \"kubernetes.io/projected/636ff76d-3139-410a-a921-28a274dd2606-kube-api-access-dq6mn\") pod \"must-gather-w2bcs\" (UID: \"636ff76d-3139-410a-a921-28a274dd2606\") " pod="openshift-must-gather-rvcf4/must-gather-w2bcs"
Jul 02 15:06:01.611345 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.611261    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rvcf4/must-gather-w2bcs"
Jul 02 15:06:01.738889 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:01.738866    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rvcf4/must-gather-w2bcs"]
Jul 02 15:06:01.741108 ip-10-0-143-132 kubenswrapper[2559]: W0702 15:06:01.741081    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod636ff76d_3139_410a_a921_28a274dd2606.slice/crio-8064f0868c567ab2ba6e8e6d0539179960d72cabfc1f1007eb72d488acd3b467 WatchSource:0}: Error finding container 8064f0868c567ab2ba6e8e6d0539179960d72cabfc1f1007eb72d488acd3b467: Status 404 returned error can't find the container with id 8064f0868c567ab2ba6e8e6d0539179960d72cabfc1f1007eb72d488acd3b467
Jul 02 15:06:02.210408 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:02.210373    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rvcf4/must-gather-w2bcs" event={"ID":"636ff76d-3139-410a-a921-28a274dd2606","Type":"ContainerStarted","Data":"8064f0868c567ab2ba6e8e6d0539179960d72cabfc1f1007eb72d488acd3b467"}
Jul 02 15:06:04.223692 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:04.222976    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rvcf4/must-gather-w2bcs" event={"ID":"636ff76d-3139-410a-a921-28a274dd2606","Type":"ContainerStarted","Data":"b084fa3443e8d11830d74a07c47dd7f7e6913e4c92c95126d37bb647fbbd837c"}
Jul 02 15:06:04.223692 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:04.223026    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rvcf4/must-gather-w2bcs" event={"ID":"636ff76d-3139-410a-a921-28a274dd2606","Type":"ContainerStarted","Data":"c3d2d0a07f0fc7dbb10b1fa9c87e8bacfa7d14cdab33850a82edd23ce1ed9e7e"}
Jul 02 15:06:04.245178 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:04.245122    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rvcf4/must-gather-w2bcs" podStartSLOduration=1.460425833 podStartE2EDuration="3.245103102s" totalImagesPullingTime="1.784677269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:06:04.242878835 +0000 UTC m=+2971.874771775" watchObservedRunningTime="2026-07-02 15:06:04.245103102 +0000 UTC m=+2971.876996041"
Jul 02 15:06:05.216818 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:05.216786    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tntl5_618bf971-9ffc-4d84-9af2-649808bc68ba/global-pull-secret-syncer/0.log"
Jul 02 15:06:05.345422 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:05.345393    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-krchm_68fdd831-2e75-4b45-b31b-8870d38e0a04/konnectivity-agent/0.log"
Jul 02 15:06:05.477202 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:05.477131    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-132.ec2.internal_79f80ec7d4a5318d8f15f1326136326f/haproxy/0.log"
Jul 02 15:06:06.125119 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:06.125085    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-jvlpb/must-gather-k9p2j"]
Jul 02 15:06:06.125579 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:06.125546    2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-jvlpb/must-gather-k9p2j" podUID="c7bed740-74e0-49bb-89cf-394aee8efa9a" containerName="copy" containerID="cri-o://5f3f61517b552d282af62b0e09e106d3331d0200b604f19596c7031cd8f74d0e" gracePeriod=2
Jul 02 15:06:06.129805 ip-10-0-143-132 kubenswrapper[2559]: E0702 15:06:06.129772    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k9p2j\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jvlpb\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="c7bed740-74e0-49bb-89cf-394aee8efa9a" pod="openshift-must-gather-jvlpb/must-gather-k9p2j"
Jul 02 15:06:06.130144 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:06.130114    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-jvlpb/must-gather-k9p2j"]
Jul 02 15:06:06.386309 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:06.386288    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jvlpb_must-gather-k9p2j_c7bed740-74e0-49bb-89cf-394aee8efa9a/copy/0.log"
Jul 02 15:06:06.391708 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:06.391670    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jvlpb/must-gather-k9p2j"
Jul 02 15:06:06.394353 ip-10-0-143-132 kubenswrapper[2559]: E0702 15:06:06.394320    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-k9p2j\" is forbidden: User \"system:node:ip-10-0-143-132.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jvlpb\": no relationship found between node 'ip-10-0-143-132.ec2.internal' and this object" podUID="c7bed740-74e0-49bb-89cf-394aee8efa9a" pod="openshift-must-gather-jvlpb/must-gather-k9p2j"
Jul 02 15:06:06.446205 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:06.446166    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52tbt\" (UniqueName: \"kubernetes.io/projected/c7bed740-74e0-49bb-89cf-394aee8efa9a-kube-api-access-52tbt\") pod \"c7bed740-74e0-49bb-89cf-394aee8efa9a\" (UID: \"c7bed740-74e0-49bb-89cf-394aee8efa9a\") "
Jul 02 15:06:06.446387 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:06.446240    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7bed740-74e0-49bb-89cf-394aee8efa9a-must-gather-output\") pod \"c7bed740-74e0-49bb-89cf-394aee8efa9a\" (UID: \"c7bed740-74e0-49bb-89cf-394aee8efa9a\") "
Jul 02 15:06:06.448135 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:06.448100    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7bed740-74e0-49bb-89cf-394aee8efa9a-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "c7bed740-74e0-49bb-89cf-394aee8efa9a" (UID: "c7bed740-74e0-49bb-89cf-394aee8efa9a"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 15:06:06.451665 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:06.451200    2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7bed740-74e0-49bb-89cf-394aee8efa9a-kube-api-access-52tbt" (OuterVolumeSpecName: "kube-api-access-52tbt") pod "c7bed740-74e0-49bb-89cf-394aee8efa9a" (UID: "c7bed740-74e0-49bb-89cf-394aee8efa9a"). InnerVolumeSpecName "kube-api-access-52tbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 15:06:06.547675 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:06.547612    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52tbt\" (UniqueName: \"kubernetes.io/projected/c7bed740-74e0-49bb-89cf-394aee8efa9a-kube-api-access-52tbt\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 15:06:06.547675 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:06.547673    2559 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c7bed740-74e0-49bb-89cf-394aee8efa9a-must-gather-output\") on node \"ip-10-0-143-132.ec2.internal\" DevicePath \"\""
Jul 02 15:06:06.977670 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:06.977416    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7bed740-74e0-49bb-89cf-394aee8efa9a" path="/var/lib/kubelet/pods/c7bed740-74e0-49bb-89cf-394aee8efa9a/volumes"
Jul 02 15:06:07.244500 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:07.244418    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jvlpb_must-gather-k9p2j_c7bed740-74e0-49bb-89cf-394aee8efa9a/copy/0.log"
Jul 02 15:06:07.244929 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:07.244900    2559 generic.go:356] "Generic (PLEG): container finished" podID="c7bed740-74e0-49bb-89cf-394aee8efa9a" containerID="5f3f61517b552d282af62b0e09e106d3331d0200b604f19596c7031cd8f74d0e" exitCode=143
Jul 02 15:06:07.245069 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:07.245045    2559 scope.go:117] "RemoveContainer" containerID="5f3f61517b552d282af62b0e09e106d3331d0200b604f19596c7031cd8f74d0e"
Jul 02 15:06:07.245299 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:07.245284    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jvlpb/must-gather-k9p2j"
Jul 02 15:06:07.266239 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:07.266068    2559 scope.go:117] "RemoveContainer" containerID="257c971f677fb188dd067c7fffd07f45442d92de5e7a32242177e8a0872541df"
Jul 02 15:06:07.287425 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:07.287378    2559 scope.go:117] "RemoveContainer" containerID="5f3f61517b552d282af62b0e09e106d3331d0200b604f19596c7031cd8f74d0e"
Jul 02 15:06:07.289952 ip-10-0-143-132 kubenswrapper[2559]: E0702 15:06:07.289920    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f3f61517b552d282af62b0e09e106d3331d0200b604f19596c7031cd8f74d0e\": container with ID starting with 5f3f61517b552d282af62b0e09e106d3331d0200b604f19596c7031cd8f74d0e not found: ID does not exist" containerID="5f3f61517b552d282af62b0e09e106d3331d0200b604f19596c7031cd8f74d0e"
Jul 02 15:06:07.290080 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:07.289975    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f3f61517b552d282af62b0e09e106d3331d0200b604f19596c7031cd8f74d0e"} err="failed to get container status \"5f3f61517b552d282af62b0e09e106d3331d0200b604f19596c7031cd8f74d0e\": rpc error: code = NotFound desc = could not find container \"5f3f61517b552d282af62b0e09e106d3331d0200b604f19596c7031cd8f74d0e\": container with ID starting with 5f3f61517b552d282af62b0e09e106d3331d0200b604f19596c7031cd8f74d0e not found: ID does not exist"
Jul 02 15:06:07.290080 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:07.290002    2559 scope.go:117] "RemoveContainer" containerID="257c971f677fb188dd067c7fffd07f45442d92de5e7a32242177e8a0872541df"
Jul 02 15:06:07.290428 ip-10-0-143-132 kubenswrapper[2559]: E0702 15:06:07.290387    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"257c971f677fb188dd067c7fffd07f45442d92de5e7a32242177e8a0872541df\": container with ID starting with 257c971f677fb188dd067c7fffd07f45442d92de5e7a32242177e8a0872541df not found: ID does not exist" containerID="257c971f677fb188dd067c7fffd07f45442d92de5e7a32242177e8a0872541df"
Jul 02 15:06:07.290511 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:07.290436    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"257c971f677fb188dd067c7fffd07f45442d92de5e7a32242177e8a0872541df"} err="failed to get container status \"257c971f677fb188dd067c7fffd07f45442d92de5e7a32242177e8a0872541df\": rpc error: code = NotFound desc = could not find container \"257c971f677fb188dd067c7fffd07f45442d92de5e7a32242177e8a0872541df\": container with ID starting with 257c971f677fb188dd067c7fffd07f45442d92de5e7a32242177e8a0872541df not found: ID does not exist"
Jul 02 15:06:09.011964 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.011937    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e53dbba-4171-4783-b27d-acfde6034572/alertmanager/0.log"
Jul 02 15:06:09.059128 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.059104    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e53dbba-4171-4783-b27d-acfde6034572/config-reloader/0.log"
Jul 02 15:06:09.085106 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.085073    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e53dbba-4171-4783-b27d-acfde6034572/kube-rbac-proxy-web/0.log"
Jul 02 15:06:09.112574 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.112544    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e53dbba-4171-4783-b27d-acfde6034572/kube-rbac-proxy/0.log"
Jul 02 15:06:09.140932 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.140854    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e53dbba-4171-4783-b27d-acfde6034572/kube-rbac-proxy-metric/0.log"
Jul 02 15:06:09.167955 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.167768    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e53dbba-4171-4783-b27d-acfde6034572/prom-label-proxy/0.log"
Jul 02 15:06:09.199825 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.199726    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e53dbba-4171-4783-b27d-acfde6034572/init-config-reloader/0.log"
Jul 02 15:06:09.307820 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.307792    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-gqx4g_1c174ed2-b798-4b00-a1f1-343f50ed01af/kube-state-metrics/0.log"
Jul 02 15:06:09.329601 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.329577    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-gqx4g_1c174ed2-b798-4b00-a1f1-343f50ed01af/kube-rbac-proxy-main/0.log"
Jul 02 15:06:09.354242 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.354215    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-gqx4g_1c174ed2-b798-4b00-a1f1-343f50ed01af/kube-rbac-proxy-self/0.log"
Jul 02 15:06:09.389509 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.389480    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6fc9cc7f56-5wstk_6dcad3e6-c885-4c41-9a76-4f66f5a8d86e/metrics-server/0.log"
Jul 02 15:06:09.413986 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.413923    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-48wjj_9f92a766-d214-4289-afed-f7792247c762/monitoring-plugin/0.log"
Jul 02 15:06:09.445881 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.445857    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kdsf4_11ee1987-424e-4880-bdeb-3ea527359cdf/node-exporter/0.log"
Jul 02 15:06:09.468508 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.468477    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kdsf4_11ee1987-424e-4880-bdeb-3ea527359cdf/kube-rbac-proxy/0.log"
Jul 02 15:06:09.489885 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.489780    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kdsf4_11ee1987-424e-4880-bdeb-3ea527359cdf/init-textfile/0.log"
Jul 02 15:06:09.763233 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.763206    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-6h8cs_cfb88d99-96c3-4bbb-b289-e9709e170871/kube-rbac-proxy-main/0.log"
Jul 02 15:06:09.792471 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.792447    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-6h8cs_cfb88d99-96c3-4bbb-b289-e9709e170871/kube-rbac-proxy-self/0.log"
Jul 02 15:06:09.815144 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.815109    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-6h8cs_cfb88d99-96c3-4bbb-b289-e9709e170871/openshift-state-metrics/0.log"
Jul 02 15:06:09.865447 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.865422    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3da50a58-ffc4-497d-86a9-49fe03aa0717/prometheus/0.log"
Jul 02 15:06:09.881967 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.881942    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3da50a58-ffc4-497d-86a9-49fe03aa0717/config-reloader/0.log"
Jul 02 15:06:09.904494 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.904471    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3da50a58-ffc4-497d-86a9-49fe03aa0717/thanos-sidecar/0.log"
Jul 02 15:06:09.931487 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.931461    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3da50a58-ffc4-497d-86a9-49fe03aa0717/kube-rbac-proxy-web/0.log"
Jul 02 15:06:09.956062 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.956031    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3da50a58-ffc4-497d-86a9-49fe03aa0717/kube-rbac-proxy/0.log"
Jul 02 15:06:09.980821 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:09.980787    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3da50a58-ffc4-497d-86a9-49fe03aa0717/kube-rbac-proxy-thanos/0.log"
Jul 02 15:06:10.003689 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:10.003665    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3da50a58-ffc4-497d-86a9-49fe03aa0717/init-config-reloader/0.log"
Jul 02 15:06:10.034373 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:10.034297    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-tcqdx_725bcafe-656f-432a-bd82-e18f9ec6fa85/prometheus-operator/0.log"
Jul 02 15:06:10.052898 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:10.052872    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-tcqdx_725bcafe-656f-432a-bd82-e18f9ec6fa85/kube-rbac-proxy/0.log"
Jul 02 15:06:10.082588 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:10.082561    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-mkm2p_e29b482f-51dc-4297-9948-88f0419d05df/prometheus-operator-admission-webhook/0.log"
Jul 02 15:06:10.118078 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:10.118015    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6698899469-rvmmw_221f24de-5723-4f15-a9dc-f3558f8cf1b0/telemeter-client/0.log"
Jul 02 15:06:10.141961 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:10.141929    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6698899469-rvmmw_221f24de-5723-4f15-a9dc-f3558f8cf1b0/reload/0.log"
Jul 02 15:06:10.164453 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:10.164430    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6698899469-rvmmw_221f24de-5723-4f15-a9dc-f3558f8cf1b0/kube-rbac-proxy/0.log"
Jul 02 15:06:10.202474 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:10.202444    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5594996499-9gsrj_2bcb328b-5d5a-48ee-84da-35fcaa205906/thanos-query/0.log"
Jul 02 15:06:10.227828 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:10.227801    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5594996499-9gsrj_2bcb328b-5d5a-48ee-84da-35fcaa205906/kube-rbac-proxy-web/0.log"
Jul 02 15:06:10.251285 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:10.251262    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5594996499-9gsrj_2bcb328b-5d5a-48ee-84da-35fcaa205906/kube-rbac-proxy/0.log"
Jul 02 15:06:10.272367 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:10.272331    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5594996499-9gsrj_2bcb328b-5d5a-48ee-84da-35fcaa205906/prom-label-proxy/0.log"
Jul 02 15:06:10.297016 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:10.296953    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5594996499-9gsrj_2bcb328b-5d5a-48ee-84da-35fcaa205906/kube-rbac-proxy-rules/0.log"
Jul 02 15:06:10.318984 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:10.318960    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5594996499-9gsrj_2bcb328b-5d5a-48ee-84da-35fcaa205906/kube-rbac-proxy-metrics/0.log"
Jul 02 15:06:11.741402 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:11.741364    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-cngdl_92ecf3c6-5716-4153-b81e-9ed91c847c4a/networking-console-plugin/0.log"
Jul 02 15:06:13.886186 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:13.886141    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"]
Jul 02 15:06:13.886788 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:13.886681    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7bed740-74e0-49bb-89cf-394aee8efa9a" containerName="copy"
Jul 02 15:06:13.886788 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:13.886698    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7bed740-74e0-49bb-89cf-394aee8efa9a" containerName="copy"
Jul 02 15:06:13.886788 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:13.886712    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7bed740-74e0-49bb-89cf-394aee8efa9a" containerName="gather"
Jul 02 15:06:13.886788 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:13.886721    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7bed740-74e0-49bb-89cf-394aee8efa9a" containerName="gather"
Jul 02 15:06:13.887034 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:13.886825    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7bed740-74e0-49bb-89cf-394aee8efa9a" containerName="gather"
Jul 02 15:06:13.887034 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:13.886839    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7bed740-74e0-49bb-89cf-394aee8efa9a" containerName="copy"
Jul 02 15:06:13.892051 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:13.892029    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:13.913352 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:13.913320    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"]
Jul 02 15:06:14.030424 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.030392    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-sys\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.030612 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.030525    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-proc\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.030698 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.030638    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-podres\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.030765 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.030742    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pwbp\" (UniqueName: \"kubernetes.io/projected/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-kube-api-access-4pwbp\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.030820 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.030776    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-lib-modules\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.131561 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.131532    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pwbp\" (UniqueName: \"kubernetes.io/projected/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-kube-api-access-4pwbp\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.131762 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.131566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-lib-modules\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.131762 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.131608    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-sys\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.131762 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.131627    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-proc\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.131762 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.131676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-podres\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.131762 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.131748    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-proc\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.131963 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.131746    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-sys\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.131963 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.131789    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-lib-modules\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.131963 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.131813    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-podres\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.151627 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.151572    2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pwbp\" (UniqueName: \"kubernetes.io/projected/5557dcc8-087f-4d1a-ae63-ef41ed7a10f8-kube-api-access-4pwbp\") pod \"perf-node-gather-daemonset-cbrdm\" (UID: \"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8\") " pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.203378 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.203340    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:14.376023 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.376000    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"]
Jul 02 15:06:14.536994 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.536964    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sw4qm_fdd69d65-f10f-4a67-b47b-a9fb75528349/dns/0.log"
Jul 02 15:06:14.557614 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.557590    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sw4qm_fdd69d65-f10f-4a67-b47b-a9fb75528349/kube-rbac-proxy/0.log"
Jul 02 15:06:14.666324 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:14.666230    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qz97f_77425abb-cd5c-4da3-87bf-e267d052a799/dns-node-resolver/0.log"
Jul 02 15:06:15.285107 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:15.285080    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t7jl4_bb27d825-0583-4db1-8bee-109bbea38bdf/node-ca/0.log"
Jul 02 15:06:15.315503 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:15.315465    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm" event={"ID":"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8","Type":"ContainerStarted","Data":"a203a20a3333d7227f816d4eb6a07f92d3ff9bf0cacab73020b8ba2037cbbfc1"}
Jul 02 15:06:15.315713 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:15.315530    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm" event={"ID":"5557dcc8-087f-4d1a-ae63-ef41ed7a10f8","Type":"ContainerStarted","Data":"cbcf24a816ac1a9f9cfcb9ccacceb1d7be360e77ff2e6f6bae250de87d8bf1b0"}
Jul 02 15:06:15.316108 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:15.316084    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:15.337141 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:15.337087    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm" podStartSLOduration=2.337059995 podStartE2EDuration="2.337059995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:06:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:06:15.334148047 +0000 UTC m=+2982.966041009" watchObservedRunningTime="2026-07-02 15:06:15.337059995 +0000 UTC m=+2982.968952936"
Jul 02 15:06:16.086880 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:16.086852    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6ff7f5b667-967lx_ba8732ec-3fe5-49af-86e1-e98bf2da100d/router/0.log"
Jul 02 15:06:16.431784 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:16.431710    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5zfzw_a9e3c620-4554-4c19-aed2-8bee0a571bcc/serve-healthcheck-canary/0.log"
Jul 02 15:06:16.876596 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:16.876566    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmcqq_06fa0dba-ee3e-448e-90a0-130b0a6148d4/kube-rbac-proxy/0.log"
Jul 02 15:06:16.897173 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:16.897147    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmcqq_06fa0dba-ee3e-448e-90a0-130b0a6148d4/exporter/0.log"
Jul 02 15:06:16.917962 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:16.917922    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bmcqq_06fa0dba-ee3e-448e-90a0-130b0a6148d4/extractor/0.log"
Jul 02 15:06:19.392521 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:19.392492    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-j2pt8_3ef41d75-1911-4d3a-bd2f-a1b089a487b4/s3-init/0.log"
Jul 02 15:06:19.407166 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:19.407146    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-j2pt8_3ef41d75-1911-4d3a-bd2f-a1b089a487b4/download-hf-model/0.log"
Jul 02 15:06:21.333279 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:21.333248    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rvcf4/perf-node-gather-daemonset-cbrdm"
Jul 02 15:06:24.862572 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:24.862544    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6wbj8_d710f0f3-f1db-4002-8898-32316b2800a7/kube-multus/0.log"
Jul 02 15:06:25.268415 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:25.268388    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9zn6_53260520-d418-4c07-95c7-d9f3fcf10acb/kube-multus-additional-cni-plugins/0.log"
Jul 02 15:06:25.290072 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:25.290050    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9zn6_53260520-d418-4c07-95c7-d9f3fcf10acb/egress-router-binary-copy/0.log"
Jul 02 15:06:25.311366 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:25.311343    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9zn6_53260520-d418-4c07-95c7-d9f3fcf10acb/cni-plugins/0.log"
Jul 02 15:06:25.334156 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:25.334134    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9zn6_53260520-d418-4c07-95c7-d9f3fcf10acb/bond-cni-plugin/0.log"
Jul 02 15:06:25.355023 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:25.354969    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9zn6_53260520-d418-4c07-95c7-d9f3fcf10acb/routeoverride-cni/0.log"
Jul 02 15:06:25.379258 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:25.379235    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9zn6_53260520-d418-4c07-95c7-d9f3fcf10acb/whereabouts-cni-bincopy/0.log"
Jul 02 15:06:25.401145 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:25.401127    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9zn6_53260520-d418-4c07-95c7-d9f3fcf10acb/whereabouts-cni/0.log"
Jul 02 15:06:25.572228 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:25.572190    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xg2xd_84655b87-ce0c-4c23-afd6-51d4f4d06657/network-metrics-daemon/0.log"
Jul 02 15:06:25.591184 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:25.591161    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xg2xd_84655b87-ce0c-4c23-afd6-51d4f4d06657/kube-rbac-proxy/0.log"
Jul 02 15:06:26.908911 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:26.908887    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zphb6_d1984103-28cc-405c-b309-308d0d8fe702/ovn-controller/0.log"
Jul 02 15:06:26.926245 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:26.926225    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zphb6_d1984103-28cc-405c-b309-308d0d8fe702/ovn-acl-logging/0.log"
Jul 02 15:06:26.951726 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:26.951702    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zphb6_d1984103-28cc-405c-b309-308d0d8fe702/kube-rbac-proxy-node/0.log"
Jul 02 15:06:26.972305 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:26.972271    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zphb6_d1984103-28cc-405c-b309-308d0d8fe702/kube-rbac-proxy-ovn-metrics/0.log"
Jul 02 15:06:26.989812 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:26.989791    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zphb6_d1984103-28cc-405c-b309-308d0d8fe702/northd/0.log"
Jul 02 15:06:27.014578 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:27.014547    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zphb6_d1984103-28cc-405c-b309-308d0d8fe702/nbdb/0.log"
Jul 02 15:06:27.035149 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:27.035126    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zphb6_d1984103-28cc-405c-b309-308d0d8fe702/sbdb/0.log"
Jul 02 15:06:27.079829 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:27.079810    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zphb6_d1984103-28cc-405c-b309-308d0d8fe702/ovnkube-controller/0.log"
Jul 02 15:06:28.165357 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:28.165326    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vmzd7_e00643be-d291-4d9d-b372-28467da96c08/network-check-target-container/0.log"
Jul 02 15:06:29.179100 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:29.179078    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7mf5d_18d6169d-69ba-422f-8da3-d081a07435cf/iptables-alerter/0.log"
Jul 02 15:06:29.966321 ip-10-0-143-132 kubenswrapper[2559]: I0702 15:06:29.966296    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-trqf6_cd989d3d-cdd0-4e60-b965-9e3e2783d358/tuned/0.log"