Jul 10 22:40:57.620828 ip-10-0-130-215 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 10 22:40:57.620840 ip-10-0-130-215 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 10 22:40:57.620849 ip-10-0-130-215 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 10 22:40:57.621172 ip-10-0-130-215 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 10 22:41:07.735541 ip-10-0-130-215 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 10 22:41:07.735562 ip-10-0-130-215 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 95d099e7cab34ce0a6fbe60f336a4e09 --
Jul 10 22:42:59.161392 ip-10-0-130-215 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 22:42:59.552721 ip-10-0-130-215 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 22:42:59.552721 ip-10-0-130-215 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 22:42:59.552721 ip-10-0-130-215 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 22:42:59.552721 ip-10-0-130-215 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 22:42:59.552721 ip-10-0-130-215 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 22:42:59.553440 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.552780    2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 22:42:59.558504 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558481    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 22:42:59.558504 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558502    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 22:42:59.558504 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558507    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558510    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558514    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558517    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558520    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558523    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558526    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558528    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558531    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558534    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558536    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558539    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558542    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558544    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558547    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558550    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558552    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558555    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558560    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 22:42:59.558602 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558564    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558568    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558572    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558576    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558579    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558590    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558592    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558595    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558597    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558600    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558603    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558606    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558609    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558612    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558615    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558617    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558620    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558623    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558625    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 22:42:59.559051 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558628    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558630    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558633    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558635    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558637    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558640    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558642    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558645    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558648    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558651    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558654    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558657    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558659    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558662    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558664    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558667    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558670    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558672    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558675    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558677    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 22:42:59.559534 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558680    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558683    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558685    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558692    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558695    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558698    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558700    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558703    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558705    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558708    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558710    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558712    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558715    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558718    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558722    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558725    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558729    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558734    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558737    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 22:42:59.559997 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558740    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558743    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558746    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558748    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558752    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558754    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558758    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558760    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558763    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558766    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558769    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558771    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558774    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558776    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558779    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558782    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558785    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558787    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558790    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.558792    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 22:42:59.560476 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559561    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559568    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559572    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559575    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559578    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559580    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559583    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559586    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559588    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559593    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559597    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559601    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559604    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559607    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559610    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559613    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559617    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559620    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559623    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 22:42:59.560968 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559626    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559630    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559633    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559636    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559639    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559642    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559645    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559647    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559650    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559652    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559655    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559658    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559660    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559662    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559665    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559667    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559670    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559672    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559675    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559677    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 22:42:59.561482 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559680    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559682    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559685    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559687    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559689    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559692    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559695    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559698    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559700    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559704    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559708    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559712    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559715    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559718    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559721    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559724    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559726    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559729    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559732    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559734    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 22:42:59.561980 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559737    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559740    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559742    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559745    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559748    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559750    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559753    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559756    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559758    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559761    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559764    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559768    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559771    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559774    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559776    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559779    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559782    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559784    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559788    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 22:42:59.562488 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559791    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559793    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559796    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559798    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559801    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559803    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559808    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559810    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559813    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559815    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559818    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559820    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559823    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559825    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559827    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559830    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559832    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559835    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559837    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559840    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 22:42:59.562951 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.559842    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560252    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560259    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560263    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560266    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560269    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560272    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560275    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560278    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560280    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560283    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560286    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560289    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560292    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560295    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560298    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560300    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560303    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560306    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 22:42:59.563446 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560309    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560312    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560315    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560317    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560320    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560323    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560325    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560328    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560330    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560333    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560336    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560340    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560343    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560347    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560350    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560353    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560356    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560360    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560364    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 22:42:59.563890 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560366    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560369    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560372    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560375    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560378    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560381    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560384    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560387    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560389    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560392    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560394    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560397    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560399    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560402    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560405    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560407    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560410    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560412    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560415    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 22:42:59.564368 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560417    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560420    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560423    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560426    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560428    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560432    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560434    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560437    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560439    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560442    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560444    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560447    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560449    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560451    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560454    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560456    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560459    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560465    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560468    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560470    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 22:42:59.564834 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560473    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560476    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560479    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560482    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560485    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560487    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560490    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560493    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560495    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560498    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560500    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560503    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560505    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560509    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560512    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560535    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560538    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560542    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560544    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560547    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 22:42:59.565337 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560550    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560552    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.560555    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560634    2566 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560644    2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560651    2566 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560655    2566 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560659    2566 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560663    2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560669    2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560678    2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560681    2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560684    2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560689    2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560692    2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560695    2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560698    2566 flags.go:64] FLAG: --cgroup-root=""
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560702    2566 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560705    2566 flags.go:64] FLAG: --client-ca-file=""
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560708    2566 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560711    2566 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560715    2566 flags.go:64] FLAG: --cluster-domain=""
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560718    2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560721    2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 22:42:59.565814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560724    2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560728    2566 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560731    2566 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560734    2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560738    2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560741    2566 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560744    2566 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560747    2566 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560750    2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560753    2566 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560756    2566 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560760    2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560764    2566 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560766    2566 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560769    2566 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560772    2566 flags.go:64] FLAG: --enable-server="true"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560775    2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560782    2566 flags.go:64] FLAG: --event-burst="100"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560785    2566 flags.go:64] FLAG: --event-qps="50"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560788    2566 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560791    2566 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560794    2566 flags.go:64] FLAG: --eviction-hard=""
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560799    2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560802    2566 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560805    2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 22:42:59.566393 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560808    2566 flags.go:64] FLAG: --eviction-soft=""
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560811    2566 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560814    2566 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560817    2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560819    2566 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560822    2566 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560825    2566 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560830    2566 flags.go:64] FLAG: --feature-gates=""
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560834    2566 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560837    2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560840    2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560843    2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560846    2566 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560849    2566 flags.go:64] FLAG: --help="false"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560852    2566 flags.go:64] FLAG: --hostname-override="ip-10-0-130-215.ec2.internal"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560855    2566 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560858    2566 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560861    2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560864    2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560868    2566 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560871    2566 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560874    2566 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560877    2566 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 22:42:59.567035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560880    2566 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560884    2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560888    2566 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560891    2566 flags.go:64] FLAG: --kube-reserved=""
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560894    2566 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560897    2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560900    2566 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560903    2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560906    2566 flags.go:64] FLAG: --lock-file=""
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560909    2566 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560912    2566 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560915    2566 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560920    2566 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560922    2566 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560925    2566 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560928    2566 flags.go:64] FLAG: --logging-format="text"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560932    2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560936    2566 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560939    2566 flags.go:64] FLAG: --manifest-url=""
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560943    2566 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560947    2566 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560950    2566 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560954    2566 flags.go:64] FLAG: --max-pods="110"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560957    2566 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560960    2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 22:42:59.567632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560963    2566 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560966    2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560969    2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560972    2566 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560975    2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560982    2566 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560986    2566 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560989    2566 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560992    2566 flags.go:64] FLAG: --pod-cidr=""
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.560995    2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561001    2566 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561004    2566 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561008    2566 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561011    2566 flags.go:64] FLAG: --port="10250"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561014    2566 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561017    2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06f3ca9257902448c"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561020    2566 flags.go:64] FLAG: --qos-reserved=""
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561023    2566 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561026    2566 flags.go:64] FLAG: --register-node="true"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561029    2566 flags.go:64] FLAG: --register-with-taints=""
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561033    2566 flags.go:64] FLAG: --registry-burst="10"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561036    2566 flags.go:64] FLAG: --registry-qps="5"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561039    2566 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561042    2566 flags.go:64] FLAG: --reserved-memory=""
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561046    2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 22:42:59.568607 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561049    2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561052    2566 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561054    2566 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561057    2566 flags.go:64] FLAG: --runonce="false"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561060    2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561063    2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561066    2566 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561069    2566 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561072    2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561075    2566 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561078    2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561081    2566 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561099    2566 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561102    2566 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561105    2566 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561108    2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561111    2566 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561114    2566 flags.go:64] FLAG: --system-cgroups=""
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561117    2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561123    2566 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561126    2566 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561129    2566 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561133    2566 flags.go:64] FLAG: --tls-min-version=""
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561137    2566 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561139    2566 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 22:42:59.569669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561142    2566 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561146    2566 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561148    2566 flags.go:64] FLAG: --v="2"
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561152    2566 flags.go:64] FLAG: --version="false"
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561157    2566 flags.go:64] FLAG: --vmodule=""
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561160    2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.561164    2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561284    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561288    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561291    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561294    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561297    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561299    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561302    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561305    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561307    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561310    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561313    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561316    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561318    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561321    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 22:42:59.570753 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561323    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561326    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561329    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561331    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561334    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561337    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561339    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561342    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561344    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561347    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561353    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561356    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561358    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561361    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561363    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561366    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561368    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561371    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561373    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561376    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 22:42:59.571656 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561378    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561381    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561383    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561386    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561388    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561391    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561393    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561396    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561398    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561401    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561404    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561406    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561410    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561414    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561417    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561420    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561422    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561425    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561427    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 22:42:59.572306 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561430    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561433    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561435    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561437    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561441    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561443    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561446    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561448    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561451    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561454    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561456    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561459    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561461    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561464    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561466    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561470    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561474    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561478    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561481    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 22:42:59.573082 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561484    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561487    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561490    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561493    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561497    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561500    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561503    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561506    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561508    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561511    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561514    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561516    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561519    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561521    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561524    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561526    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561529    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561531    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561534    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561537    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 22:42:59.573858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561539    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561542    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561547    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561549    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561552    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561554    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.561557    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.562208    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.570169    2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.570198    2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.570224    2566 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.570234    2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570320    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570331    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570338    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 22:42:59.574435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570343    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570349    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570353    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570358    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570363    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570367    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570372    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570377    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570381    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570386    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570390    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570394    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570399    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570403    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570408    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570412    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570415    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570420    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570424    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570429    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 22:42:59.574878 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570433    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570440    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570446    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570451    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570456    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570461    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570467    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570472    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570476    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570481    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570486    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570490    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570494    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570499    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570503    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570507    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570511    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570516    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570520    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 22:42:59.575418 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570524    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570529    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570533    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570537    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570541    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570546    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570550    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570554    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570558    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570562    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570566    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570571    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570575    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570580    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570584    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570588    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570593    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570597    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570601    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 22:42:59.575930 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570609    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570615    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570620    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570625    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570630    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570635    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570640    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570644    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570649    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570653    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570657    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570660    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570664    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570669    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570673    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570677    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570681    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570685    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570690    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570694    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 22:42:59.576435 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570698    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570702    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570706    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570710    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570715    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570720    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570724    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570728    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570733    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570738    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570742    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570746    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570751    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570755    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570761    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570765    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570770    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 22:42:59.577057 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570776    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.570785    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570977    2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570988    2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570993    2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.570998    2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571003    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571007    2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571011    2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571015    2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571019    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571023    2566 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571027    2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571032    2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571037    2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 22:42:59.577614 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571041    2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571046    2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571050    2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571054    2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571058    2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571063    2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571067    2566 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571072    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571076    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571080    2566 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571103    2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571108    2566 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571112    2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571117    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571121    2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571126    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571131    2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571135    2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571139    2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571144    2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 22:42:59.578148 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571148    2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571152    2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571156    2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571159    2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571164    2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571169    2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571173    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571177    2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571181    2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571185    2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571189    2566 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571193    2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571198    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571202    2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571207    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571212    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571216    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571222    2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571226    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571230    2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 22:42:59.578673 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571234    2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571239    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571243    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571247    2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571254    2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571262    2566 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571266    2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571271    2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571276    2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571281    2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571285    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571290    2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571295    2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571301    2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571305    2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571309    2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571313    2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571318    2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571322    2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 22:42:59.579232 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571327    2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571332    2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571338    2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571344    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571349    2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571353    2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571358    2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571362    2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571367    2566 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571371    2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571376    2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571380    2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571385    2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571389    2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571393    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571397    2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571402    2566 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571406    2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571410    2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 22:42:59.579963 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571414    2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 22:42:59.580592 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571418    2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 22:42:59.580592 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571423    2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 22:42:59.580592 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571428    2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 22:42:59.580592 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571432    2566 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 22:42:59.580592 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571436    2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 22:42:59.580592 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571440    2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 22:42:59.580592 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:42:59.571444    2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 22:42:59.580592 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.571453    2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 22:42:59.580592 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.571661    2566 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 22:42:59.580592 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.574376    2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 22:42:59.580592 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.575681    2566 server.go:1019] "Starting client certificate rotation"
Jul 10 22:42:59.580592 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.575782    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 22:42:59.580592 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.575820    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 22:42:59.581506 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.581475    2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 22:42:59.584407 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.584387    2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 22:42:59.597511 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.597492    2566 log.go:25] "Validated CRI v1 runtime API"
Jul 10 22:42:59.599421 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.599406    2566 log.go:25] "Validated CRI v1 image API"
Jul 10 22:42:59.600183 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.600166    2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 22:42:59.602593 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.602573    2566 fs.go:135] Filesystem UUIDs: map[159d5a7d-c3c6-4351-9f0d-1db1888933d9:/dev/nvme0n1p3 315df632-8e7b-48c3-91af-35375b81408f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 10 22:42:59.602653 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.602593    2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 22:42:59.606312 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.606293    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 22:42:59.609591 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.609476    2566 manager.go:216] Machine: {Timestamp:2026-07-10 22:42:59.608220327 +0000 UTC m=+0.331254298 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100069 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e21ad1b4a0849592a6655b324607e SystemUUID:ec2e21ad-1b4a-0849-592a-6655b324607e BootID:95d099e7-cab3-4ce0-a6fb-e60f336a4e09 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:c8:f3:78:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:c8:f3:78:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:1f:33:05:ce:cc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 22:42:59.609591 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.609590    2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 22:42:59.609708 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.609676    2566 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 22:42:59.613137 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.613075    2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 22:42:59.613291 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.613144    2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-215.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 22:42:59.613923 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.613909    2566 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 22:42:59.613955 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.613925    2566 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 22:42:59.613955 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.613933    2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 22:42:59.614536 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.614525    2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 22:42:59.615276 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:42:59.615265    2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 22:43:00.647562 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.647476    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 22:43:00.647620 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.647608    2566 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 22:43:00.647661 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.647647    2566 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 22:43:00.647702 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.647662    2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 22:43:00.647702 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.647688    2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 22:43:00.647702 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.647703    2566 kubelet.go:398] "Adding apiserver pod source"
Jul 10 22:43:00.647834 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.647715    2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 22:43:00.648135 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.648122    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 22:43:00.648188 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.648146    2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 22:43:00.652028 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.651991    2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 22:43:00.653362 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.653345    2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 22:43:00.653414 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.653378    2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 22:43:00.653948 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.653936    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 22:43:00.653992 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.653952    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 22:43:00.653992 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.653958    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 22:43:00.653992 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.653963    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 22:43:00.653992 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.653971    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 22:43:00.653992 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.653978    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 22:43:00.654134 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.654057    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 22:43:00.654134 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.654063    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 22:43:00.654134 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.654071    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 22:43:00.654134 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.654076    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 22:43:00.654134 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.654085    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 22:43:00.654134 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.654092    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 22:43:00.654976 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.654965    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 22:43:00.655008 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.654977    2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 22:43:00.657633 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.657610    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rcw84"
Jul 10 22:43:00.658385 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.658365    2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-215.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 22:43:00.658665 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.658654    2566 server.go:1268] "Started kubelet"
Jul 10 22:43:00.658887 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.658845    2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 22:43:00.658949 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.658878    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 22:43:00.658949 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.658913    2566 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 22:43:00.659046 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.658951    2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 22:43:00.659046 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.659012    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 22:43:00.659635 ip-10-0-130-215 systemd[1]: Started Kubernetes Kubelet.
Jul 10 22:43:00.659991 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.659974    2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 22:43:00.661315 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.661299    2566 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 22:43:00.664087 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.663112    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-215.ec2.internal.18c10ef6d1b7634a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-215.ec2.internal,UID:ip-10-0-130-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-215.ec2.internal,},FirstTimestamp:2026-07-10 22:43:00.658627402 +0000 UTC m=+0.351985669,LastTimestamp:2026-07-10 22:43:00.658627402 +0000 UTC m=+0.351985669,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-215.ec2.internal,}"
Jul 10 22:43:00.664215 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.664198    2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 22:43:00.664873 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.664827    2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 22:43:00.664873 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.664842    2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 22:43:00.664995 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.664877    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rcw84"
Jul 10 22:43:00.665232 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.665207    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:00.665754 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.665731    2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 22:43:00.665754 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.665733    2566 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 22:43:00.665754 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.665758    2566 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 22:43:00.665947 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.665849    2566 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 22:43:00.665947 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.665860    2566 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 22:43:00.666346 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.666321    2566 factory.go:55] Registering systemd factory
Jul 10 22:43:00.666346 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.666338    2566 factory.go:223] Registration of the systemd container factory successfully
Jul 10 22:43:00.666567 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.666554    2566 factory.go:153] Registering CRI-O factory
Jul 10 22:43:00.666567 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.666568    2566 factory.go:223] Registration of the crio container factory successfully
Jul 10 22:43:00.666694 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.666619    2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 22:43:00.666694 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.666643    2566 factory.go:103] Registering Raw factory
Jul 10 22:43:00.666694 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.666654    2566 manager.go:1196] Started watching for new ooms in manager
Jul 10 22:43:00.667350 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.667337    2566 manager.go:349] Starting recovery of all containers
Jul 10 22:43:00.672812 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.672758    2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 22:43:00.672934 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.672893    2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 22:43:00.679254 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.679231    2566 manager.go:354] Recovery completed
Jul 10 22:43:00.683536 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.683524    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:43:00.686144 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.686123    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:43:00.686213 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.686160    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:43:00.686213 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.686175    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:43:00.686754 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.686734    2566 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 22:43:00.686754 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.686748    2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 22:43:00.686911 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.686779    2566 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 22:43:00.686911 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.686796    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:43:00.687544 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.687530    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:43:00.687610 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.687558    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:43:00.687610 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.687573    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:43:00.687755 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.687741    2566 policy_none.go:49] "None policy: Start"
Jul 10 22:43:00.687875 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.687827    2566 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 22:43:00.687875 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.687845    2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 22:43:00.688538 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.688357    2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-215.ec2.internal.18c10ef6d35b3c11  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-215.ec2.internal,UID:ip-10-0-130-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-215.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-215.ec2.internal,},FirstTimestamp:2026-07-10 22:43:00.686142481 +0000 UTC m=+0.379500748,LastTimestamp:2026-07-10 22:43:00.686142481 +0000 UTC m=+0.379500748,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-215.ec2.internal,}"
Jul 10 22:43:00.688651 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.688639    2566 policy_none.go:47] "Start"
Jul 10 22:43:00.720408 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.720388    2566 manager.go:337] "Starting Device Plugin manager"
Jul 10 22:43:00.720529 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.720440    2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 22:43:00.720529 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.720454    2566 server.go:87] "Starting device plugin registration server"
Jul 10 22:43:00.720821 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.720806    2566 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 22:43:00.720888 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.720844    2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 22:43:00.720997 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.720923    2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 22:43:00.721057 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.721012    2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 22:43:00.721057 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.721026    2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 22:43:00.721688 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.721668    2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 22:43:00.721793 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.721729    2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:00.795435 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.795398    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 22:43:00.796574 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.796557    2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 22:43:00.796621 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.796610    2566 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 22:43:00.796653 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.796640    2566 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 22:43:00.796715 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.796684    2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 22:43:00.799207 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.799189    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 22:43:00.821372 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.821347    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:43:00.822589 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.822572    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:43:00.822647 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.822603    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:43:00.822647 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.822616    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:43:00.822647 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.822640    2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-215.ec2.internal"
Jul 10 22:43:00.830566 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.830548    2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-215.ec2.internal"
Jul 10 22:43:00.830625 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.830578    2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-215.ec2.internal\": node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:00.847259 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.847156    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:00.896844 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.896802    2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal"]
Jul 10 22:43:00.897009 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.896900    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:43:00.898363 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.898347    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:43:00.898463 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.898375    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:43:00.898463 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.898385    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:43:00.899403 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.899390    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:43:00.899566 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.899553    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:00.899632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.899594    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:43:00.900119 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.900106    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:43:00.900119 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.900115    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:43:00.900235 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.900133    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:43:00.900235 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.900139    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:43:00.900235 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.900154    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:43:00.900235 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.900161    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:43:00.901069 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.901056    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:00.901118 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.901079    2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 22:43:00.901750 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.901731    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 22:43:00.901850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.901780    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 22:43:00.901850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.901793    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeHasSufficientPID"
Jul 10 22:43:00.923606 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.923575    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-215.ec2.internal\" not found" node="ip-10-0-130-215.ec2.internal"
Jul 10 22:43:00.928100 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.928083    2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-215.ec2.internal\" not found" node="ip-10-0-130-215.ec2.internal"
Jul 10 22:43:00.947281 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:00.947253    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:00.966683 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.966652    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bfd3bb8070f8a0d68abe55dcf16be361-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal\" (UID: \"bfd3bb8070f8a0d68abe55dcf16be361\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:00.966810 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.966685    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfd3bb8070f8a0d68abe55dcf16be361-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal\" (UID: \"bfd3bb8070f8a0d68abe55dcf16be361\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:00.966810 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:00.966705    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/41b0fee650dcf69fea5e4dfcbe8f4eea-config\") pod \"kube-apiserver-proxy-ip-10-0-130-215.ec2.internal\" (UID: \"41b0fee650dcf69fea5e4dfcbe8f4eea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:01.048337 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:01.048309    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:01.067689 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.067656    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bfd3bb8070f8a0d68abe55dcf16be361-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal\" (UID: \"bfd3bb8070f8a0d68abe55dcf16be361\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:01.067689 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.067703    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfd3bb8070f8a0d68abe55dcf16be361-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal\" (UID: \"bfd3bb8070f8a0d68abe55dcf16be361\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:01.067877 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.067723    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/41b0fee650dcf69fea5e4dfcbe8f4eea-config\") pod \"kube-apiserver-proxy-ip-10-0-130-215.ec2.internal\" (UID: \"41b0fee650dcf69fea5e4dfcbe8f4eea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:01.067877 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.067749    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/41b0fee650dcf69fea5e4dfcbe8f4eea-config\") pod \"kube-apiserver-proxy-ip-10-0-130-215.ec2.internal\" (UID: \"41b0fee650dcf69fea5e4dfcbe8f4eea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:01.067877 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.067748    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bfd3bb8070f8a0d68abe55dcf16be361-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal\" (UID: \"bfd3bb8070f8a0d68abe55dcf16be361\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:01.067877 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.067794    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfd3bb8070f8a0d68abe55dcf16be361-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal\" (UID: \"bfd3bb8070f8a0d68abe55dcf16be361\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:01.149054 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:01.148983    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:01.226543 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.226500    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:01.231031 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.231004    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:01.249520 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:01.249487    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:01.350151 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:01.350112    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:01.450758 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:01.450667    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:01.551184 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:01.551150    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:01.604669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.604639    2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 22:43:01.605161 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.604819    2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 22:43:01.652166 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:01.652136    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:01.676871 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.676823    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 22:38:00 +0000 UTC" deadline="2028-03-03 19:16:17.228333067 +0000 UTC"
Jul 10 22:43:01.676871 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.676867    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14444h33m15.551470148s"
Jul 10 22:43:01.714235 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:01.714021    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b0fee650dcf69fea5e4dfcbe8f4eea.slice/crio-87bc53b80f33c05bd98f45e7ce7690ba36a1f56c454981d03459023d2a0e50f4 WatchSource:0}: Error finding container 87bc53b80f33c05bd98f45e7ce7690ba36a1f56c454981d03459023d2a0e50f4: Status 404 returned error can't find the container with id 87bc53b80f33c05bd98f45e7ce7690ba36a1f56c454981d03459023d2a0e50f4
Jul 10 22:43:01.714452 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:01.714420    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd3bb8070f8a0d68abe55dcf16be361.slice/crio-bef7a548a4b2303b886317311449486a3c1e769ea6967c1602578d4ab55f9262 WatchSource:0}: Error finding container bef7a548a4b2303b886317311449486a3c1e769ea6967c1602578d4ab55f9262: Status 404 returned error can't find the container with id bef7a548a4b2303b886317311449486a3c1e769ea6967c1602578d4ab55f9262
Jul 10 22:43:01.719066 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.719039    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 22:43:01.752853 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:01.752811    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:01.790911 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.790887    2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 22:43:01.800028 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.799974    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" event={"ID":"bfd3bb8070f8a0d68abe55dcf16be361","Type":"ContainerStarted","Data":"bef7a548a4b2303b886317311449486a3c1e769ea6967c1602578d4ab55f9262"}
Jul 10 22:43:01.800906 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:01.800884    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal" event={"ID":"41b0fee650dcf69fea5e4dfcbe8f4eea","Type":"ContainerStarted","Data":"87bc53b80f33c05bd98f45e7ce7690ba36a1f56c454981d03459023d2a0e50f4"}
Jul 10 22:43:01.853088 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:01.853057    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:01.953655 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:01.953586    2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-215.ec2.internal\" not found"
Jul 10 22:43:02.048496 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.048467    2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 22:43:02.066269 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.066239    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:02.081503 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.081477    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 22:43:02.082489 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.082475    2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal"
Jul 10 22:43:02.092050 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.092026    2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 22:43:02.210334 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.210257    2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 22:43:02.471958 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.471867    2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 22:43:02.648662 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.648619    2566 apiserver.go:52] "Watching apiserver"
Jul 10 22:43:02.657449 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.657417    2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 22:43:02.657905 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.657879    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-j56vp","kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz","openshift-cluster-node-tuning-operator/tuned-58fkc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal","openshift-multus/multus-btksg","openshift-multus/network-metrics-daemon-6rq2s","openshift-network-diagnostics/network-check-target-x5vjs","kube-system/konnectivity-agent-vhjz5","openshift-dns/node-resolver-fqm8t","openshift-image-registry/node-ca-85mnt","openshift-multus/multus-additional-cni-plugins-gl9bt","openshift-network-operator/iptables-alerter-wtcvp","openshift-ovn-kubernetes/ovnkube-node-8wmsn"]
Jul 10 22:43:02.660596 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.660575    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fqm8t"
Jul 10 22:43:02.662715 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.662691    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vhjz5"
Jul 10 22:43:02.663279 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.663260    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 22:43:02.663279 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.663272    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 22:43:02.663627 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.663605    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m562j\""
Jul 10 22:43:02.664881 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.664862    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.664980 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.664885    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 22:43:02.665424 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.665405    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 22:43:02.665831 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.665538    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zwrwq\""
Jul 10 22:43:02.666104 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.666085    2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 22:43:02.667916 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.667864    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.668270 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.668243    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 22:43:02.668666 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.668570    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 22:43:02.668776 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.668744    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sx8xf\""
Jul 10 22:43:02.668910 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.668896    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 22:43:02.670148 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.670131    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:02.670237 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:02.670208    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:02.672262 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.672241    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-85mnt"
Jul 10 22:43:02.672912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.672710    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 22:43:02.672912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.672751    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hgfnw\""
Jul 10 22:43:02.673174 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.673157    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 22:43:02.674447 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.674429    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.675749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.675523    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-978ts\" (UniqueName: \"kubernetes.io/projected/d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf-kube-api-access-978ts\") pod \"node-resolver-fqm8t\" (UID: \"d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf\") " pod="openshift-dns/node-resolver-fqm8t"
Jul 10 22:43:02.675749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.675563    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-registration-dir\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.675749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.675602    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-device-dir\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.675749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.675645    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-etc-selinux\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.675749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.675677    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zh75\" (UniqueName: \"kubernetes.io/projected/a5efd630-07b6-47cc-8534-d5d002f1d971-kube-api-access-4zh75\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.675749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.675732    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd433807-db54-456a-adf3-70a6912f8833-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.676099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.675803    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd433807-db54-456a-adf3-70a6912f8833-cni-binary-copy\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.676099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.675834    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd433807-db54-456a-adf3-70a6912f8833-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.676099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.675867    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5c9c\" (UniqueName: \"kubernetes.io/projected/bd433807-db54-456a-adf3-70a6912f8833-kube-api-access-k5c9c\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.676099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.675899    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.676099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.675931    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-sys-fs\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.676099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.675959    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd433807-db54-456a-adf3-70a6912f8833-cnibin\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.676099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.675983    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf-hosts-file\") pod \"node-resolver-fqm8t\" (UID: \"d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf\") " pod="openshift-dns/node-resolver-fqm8t"
Jul 10 22:43:02.676099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.676013    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/851d6aef-2780-4f25-867c-14ba6fdace8c-agent-certs\") pod \"konnectivity-agent-vhjz5\" (UID: \"851d6aef-2780-4f25-867c-14ba6fdace8c\") " pod="kube-system/konnectivity-agent-vhjz5"
Jul 10 22:43:02.676099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.676045    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/851d6aef-2780-4f25-867c-14ba6fdace8c-konnectivity-ca\") pod \"konnectivity-agent-vhjz5\" (UID: \"851d6aef-2780-4f25-867c-14ba6fdace8c\") " pod="kube-system/konnectivity-agent-vhjz5"
Jul 10 22:43:02.676099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.676073    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-socket-dir\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.676099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.676102    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd433807-db54-456a-adf3-70a6912f8833-system-cni-dir\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.676624 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.676128    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd433807-db54-456a-adf3-70a6912f8833-os-release\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.676624 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.676180    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd433807-db54-456a-adf3-70a6912f8833-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.676624 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.676215    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf-tmp-dir\") pod \"node-resolver-fqm8t\" (UID: \"d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf\") " pod="openshift-dns/node-resolver-fqm8t"
Jul 10 22:43:02.676779 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.676671    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nq64j\""
Jul 10 22:43:02.676779 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.676727    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 22:43:02.677492 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.676671    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 22:43:02.677492 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.676974    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 22:43:02.677492 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.677063    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 22:43:02.677492 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.676976    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 22:43:02.677492 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.677244    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 22:43:02.677492 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.677450    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 22:43:02.677854 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.677520    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wtcvp"
Jul 10 22:43:02.678590 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.678213    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vg8hw\""
Jul 10 22:43:02.680023 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.680004    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:02.680108 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:02.680073    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:02.681291 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.681003    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 22:43:02.681291 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.681273    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9r2jp\""
Jul 10 22:43:02.681431 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.681330    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 22:43:02.681482 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.681456    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 22:43:02.683336 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.683321    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.685580 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.685458    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:02.685580 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:02.685537    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:02.686325 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.685963    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 22:43:02.686325 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.685989    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jj2hk\""
Jul 10 22:43:02.686325 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.686188    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 22:43:02.687151 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.687103    2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 22:43:02.688333 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.687890    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.690275 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.690013    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 22:43:02.690711 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.690683    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2czwh\""
Jul 10 22:43:02.692205 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.691980    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 22:43:02.692205 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.692021    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 22:43:02.692205 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.691982    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 22:43:02.692205 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.691982    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 22:43:02.692205 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.692127    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 22:43:02.708584 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.708561    2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tp2j5"
Jul 10 22:43:02.717612 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.717403    2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tp2j5"
Jul 10 22:43:02.767081 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.767052    2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 22:43:02.777065 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777037    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2-serviceca\") pod \"node-ca-85mnt\" (UID: \"1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2\") " pod="openshift-image-registry/node-ca-85mnt"
Jul 10 22:43:02.777244 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777075    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-host\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.777244 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777101    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c80d1cd-1826-402a-85ba-8d5cd7082014-tmp\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.777244 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777126    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-etc-selinux\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.777244 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777143    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zh75\" (UniqueName: \"kubernetes.io/projected/a5efd630-07b6-47cc-8534-d5d002f1d971-kube-api-access-4zh75\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.777244 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777160    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9p7g\" (UniqueName: \"kubernetes.io/projected/351fb14f-02ad-484c-aef1-e6a426502261-kube-api-access-m9p7g\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.777244 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777175    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-sysctl-d\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.777244 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777189    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pntgx\" (UniqueName: \"kubernetes.io/projected/6c80d1cd-1826-402a-85ba-8d5cd7082014-kube-api-access-pntgx\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.777244 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777212    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-run-ovn\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.777244 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777232    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-log-socket\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.777654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777257    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd433807-db54-456a-adf3-70a6912f8833-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.777654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777281    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/351fb14f-02ad-484c-aef1-e6a426502261-cni-binary-copy\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.777654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777280    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-etc-selinux\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.777654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777301    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-systemd\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.777654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777324    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-run\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.777654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777415    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-var-lib-kubelet\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.777654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777437    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-run-systemd\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.777654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777456    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-sys-fs\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.777654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777515    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-multus-socket-dir-parent\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.777654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777561    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-run-netns\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.777654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777630    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-sys-fs\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.777654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777634    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf-hosts-file\") pod \"node-resolver-fqm8t\" (UID: \"d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf\") " pod="openshift-dns/node-resolver-fqm8t"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777676    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/851d6aef-2780-4f25-867c-14ba6fdace8c-agent-certs\") pod \"konnectivity-agent-vhjz5\" (UID: \"851d6aef-2780-4f25-867c-14ba6fdace8c\") " pod="kube-system/konnectivity-agent-vhjz5"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777679    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf-hosts-file\") pod \"node-resolver-fqm8t\" (UID: \"d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf\") " pod="openshift-dns/node-resolver-fqm8t"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777701    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-sysctl-conf\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777733    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-run-openvswitch\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777757    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-cni-netd\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777796    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/858194fe-333d-433b-a093-ba6f5b9af0ee-ovn-node-metrics-cert\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777824    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-registration-dir\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777849    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5c9c\" (UniqueName: \"kubernetes.io/projected/bd433807-db54-456a-adf3-70a6912f8833-kube-api-access-k5c9c\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777919    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd433807-db54-456a-adf3-70a6912f8833-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.777944    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-registration-dir\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778021    2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778055    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-sys\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778087    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-var-lib-kubelet\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778111    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-sysconfig\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778137    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778165    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-etc-openvswitch\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.778220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778185    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/858194fe-333d-433b-a093-ba6f5b9af0ee-env-overrides\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778209    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778224    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-var-lib-cni-multus\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778245    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-kubelet\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778271    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-systemd-units\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778309    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/858194fe-333d-433b-a093-ba6f5b9af0ee-ovnkube-script-lib\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778314    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778356    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-socket-dir\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778408    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd433807-db54-456a-adf3-70a6912f8833-system-cni-dir\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778462    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd433807-db54-456a-adf3-70a6912f8833-os-release\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778466    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd433807-db54-456a-adf3-70a6912f8833-system-cni-dir\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778467    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-socket-dir\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778513    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd433807-db54-456a-adf3-70a6912f8833-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778540    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd433807-db54-456a-adf3-70a6912f8833-os-release\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778557    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffr2q\" (UniqueName: \"kubernetes.io/projected/3efa918d-27f0-4c41-912b-519868eaf758-kube-api-access-ffr2q\") pod \"network-metrics-daemon-6rq2s\" (UID: \"3efa918d-27f0-4c41-912b-519868eaf758\") " pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778626    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-run-multus-certs\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.778921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778652    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ca38ae3-c857-47a1-a3e9-08279a2e3a81-host-slash\") pod \"iptables-alerter-wtcvp\" (UID: \"8ca38ae3-c857-47a1-a3e9-08279a2e3a81\") " pod="openshift-network-operator/iptables-alerter-wtcvp"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778678    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lg2s\" (UniqueName: \"kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s\") pod \"network-check-target-x5vjs\" (UID: \"38498cbc-be4a-4489-a927-0d38b32a8e53\") " pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778687    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd433807-db54-456a-adf3-70a6912f8833-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778703    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf-tmp-dir\") pod \"node-resolver-fqm8t\" (UID: \"d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf\") " pod="openshift-dns/node-resolver-fqm8t"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778739    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-device-dir\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778800    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs\") pod \"network-metrics-daemon-6rq2s\" (UID: \"3efa918d-27f0-4c41-912b-519868eaf758\") " pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778807    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5efd630-07b6-47cc-8534-d5d002f1d971-device-dir\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778834    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-os-release\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778870    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-var-lib-cni-bin\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778896    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-cni-bin\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778935    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxmz8\" (UniqueName: \"kubernetes.io/projected/1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2-kube-api-access-dxmz8\") pod \"node-ca-85mnt\" (UID: \"1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2\") " pod="openshift-image-registry/node-ca-85mnt"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.778976    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-etc-kubernetes\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779001    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-modprobe-d\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779037    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-multus-conf-dir\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779001    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf-tmp-dir\") pod \"node-resolver-fqm8t\" (UID: \"d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf\") " pod="openshift-dns/node-resolver-fqm8t"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779061    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wswsv\" (UniqueName: \"kubernetes.io/projected/8ca38ae3-c857-47a1-a3e9-08279a2e3a81-kube-api-access-wswsv\") pod \"iptables-alerter-wtcvp\" (UID: \"8ca38ae3-c857-47a1-a3e9-08279a2e3a81\") " pod="openshift-network-operator/iptables-alerter-wtcvp"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779083    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/010f1cce-27b5-4536-b7b9-9be0187fb5d6-dbus\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:02.779558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779105    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-slash\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779125    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-var-lib-openvswitch\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779153    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/851d6aef-2780-4f25-867c-14ba6fdace8c-konnectivity-ca\") pod \"konnectivity-agent-vhjz5\" (UID: \"851d6aef-2780-4f25-867c-14ba6fdace8c\") " pod="kube-system/konnectivity-agent-vhjz5"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779175    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-cnibin\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779273    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-hostroot\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779301    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-lib-modules\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779329    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/010f1cce-27b5-4536-b7b9-9be0187fb5d6-kubelet-config\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779354    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/858194fe-333d-433b-a093-ba6f5b9af0ee-ovnkube-config\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779401    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978ts\" (UniqueName: \"kubernetes.io/projected/d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf-kube-api-access-978ts\") pod \"node-resolver-fqm8t\" (UID: \"d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf\") " pod="openshift-dns/node-resolver-fqm8t"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779418    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd433807-db54-456a-adf3-70a6912f8833-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779434    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-multus-cni-dir\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779456    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-kubernetes\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779472    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd433807-db54-456a-adf3-70a6912f8833-cni-binary-copy\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779486    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-system-cni-dir\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779502    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-run-k8s-cni-cncf-io\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779527    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/351fb14f-02ad-484c-aef1-e6a426502261-multus-daemon-config\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.780343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779551    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-tuned\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.781095 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779574    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-run-netns\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.781095 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779598    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.781095 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779623    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd433807-db54-456a-adf3-70a6912f8833-cnibin\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.781095 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779645    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2-host\") pod \"node-ca-85mnt\" (UID: \"1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2\") " pod="openshift-image-registry/node-ca-85mnt"
Jul 10 22:43:02.781095 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779679    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/851d6aef-2780-4f25-867c-14ba6fdace8c-konnectivity-ca\") pod \"konnectivity-agent-vhjz5\" (UID: \"851d6aef-2780-4f25-867c-14ba6fdace8c\") " pod="kube-system/konnectivity-agent-vhjz5"
Jul 10 22:43:02.781095 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779681    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ca38ae3-c857-47a1-a3e9-08279a2e3a81-iptables-alerter-script\") pod \"iptables-alerter-wtcvp\" (UID: \"8ca38ae3-c857-47a1-a3e9-08279a2e3a81\") " pod="openshift-network-operator/iptables-alerter-wtcvp"
Jul 10 22:43:02.781095 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779734    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd433807-db54-456a-adf3-70a6912f8833-cnibin\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.781095 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779743    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-node-log\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.781095 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.779800    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbb5n\" (UniqueName: \"kubernetes.io/projected/858194fe-333d-433b-a093-ba6f5b9af0ee-kube-api-access-dbb5n\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.781095 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.780154    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd433807-db54-456a-adf3-70a6912f8833-cni-binary-copy\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.781095 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.780730    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd433807-db54-456a-adf3-70a6912f8833-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.782273 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.782248    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/851d6aef-2780-4f25-867c-14ba6fdace8c-agent-certs\") pod \"konnectivity-agent-vhjz5\" (UID: \"851d6aef-2780-4f25-867c-14ba6fdace8c\") " pod="kube-system/konnectivity-agent-vhjz5"
Jul 10 22:43:02.785780 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.785739    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zh75\" (UniqueName: \"kubernetes.io/projected/a5efd630-07b6-47cc-8534-d5d002f1d971-kube-api-access-4zh75\") pod \"aws-ebs-csi-driver-node-jj7kz\" (UID: \"a5efd630-07b6-47cc-8534-d5d002f1d971\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.786105 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.786081    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5c9c\" (UniqueName: \"kubernetes.io/projected/bd433807-db54-456a-adf3-70a6912f8833-kube-api-access-k5c9c\") pod \"multus-additional-cni-plugins-gl9bt\" (UID: \"bd433807-db54-456a-adf3-70a6912f8833\") " pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:02.787175 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.787157    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-978ts\" (UniqueName: \"kubernetes.io/projected/d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf-kube-api-access-978ts\") pod \"node-resolver-fqm8t\" (UID: \"d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf\") " pod="openshift-dns/node-resolver-fqm8t"
Jul 10 22:43:02.880570 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880541    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.880570 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880572    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/858194fe-333d-433b-a093-ba6f5b9af0ee-ovnkube-config\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.880808 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880590    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-multus-cni-dir\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.880808 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880604    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-kubernetes\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.880808 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880647    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-system-cni-dir\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.880808 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880667    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-run-k8s-cni-cncf-io\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.880808 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880686    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/351fb14f-02ad-484c-aef1-e6a426502261-multus-daemon-config\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.880808 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880681    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.880808 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880720    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-run-k8s-cni-cncf-io\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.880808 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880739    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-system-cni-dir\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.880808 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880709    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-tuned\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.880808 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880786    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-run-netns\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880834    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880877    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880898    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-run-netns\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880915    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-multus-cni-dir\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880957    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2-host\") pod \"node-ca-85mnt\" (UID: \"1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2\") " pod="openshift-image-registry/node-ca-85mnt"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880974    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-kubernetes\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.880991    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ca38ae3-c857-47a1-a3e9-08279a2e3a81-iptables-alerter-script\") pod \"iptables-alerter-wtcvp\" (UID: \"8ca38ae3-c857-47a1-a3e9-08279a2e3a81\") " pod="openshift-network-operator/iptables-alerter-wtcvp"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881018    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-node-log\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881043    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbb5n\" (UniqueName: \"kubernetes.io/projected/858194fe-333d-433b-a093-ba6f5b9af0ee-kube-api-access-dbb5n\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881052    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-node-log\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881018    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2-host\") pod \"node-ca-85mnt\" (UID: \"1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2\") " pod="openshift-image-registry/node-ca-85mnt"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881068    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2-serviceca\") pod \"node-ca-85mnt\" (UID: \"1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2\") " pod="openshift-image-registry/node-ca-85mnt"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881090    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-host\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881113    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c80d1cd-1826-402a-85ba-8d5cd7082014-tmp\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881139    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9p7g\" (UniqueName: \"kubernetes.io/projected/351fb14f-02ad-484c-aef1-e6a426502261-kube-api-access-m9p7g\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881167    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-sysctl-d\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881192    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pntgx\" (UniqueName: \"kubernetes.io/projected/6c80d1cd-1826-402a-85ba-8d5cd7082014-kube-api-access-pntgx\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.881268 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881215    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-run-ovn\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881239    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-log-socket\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881267    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/351fb14f-02ad-484c-aef1-e6a426502261-cni-binary-copy\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881300    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-systemd\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881319    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/858194fe-333d-433b-a093-ba6f5b9af0ee-ovnkube-config\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881348    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/351fb14f-02ad-484c-aef1-e6a426502261-multus-daemon-config\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881376    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-run\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881324    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-run\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881414    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-host\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881413    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-sysctl-d\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881434    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-var-lib-kubelet\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881481    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-var-lib-kubelet\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881525    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-log-socket\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881563    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-run-ovn\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881564    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ca38ae3-c857-47a1-a3e9-08279a2e3a81-iptables-alerter-script\") pod \"iptables-alerter-wtcvp\" (UID: \"8ca38ae3-c857-47a1-a3e9-08279a2e3a81\") " pod="openshift-network-operator/iptables-alerter-wtcvp"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881645    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-systemd\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881757    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-run-systemd\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881818    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-run-systemd\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.882156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881807    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-multus-socket-dir-parent\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881866    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-run-netns\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881878    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-multus-socket-dir-parent\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881882    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2-serviceca\") pod \"node-ca-85mnt\" (UID: \"1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2\") " pod="openshift-image-registry/node-ca-85mnt"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881894    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-sysctl-conf\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881920    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-run-openvswitch\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881927    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-run-netns\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881953    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-cni-netd\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.881984    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/858194fe-333d-433b-a093-ba6f5b9af0ee-ovn-node-metrics-cert\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882010    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-sys\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882008    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-run-openvswitch\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882031    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-var-lib-kubelet\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882046    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-sysctl-conf\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882058    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-sysconfig\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882084    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882095    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-sys\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882104    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-etc-openvswitch\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882116    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/351fb14f-02ad-484c-aef1-e6a426502261-cni-binary-copy\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.883018 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882129    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/858194fe-333d-433b-a093-ba6f5b9af0ee-env-overrides\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882138    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-sysconfig\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882151    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-var-lib-cni-multus\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882175    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-kubelet\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882202    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-var-lib-kubelet\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882201    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-systemd-units\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:02.882236    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882258    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/858194fe-333d-433b-a093-ba6f5b9af0ee-ovnkube-script-lib\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882239    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-etc-openvswitch\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882287    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffr2q\" (UniqueName: \"kubernetes.io/projected/3efa918d-27f0-4c41-912b-519868eaf758-kube-api-access-ffr2q\") pod \"network-metrics-daemon-6rq2s\" (UID: \"3efa918d-27f0-4c41-912b-519868eaf758\") " pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:02.882336    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret podName:010f1cce-27b5-4536-b7b9-9be0187fb5d6 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:03.382295894 +0000 UTC m=+3.075654147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret") pod "global-pull-secret-syncer-j56vp" (UID: "010f1cce-27b5-4536-b7b9-9be0187fb5d6") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882343    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-cni-netd\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882389    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-run-multus-certs\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882420    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-kubelet\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882430    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ca38ae3-c857-47a1-a3e9-08279a2e3a81-host-slash\") pod \"iptables-alerter-wtcvp\" (UID: \"8ca38ae3-c857-47a1-a3e9-08279a2e3a81\") " pod="openshift-network-operator/iptables-alerter-wtcvp"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882461    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-var-lib-cni-multus\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882391    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-systemd-units\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.883850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882476    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ca38ae3-c857-47a1-a3e9-08279a2e3a81-host-slash\") pod \"iptables-alerter-wtcvp\" (UID: \"8ca38ae3-c857-47a1-a3e9-08279a2e3a81\") " pod="openshift-network-operator/iptables-alerter-wtcvp"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882490    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-run-multus-certs\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882592    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/858194fe-333d-433b-a093-ba6f5b9af0ee-env-overrides\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882597    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lg2s\" (UniqueName: \"kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s\") pod \"network-check-target-x5vjs\" (UID: \"38498cbc-be4a-4489-a927-0d38b32a8e53\") " pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882652    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs\") pod \"network-metrics-daemon-6rq2s\" (UID: \"3efa918d-27f0-4c41-912b-519868eaf758\") " pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882677    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-os-release\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882702    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-var-lib-cni-bin\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882724    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-cni-bin\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882779    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxmz8\" (UniqueName: \"kubernetes.io/projected/1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2-kube-api-access-dxmz8\") pod \"node-ca-85mnt\" (UID: \"1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2\") " pod="openshift-image-registry/node-ca-85mnt"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882803    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-etc-kubernetes\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882827    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-modprobe-d\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882854    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-multus-conf-dir\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882869    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-host-var-lib-cni-bin\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882875    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wswsv\" (UniqueName: \"kubernetes.io/projected/8ca38ae3-c857-47a1-a3e9-08279a2e3a81-kube-api-access-wswsv\") pod \"iptables-alerter-wtcvp\" (UID: \"8ca38ae3-c857-47a1-a3e9-08279a2e3a81\") " pod="openshift-network-operator/iptables-alerter-wtcvp"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882911    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/010f1cce-27b5-4536-b7b9-9be0187fb5d6-dbus\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882936    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-slash\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882962    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-var-lib-openvswitch\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.882991    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-cnibin\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.884314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883017    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-hostroot\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883041    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-lib-modules\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883078    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/010f1cce-27b5-4536-b7b9-9be0187fb5d6-kubelet-config\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883084    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-cni-bin\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883174    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-cnibin\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883205    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-var-lib-openvswitch\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883264    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-lib-modules\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883263    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/010f1cce-27b5-4536-b7b9-9be0187fb5d6-kubelet-config\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883305    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/010f1cce-27b5-4536-b7b9-9be0187fb5d6-dbus\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883315    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/858194fe-333d-433b-a093-ba6f5b9af0ee-host-slash\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883320    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-tuned\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883352    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-hostroot\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:02.883376    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883385    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-os-release\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883420    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-multus-conf-dir\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883431    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/351fb14f-02ad-484c-aef1-e6a426502261-etc-kubernetes\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883430    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6c80d1cd-1826-402a-85ba-8d5cd7082014-etc-modprobe-d\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:02.883474    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs podName:3efa918d-27f0-4c41-912b-519868eaf758 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:03.383455668 +0000 UTC m=+3.076813933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs") pod "network-metrics-daemon-6rq2s" (UID: "3efa918d-27f0-4c41-912b-519868eaf758") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:02.884800 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883664    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/858194fe-333d-433b-a093-ba6f5b9af0ee-ovnkube-script-lib\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.885363 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.883857    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c80d1cd-1826-402a-85ba-8d5cd7082014-tmp\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.885363 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.885248    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/858194fe-333d-433b-a093-ba6f5b9af0ee-ovn-node-metrics-cert\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.890197 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:02.890171    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:43:02.890197 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:02.890196    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:43:02.890197 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:02.890211    2566 projected.go:196] Error preparing data for projected volume kube-api-access-2lg2s for pod openshift-network-diagnostics/network-check-target-x5vjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:02.890495 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:02.890282    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s podName:38498cbc-be4a-4489-a927-0d38b32a8e53 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:03.390265553 +0000 UTC m=+3.083623808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2lg2s" (UniqueName: "kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s") pod "network-check-target-x5vjs" (UID: "38498cbc-be4a-4489-a927-0d38b32a8e53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:02.892080 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.892051    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pntgx\" (UniqueName: \"kubernetes.io/projected/6c80d1cd-1826-402a-85ba-8d5cd7082014-kube-api-access-pntgx\") pod \"tuned-58fkc\" (UID: \"6c80d1cd-1826-402a-85ba-8d5cd7082014\") " pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:02.892582 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.892560    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbb5n\" (UniqueName: \"kubernetes.io/projected/858194fe-333d-433b-a093-ba6f5b9af0ee-kube-api-access-dbb5n\") pod \"ovnkube-node-8wmsn\" (UID: \"858194fe-333d-433b-a093-ba6f5b9af0ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:02.895172 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.892969    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffr2q\" (UniqueName: \"kubernetes.io/projected/3efa918d-27f0-4c41-912b-519868eaf758-kube-api-access-ffr2q\") pod \"network-metrics-daemon-6rq2s\" (UID: \"3efa918d-27f0-4c41-912b-519868eaf758\") " pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:02.895172 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.893132    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9p7g\" (UniqueName: \"kubernetes.io/projected/351fb14f-02ad-484c-aef1-e6a426502261-kube-api-access-m9p7g\") pod \"multus-btksg\" (UID: \"351fb14f-02ad-484c-aef1-e6a426502261\") " pod="openshift-multus/multus-btksg"
Jul 10 22:43:02.895172 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.893240    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wswsv\" (UniqueName: \"kubernetes.io/projected/8ca38ae3-c857-47a1-a3e9-08279a2e3a81-kube-api-access-wswsv\") pod \"iptables-alerter-wtcvp\" (UID: \"8ca38ae3-c857-47a1-a3e9-08279a2e3a81\") " pod="openshift-network-operator/iptables-alerter-wtcvp"
Jul 10 22:43:02.895172 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.893270    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxmz8\" (UniqueName: \"kubernetes.io/projected/1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2-kube-api-access-dxmz8\") pod \"node-ca-85mnt\" (UID: \"1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2\") " pod="openshift-image-registry/node-ca-85mnt"
Jul 10 22:43:02.972887 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.972852    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fqm8t"
Jul 10 22:43:02.982872 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.982845    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vhjz5"
Jul 10 22:43:02.991591 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.991563    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz"
Jul 10 22:43:02.998518 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:02.998497    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gl9bt"
Jul 10 22:43:03.006249 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.006224    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-85mnt"
Jul 10 22:43:03.013987 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.013963    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-btksg"
Jul 10 22:43:03.021683 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.021663    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wtcvp"
Jul 10 22:43:03.028644 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.028624    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-58fkc"
Jul 10 22:43:03.033415 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.033392    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:03.387947 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.387854    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:03.387947 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.387918    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs\") pod \"network-metrics-daemon-6rq2s\" (UID: \"3efa918d-27f0-4c41-912b-519868eaf758\") " pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:03.388160 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:03.388049    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:03.388160 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:03.388107    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs podName:3efa918d-27f0-4c41-912b-519868eaf758 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:04.388088828 +0000 UTC m=+4.081447089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs") pod "network-metrics-daemon-6rq2s" (UID: "3efa918d-27f0-4c41-912b-519868eaf758") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:03.388358 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:03.388322    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:03.388472 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:03.388401    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret podName:010f1cce-27b5-4536-b7b9-9be0187fb5d6 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:04.388383204 +0000 UTC m=+4.081741473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret") pod "global-pull-secret-syncer-j56vp" (UID: "010f1cce-27b5-4536-b7b9-9be0187fb5d6") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:03.488921 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.488889    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lg2s\" (UniqueName: \"kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s\") pod \"network-check-target-x5vjs\" (UID: \"38498cbc-be4a-4489-a927-0d38b32a8e53\") " pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:03.489110 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:03.489060    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:43:03.489110 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:03.489084    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:43:03.489110 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:03.489094    2566 projected.go:196] Error preparing data for projected volume kube-api-access-2lg2s for pod openshift-network-diagnostics/network-check-target-x5vjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:03.489246 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:03.489172    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s podName:38498cbc-be4a-4489-a927-0d38b32a8e53 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:04.489151485 +0000 UTC m=+4.182509742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2lg2s" (UniqueName: "kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s") pod "network-check-target-x5vjs" (UID: "38498cbc-be4a-4489-a927-0d38b32a8e53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:03.555106 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:03.555066    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c0c20c4_4027_4cc1_9f85_a078ac9fe0c2.slice/crio-513a9396ab18278b3fe929a7e87d13d904562e477e5a37d63434591e982b485b WatchSource:0}: Error finding container 513a9396ab18278b3fe929a7e87d13d904562e477e5a37d63434591e982b485b: Status 404 returned error can't find the container with id 513a9396ab18278b3fe929a7e87d13d904562e477e5a37d63434591e982b485b
Jul 10 22:43:03.558319 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:03.558290    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca38ae3_c857_47a1_a3e9_08279a2e3a81.slice/crio-30099794ca849fe5a4e67a5e40a863e976f38717d0628398ce42327771a196ae WatchSource:0}: Error finding container 30099794ca849fe5a4e67a5e40a863e976f38717d0628398ce42327771a196ae: Status 404 returned error can't find the container with id 30099794ca849fe5a4e67a5e40a863e976f38717d0628398ce42327771a196ae
Jul 10 22:43:03.560531 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:03.560495    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd433807_db54_456a_adf3_70a6912f8833.slice/crio-106aa492635e27c22257fa845686dcdd0f4e86199c3435cbc784dd49d6342606 WatchSource:0}: Error finding container 106aa492635e27c22257fa845686dcdd0f4e86199c3435cbc784dd49d6342606: Status 404 returned error can't find the container with id 106aa492635e27c22257fa845686dcdd0f4e86199c3435cbc784dd49d6342606
Jul 10 22:43:03.561039 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:03.561016    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52abbd9_88c8_4d3b_9a5a_a7d8ed23f6cf.slice/crio-8db415fb6f3a0182f574f750af72f365f63b9b30be9103c89fb0be37888fb7dd WatchSource:0}: Error finding container 8db415fb6f3a0182f574f750af72f365f63b9b30be9103c89fb0be37888fb7dd: Status 404 returned error can't find the container with id 8db415fb6f3a0182f574f750af72f365f63b9b30be9103c89fb0be37888fb7dd
Jul 10 22:43:03.562203 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:03.562184    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod351fb14f_02ad_484c_aef1_e6a426502261.slice/crio-1853b220e6658a043ad0021dd07293b911bfadf4505cd7a41215b45871e952c5 WatchSource:0}: Error finding container 1853b220e6658a043ad0021dd07293b911bfadf4505cd7a41215b45871e952c5: Status 404 returned error can't find the container with id 1853b220e6658a043ad0021dd07293b911bfadf4505cd7a41215b45871e952c5
Jul 10 22:43:03.584154 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:03.584128    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851d6aef_2780_4f25_867c_14ba6fdace8c.slice/crio-ff2db0f6836bc4aabce9444b7a8f8941e83b027c0bb1136db8ce8dc8691238e6 WatchSource:0}: Error finding container ff2db0f6836bc4aabce9444b7a8f8941e83b027c0bb1136db8ce8dc8691238e6: Status 404 returned error can't find the container with id ff2db0f6836bc4aabce9444b7a8f8941e83b027c0bb1136db8ce8dc8691238e6
Jul 10 22:43:03.584661 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:03.584642    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c80d1cd_1826_402a_85ba_8d5cd7082014.slice/crio-822efb2e1b04771f2e79338d57aeb9b0d80779401ebe14769a2a364df6cf4e09 WatchSource:0}: Error finding container 822efb2e1b04771f2e79338d57aeb9b0d80779401ebe14769a2a364df6cf4e09: Status 404 returned error can't find the container with id 822efb2e1b04771f2e79338d57aeb9b0d80779401ebe14769a2a364df6cf4e09
Jul 10 22:43:03.585784 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:03.585746    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858194fe_333d_433b_a093_ba6f5b9af0ee.slice/crio-25efc1707c49c238d4c83b2f51f2c76659590988743ea092ac68f2b804864891 WatchSource:0}: Error finding container 25efc1707c49c238d4c83b2f51f2c76659590988743ea092ac68f2b804864891: Status 404 returned error can't find the container with id 25efc1707c49c238d4c83b2f51f2c76659590988743ea092ac68f2b804864891
Jul 10 22:43:03.586632 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:03.586546    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5efd630_07b6_47cc_8534_d5d002f1d971.slice/crio-c059ca7859613f76bf7317fc19c0fe5efd9dda32026df9400d27d9ad8218286a WatchSource:0}: Error finding container c059ca7859613f76bf7317fc19c0fe5efd9dda32026df9400d27d9ad8218286a: Status 404 returned error can't find the container with id c059ca7859613f76bf7317fc19c0fe5efd9dda32026df9400d27d9ad8218286a
Jul 10 22:43:03.721620 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.721434    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 22:38:02 +0000 UTC" deadline="2027-12-08 07:02:29.80469547 +0000 UTC"
Jul 10 22:43:03.722120 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.721639    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12368h19m26.08308686s"
Jul 10 22:43:03.797421 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.797399    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:03.797526 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:03.797509    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:03.805694 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.805663    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal" event={"ID":"41b0fee650dcf69fea5e4dfcbe8f4eea","Type":"ContainerStarted","Data":"0ece225206c4dd7a44b8a6bbe20ee97715eeed504e21e55edbde6a6d8bd13308"}
Jul 10 22:43:03.806735 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.806704    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz" event={"ID":"a5efd630-07b6-47cc-8534-d5d002f1d971","Type":"ContainerStarted","Data":"c059ca7859613f76bf7317fc19c0fe5efd9dda32026df9400d27d9ad8218286a"}
Jul 10 22:43:03.807584 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.807565    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-58fkc" event={"ID":"6c80d1cd-1826-402a-85ba-8d5cd7082014","Type":"ContainerStarted","Data":"822efb2e1b04771f2e79338d57aeb9b0d80779401ebe14769a2a364df6cf4e09"}
Jul 10 22:43:03.810817 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.810791    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vhjz5" event={"ID":"851d6aef-2780-4f25-867c-14ba6fdace8c","Type":"ContainerStarted","Data":"ff2db0f6836bc4aabce9444b7a8f8941e83b027c0bb1136db8ce8dc8691238e6"}
Jul 10 22:43:03.813372 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.813333    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-btksg" event={"ID":"351fb14f-02ad-484c-aef1-e6a426502261","Type":"ContainerStarted","Data":"1853b220e6658a043ad0021dd07293b911bfadf4505cd7a41215b45871e952c5"}
Jul 10 22:43:03.814241 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.814224    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fqm8t" event={"ID":"d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf","Type":"ContainerStarted","Data":"8db415fb6f3a0182f574f750af72f365f63b9b30be9103c89fb0be37888fb7dd"}
Jul 10 22:43:03.815094 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.815076    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gl9bt" event={"ID":"bd433807-db54-456a-adf3-70a6912f8833","Type":"ContainerStarted","Data":"106aa492635e27c22257fa845686dcdd0f4e86199c3435cbc784dd49d6342606"}
Jul 10 22:43:03.816035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.816016    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-85mnt" event={"ID":"1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2","Type":"ContainerStarted","Data":"513a9396ab18278b3fe929a7e87d13d904562e477e5a37d63434591e982b485b"}
Jul 10 22:43:03.817376 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.817351    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" event={"ID":"bfd3bb8070f8a0d68abe55dcf16be361","Type":"ContainerStarted","Data":"745c4b9f0725587051a36c4fcee3d07138507673a4f3c174547f667ab1169808"}
Jul 10 22:43:03.818417 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.818395    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn" event={"ID":"858194fe-333d-433b-a093-ba6f5b9af0ee","Type":"ContainerStarted","Data":"25efc1707c49c238d4c83b2f51f2c76659590988743ea092ac68f2b804864891"}
Jul 10 22:43:03.819412 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.819394    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wtcvp" event={"ID":"8ca38ae3-c857-47a1-a3e9-08279a2e3a81","Type":"ContainerStarted","Data":"30099794ca849fe5a4e67a5e40a863e976f38717d0628398ce42327771a196ae"}
Jul 10 22:43:03.833585 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:03.833530    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-215.ec2.internal" podStartSLOduration=1.8335091019999998 podStartE2EDuration="1.833509102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:43:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:03.819031194 +0000 UTC m=+3.512389470" watchObservedRunningTime="2026-07-10 22:43:03.833509102 +0000 UTC m=+3.526867424"
Jul 10 22:43:04.394989 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:04.394947    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:04.395181 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:04.395024    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs\") pod \"network-metrics-daemon-6rq2s\" (UID: \"3efa918d-27f0-4c41-912b-519868eaf758\") " pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:04.395181 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:04.395168    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:04.395297 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:04.395243    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs podName:3efa918d-27f0-4c41-912b-519868eaf758 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:06.39521467 +0000 UTC m=+6.088572928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs") pod "network-metrics-daemon-6rq2s" (UID: "3efa918d-27f0-4c41-912b-519868eaf758") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:04.399981 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:04.399945    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:04.400142 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:04.400039    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret podName:010f1cce-27b5-4536-b7b9-9be0187fb5d6 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:06.40001889 +0000 UTC m=+6.093377156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret") pod "global-pull-secret-syncer-j56vp" (UID: "010f1cce-27b5-4536-b7b9-9be0187fb5d6") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:04.495526 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:04.495489    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lg2s\" (UniqueName: \"kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s\") pod \"network-check-target-x5vjs\" (UID: \"38498cbc-be4a-4489-a927-0d38b32a8e53\") " pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:04.495738 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:04.495722    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:43:04.495820 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:04.495746    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:43:04.495820 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:04.495776    2566 projected.go:196] Error preparing data for projected volume kube-api-access-2lg2s for pod openshift-network-diagnostics/network-check-target-x5vjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:04.495932 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:04.495837    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s podName:38498cbc-be4a-4489-a927-0d38b32a8e53 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:06.495818791 +0000 UTC m=+6.189177046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2lg2s" (UniqueName: "kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s") pod "network-check-target-x5vjs" (UID: "38498cbc-be4a-4489-a927-0d38b32a8e53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:04.723940 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:04.722528    2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 22:38:02 +0000 UTC" deadline="2027-12-27 20:24:13.851122635 +0000 UTC"
Jul 10 22:43:04.723940 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:04.722584    2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12837h41m9.128542923s"
Jul 10 22:43:04.798381 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:04.797895    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:04.798381 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:04.798030    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:04.798381 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:04.798246    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:04.798381 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:04.798344    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:04.842433 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:04.842391    2566 generic.go:356] "Generic (PLEG): container finished" podID="bfd3bb8070f8a0d68abe55dcf16be361" containerID="745c4b9f0725587051a36c4fcee3d07138507673a4f3c174547f667ab1169808" exitCode=0
Jul 10 22:43:04.843445 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:04.843416    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" event={"ID":"bfd3bb8070f8a0d68abe55dcf16be361","Type":"ContainerDied","Data":"745c4b9f0725587051a36c4fcee3d07138507673a4f3c174547f667ab1169808"}
Jul 10 22:43:05.797936 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:05.797901    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:05.798400 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:05.798058    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:05.889990 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:05.889951    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" event={"ID":"bfd3bb8070f8a0d68abe55dcf16be361","Type":"ContainerStarted","Data":"9fa06bae6e570774766f642d5386cb14968c7746d672da294e3650aa8d20b587"}
Jul 10 22:43:06.413897 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:06.413864    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:06.414071 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:06.413929    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs\") pod \"network-metrics-daemon-6rq2s\" (UID: \"3efa918d-27f0-4c41-912b-519868eaf758\") " pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:06.414149 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:06.414072    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:06.414149 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:06.414127    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs podName:3efa918d-27f0-4c41-912b-519868eaf758 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:10.414110004 +0000 UTC m=+10.107468258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs") pod "network-metrics-daemon-6rq2s" (UID: "3efa918d-27f0-4c41-912b-519868eaf758") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:06.414524 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:06.414503    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:06.414614 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:06.414558    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret podName:010f1cce-27b5-4536-b7b9-9be0187fb5d6 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:10.414542567 +0000 UTC m=+10.107900824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret") pod "global-pull-secret-syncer-j56vp" (UID: "010f1cce-27b5-4536-b7b9-9be0187fb5d6") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:06.514397 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:06.514351    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lg2s\" (UniqueName: \"kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s\") pod \"network-check-target-x5vjs\" (UID: \"38498cbc-be4a-4489-a927-0d38b32a8e53\") " pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:06.514588 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:06.514572    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:43:06.514658 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:06.514600    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:43:06.514658 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:06.514614    2566 projected.go:196] Error preparing data for projected volume kube-api-access-2lg2s for pod openshift-network-diagnostics/network-check-target-x5vjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:06.514759 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:06.514697    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s podName:38498cbc-be4a-4489-a927-0d38b32a8e53 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:10.514656818 +0000 UTC m=+10.208015075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2lg2s" (UniqueName: "kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s") pod "network-check-target-x5vjs" (UID: "38498cbc-be4a-4489-a927-0d38b32a8e53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:06.797188 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:06.797090    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:06.797342 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:06.797230    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:06.797740 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:06.797701    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:06.797863 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:06.797846    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:07.797624 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:07.797592    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:07.798151 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:07.797748    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:08.797894 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:08.797860    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:08.798346 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:08.797996    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:08.798508 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:08.798485    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:08.798639 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:08.798608    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:09.797505 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:09.797467    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:09.797672 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:09.797597    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:10.446779 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:10.446708    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs\") pod \"network-metrics-daemon-6rq2s\" (UID: \"3efa918d-27f0-4c41-912b-519868eaf758\") " pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:10.447265 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:10.446937    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:10.447265 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:10.447102    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:10.447265 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:10.447102    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:10.447265 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:10.447170    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret podName:010f1cce-27b5-4536-b7b9-9be0187fb5d6 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:18.447150723 +0000 UTC m=+18.140508996 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret") pod "global-pull-secret-syncer-j56vp" (UID: "010f1cce-27b5-4536-b7b9-9be0187fb5d6") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:10.447265 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:10.447208    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs podName:3efa918d-27f0-4c41-912b-519868eaf758 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:18.447195429 +0000 UTC m=+18.140553686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs") pod "network-metrics-daemon-6rq2s" (UID: "3efa918d-27f0-4c41-912b-519868eaf758") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:10.548246 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:10.548163    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lg2s\" (UniqueName: \"kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s\") pod \"network-check-target-x5vjs\" (UID: \"38498cbc-be4a-4489-a927-0d38b32a8e53\") " pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:10.548418 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:10.548326    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:43:10.548418 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:10.548346    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:43:10.548418 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:10.548360    2566 projected.go:196] Error preparing data for projected volume kube-api-access-2lg2s for pod openshift-network-diagnostics/network-check-target-x5vjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:10.548571 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:10.548420    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s podName:38498cbc-be4a-4489-a927-0d38b32a8e53 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:18.548403625 +0000 UTC m=+18.241761894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2lg2s" (UniqueName: "kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s") pod "network-check-target-x5vjs" (UID: "38498cbc-be4a-4489-a927-0d38b32a8e53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:10.798409 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:10.798213    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:10.798409 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:10.798330    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:10.798725 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:10.798706    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:10.798866 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:10.798844    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:11.798242 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:11.797657    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:11.798242 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:11.797864    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:12.797201 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:12.797154    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:12.797201 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:12.797174    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:12.797461 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:12.797295    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:12.797752 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:12.797709    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:13.797228 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:13.797190    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:13.797585 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:13.797313    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:14.796927 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:14.796898    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:14.797115 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:14.796898    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:14.797115 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:14.797025    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:14.797228 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:14.797116    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:15.797550 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:15.797519    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:15.798037 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:15.797643    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:16.797614 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:16.797577    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:16.798091 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:16.797622    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:16.798091 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:16.797814    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:16.798091 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:16.797809    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:17.797993 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:17.797956    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:17.798444 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:17.798107    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:18.513694 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:18.513650    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:18.513884 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:18.513725    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs\") pod \"network-metrics-daemon-6rq2s\" (UID: \"3efa918d-27f0-4c41-912b-519868eaf758\") " pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:18.513884 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:18.513857    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:18.513999 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:18.513861    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:18.513999 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:18.513942    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret podName:010f1cce-27b5-4536-b7b9-9be0187fb5d6 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:34.513919812 +0000 UTC m=+34.207278064 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret") pod "global-pull-secret-syncer-j56vp" (UID: "010f1cce-27b5-4536-b7b9-9be0187fb5d6") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:18.513999 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:18.513988    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs podName:3efa918d-27f0-4c41-912b-519868eaf758 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:34.513974506 +0000 UTC m=+34.207332764 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs") pod "network-metrics-daemon-6rq2s" (UID: "3efa918d-27f0-4c41-912b-519868eaf758") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:18.614259 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:18.614220    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lg2s\" (UniqueName: \"kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s\") pod \"network-check-target-x5vjs\" (UID: \"38498cbc-be4a-4489-a927-0d38b32a8e53\") " pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:18.614459 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:18.614431    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:43:18.614459 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:18.614458    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:43:18.614546 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:18.614472    2566 projected.go:196] Error preparing data for projected volume kube-api-access-2lg2s for pod openshift-network-diagnostics/network-check-target-x5vjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:18.614546 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:18.614536    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s podName:38498cbc-be4a-4489-a927-0d38b32a8e53 nodeName:}" failed. No retries permitted until 2026-07-10 22:43:34.614517037 +0000 UTC m=+34.307875308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2lg2s" (UniqueName: "kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s") pod "network-check-target-x5vjs" (UID: "38498cbc-be4a-4489-a927-0d38b32a8e53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:18.797256 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:18.797172    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:18.797425 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:18.797177    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:18.797425 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:18.797304    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:18.797425 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:18.797397    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:19.797689 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:19.797654    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:19.798239 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:19.797832    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:20.798219 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:20.798162    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:20.798692 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:20.798226    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:20.798692 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:20.798334    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:20.798692 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:20.798481    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:21.797822 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:21.797711    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:21.798023 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:21.797896    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:22.797116 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.796875    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:22.798012 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:22.797252    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:22.798012 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.796949    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:22.798012 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:22.797635    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:22.930013 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.929723    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz" event={"ID":"a5efd630-07b6-47cc-8534-d5d002f1d971","Type":"ContainerStarted","Data":"d72ea84695bfc2d02b5298bbe5bb4f6fc408bbd58a77123d1f9cb51dc0b1380a"}
Jul 10 22:43:22.933212 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.933183    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-58fkc" event={"ID":"6c80d1cd-1826-402a-85ba-8d5cd7082014","Type":"ContainerStarted","Data":"d38de4cbac4134076d3446948ebb9bd446ec1de6f8b5d2ede01ed64dc2b8ee75"}
Jul 10 22:43:22.934913 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.934868    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vhjz5" event={"ID":"851d6aef-2780-4f25-867c-14ba6fdace8c","Type":"ContainerStarted","Data":"a45ac2e0a198a250e7f725e9fab762554a7c3bfe9cc4c0f9427887c0c1ecba1a"}
Jul 10 22:43:22.936411 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.936376    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-btksg" event={"ID":"351fb14f-02ad-484c-aef1-e6a426502261","Type":"ContainerStarted","Data":"8654e924e5325d644c37a6930b175d9e77ddcb83e580efb015e2271997067f30"}
Jul 10 22:43:22.938033 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.938004    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fqm8t" event={"ID":"d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf","Type":"ContainerStarted","Data":"853cbe063a7f000493b0561fd4eefb60ddf5f04d5c3984bef60dceef99f62cb6"}
Jul 10 22:43:22.939647 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.939625    2566 generic.go:356] "Generic (PLEG): container finished" podID="bd433807-db54-456a-adf3-70a6912f8833" containerID="9320499cbedc65366434aaad48c99c127079325ae2f2e836b7b1c1d33775a623" exitCode=0
Jul 10 22:43:22.939754 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.939696    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gl9bt" event={"ID":"bd433807-db54-456a-adf3-70a6912f8833","Type":"ContainerDied","Data":"9320499cbedc65366434aaad48c99c127079325ae2f2e836b7b1c1d33775a623"}
Jul 10 22:43:22.941176 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.941146    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-85mnt" event={"ID":"1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2","Type":"ContainerStarted","Data":"c605529a15c3a3d4ab70676b25db3597986f2cfab2d01e19dd8b487b7b2a7d2c"}
Jul 10 22:43:22.943554 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.943533    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 22:43:22.943951 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.943925    2566 generic.go:356] "Generic (PLEG): container finished" podID="858194fe-333d-433b-a093-ba6f5b9af0ee" containerID="8e2c2aa8ad190b09a1682ee58f4f7a216b1652f90bf52257142a856e887c3b09" exitCode=1
Jul 10 22:43:22.944032 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.943967    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn" event={"ID":"858194fe-333d-433b-a093-ba6f5b9af0ee","Type":"ContainerStarted","Data":"3e94906032efcc33d7824f7bad8784cdc67ff76ccdaf67d6e964db72a107c26c"}
Jul 10 22:43:22.944099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.944039    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn" event={"ID":"858194fe-333d-433b-a093-ba6f5b9af0ee","Type":"ContainerStarted","Data":"f88a4d5cdec5083253607a7ca62d1f98e1f92f2422257b743e5cbf0a8dc4cb83"}
Jul 10 22:43:22.944099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.944091    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn" event={"ID":"858194fe-333d-433b-a093-ba6f5b9af0ee","Type":"ContainerDied","Data":"8e2c2aa8ad190b09a1682ee58f4f7a216b1652f90bf52257142a856e887c3b09"}
Jul 10 22:43:22.944184 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.944144    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn" event={"ID":"858194fe-333d-433b-a093-ba6f5b9af0ee","Type":"ContainerStarted","Data":"9173a99205ab2aaf51dbddbfd992f9a97157fc0f7c5951d7a1d9ce99ae919003"}
Jul 10 22:43:22.951872 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.951833    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-58fkc" podStartSLOduration=3.082190684 podStartE2EDuration="21.951819545s" totalImagesPullingTime="18.869628861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:22.951193452 +0000 UTC m=+22.644551727" watchObservedRunningTime="2026-07-10 22:43:22.951819545 +0000 UTC m=+22.645177822"
Jul 10 22:43:22.951968 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.951923    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-215.ec2.internal" podStartSLOduration=20.95191847 podStartE2EDuration="20.95191847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:43:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:05.905990183 +0000 UTC m=+5.599348460" watchObservedRunningTime="2026-07-10 22:43:22.95191847 +0000 UTC m=+22.645276745"
Jul 10 22:43:22.966628 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.966581    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fqm8t" podStartSLOduration=4.091928592 podStartE2EDuration="22.966563887s" totalImagesPullingTime="18.874635295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:22.966508235 +0000 UTC m=+22.659866511" watchObservedRunningTime="2026-07-10 22:43:22.966563887 +0000 UTC m=+22.659922162"
Jul 10 22:43:22.982711 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:22.982666    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vhjz5" podStartSLOduration=8.173611375 podStartE2EDuration="22.982649422s" totalImagesPullingTime="14.809038047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:22.982325974 +0000 UTC m=+22.675684251" watchObservedRunningTime="2026-07-10 22:43:22.982649422 +0000 UTC m=+22.676007697"
Jul 10 22:43:23.000331 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:23.000284    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-btksg" podStartSLOduration=2.780245903 podStartE2EDuration="22.000266758s" totalImagesPullingTime="19.220020855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:23.000185819 +0000 UTC m=+22.693544114" watchObservedRunningTime="2026-07-10 22:43:23.000266758 +0000 UTC m=+22.693625054"
Jul 10 22:43:23.797117 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:23.797036    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:23.797738 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:23.797191    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:23.949631 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:23.949603    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 22:43:23.950122 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:23.950089    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn" event={"ID":"858194fe-333d-433b-a093-ba6f5b9af0ee","Type":"ContainerStarted","Data":"eceb701e5f3b2bd16e6ffc6f185a38cc71869b405869223c1f3cfb54a949649b"}
Jul 10 22:43:23.950264 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:23.950188    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn" event={"ID":"858194fe-333d-433b-a093-ba6f5b9af0ee","Type":"ContainerStarted","Data":"e964038970f6473f6fd4008740701e325a1d5209387df8941306b444ced53b37"}
Jul 10 22:43:24.090915 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:24.090880    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vhjz5"
Jul 10 22:43:24.091666 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:24.091646    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vhjz5"
Jul 10 22:43:24.109912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:24.109866    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-85mnt" podStartSLOduration=4.209050182 podStartE2EDuration="23.109846824s" totalImagesPullingTime="18.900796642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:23.041004255 +0000 UTC m=+22.734362541" watchObservedRunningTime="2026-07-10 22:43:24.109846824 +0000 UTC m=+23.803205101"
Jul 10 22:43:24.193990 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:24.193959    2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 22:43:24.731537 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:24.731422    2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T22:43:24.193981686Z","UUID":"986f5e01-0a04-44b6-95a8-a5bde4945d2c","Handler":null,"Name":"","Endpoint":""}
Jul 10 22:43:24.733417 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:24.733392    2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 22:43:24.733544 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:24.733464    2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 22:43:24.797145 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:24.797108    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:24.797145 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:24.797126    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:24.797635 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:24.797246    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:24.797635 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:24.797356    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:24.954355 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:24.954120    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wtcvp" event={"ID":"8ca38ae3-c857-47a1-a3e9-08279a2e3a81","Type":"ContainerStarted","Data":"f56403eaf64d7ab64c8829cce4b14910b01d8bdd28b5ea9e95a0514a48b64382"}
Jul 10 22:43:24.956377 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:24.956343    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz" event={"ID":"a5efd630-07b6-47cc-8534-d5d002f1d971","Type":"ContainerStarted","Data":"14ae76cac78b3cbb34fe4ac18a027a724d367f972aac58f09dbc0b9e3a545e33"}
Jul 10 22:43:24.968433 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:24.968311    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wtcvp" podStartSLOduration=5.071344939 podStartE2EDuration="23.968288704s" totalImagesPullingTime="18.896943765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:24.968099264 +0000 UTC m=+24.661457540" watchObservedRunningTime="2026-07-10 22:43:24.968288704 +0000 UTC m=+24.661646983"
Jul 10 22:43:25.797023 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:25.796833    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:25.797212 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:25.797112    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:25.963064 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:25.963034    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 22:43:25.963470 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:25.963436    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn" event={"ID":"858194fe-333d-433b-a093-ba6f5b9af0ee","Type":"ContainerStarted","Data":"aec4b47ba00266bbd1b8402f395e2ce52d5fea953956cf2a2a471899f6a12a22"}
Jul 10 22:43:25.965641 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:25.965607    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz" event={"ID":"a5efd630-07b6-47cc-8534-d5d002f1d971","Type":"ContainerStarted","Data":"ae66ba0c134b91d36f05d11dd3ddcecdc3c7f29d010b3e5485c162eb7c931692"}
Jul 10 22:43:25.965842 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:25.965825    2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 10 22:43:25.983326 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:25.983272    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jj7kz" podStartSLOduration=4.832460823 podStartE2EDuration="25.9832556s" totalImagesPullingTime="21.150794777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:43:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:25.983232527 +0000 UTC m=+25.676590795" watchObservedRunningTime="2026-07-10 22:43:25.9832556 +0000 UTC m=+25.676613869"
Jul 10 22:43:26.115891 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:26.115808    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vhjz5"
Jul 10 22:43:26.116566 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:26.116535    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vhjz5"
Jul 10 22:43:26.797492 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:26.797454    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:26.797492 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:26.797501    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:26.798133 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:26.797604    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:26.798133 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:26.797743    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:27.797723 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:27.797540    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:27.798361 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:27.797821    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:27.971808 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:27.971668    2566 generic.go:356] "Generic (PLEG): container finished" podID="bd433807-db54-456a-adf3-70a6912f8833" containerID="a60579d740d78a07a433df3ded04f5222be0af5689f55f943666009589dcc7ca" exitCode=0
Jul 10 22:43:27.971808 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:27.971778    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gl9bt" event={"ID":"bd433807-db54-456a-adf3-70a6912f8833","Type":"ContainerDied","Data":"a60579d740d78a07a433df3ded04f5222be0af5689f55f943666009589dcc7ca"}
Jul 10 22:43:27.975452 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:27.975435    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 22:43:27.975810 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:27.975790    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn" event={"ID":"858194fe-333d-433b-a093-ba6f5b9af0ee","Type":"ContainerStarted","Data":"a98e267b18792dbc9c6d9d805084ead40af5f6eef789e0c501f7e11c7bc8cc23"}
Jul 10 22:43:27.976281 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:27.976268    2566 scope.go:117] "RemoveContainer" containerID="8e2c2aa8ad190b09a1682ee58f4f7a216b1652f90bf52257142a856e887c3b09"
Jul 10 22:43:28.797400 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:28.797363    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:28.797400 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:28.797401    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:28.797603 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:28.797497    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:28.797603 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:28.797580    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:28.981662 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:28.981638    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 22:43:28.982161 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:28.982005    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn" event={"ID":"858194fe-333d-433b-a093-ba6f5b9af0ee","Type":"ContainerStarted","Data":"7e6d13b6642fac5032134af103a82e6bde64bae6f71aadb9d401dba0151d8629"}
Jul 10 22:43:28.982225 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:28.982197    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:28.982278 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:28.982249    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:28.982329 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:28.982291    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:28.997535 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:28.997510    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:29.000275 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:28.997969    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:43:29.010111 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:29.010061    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn" podStartSLOduration=9.106712828 podStartE2EDuration="28.010047202s" totalImagesPullingTime="18.903334374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:29.009865242 +0000 UTC m=+28.703223517" watchObservedRunningTime="2026-07-10 22:43:29.010047202 +0000 UTC m=+28.703405478"
Jul 10 22:43:29.796908 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:29.796867    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:29.797134 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:29.797005    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:29.986657 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:29.986624    2566 generic.go:356] "Generic (PLEG): container finished" podID="bd433807-db54-456a-adf3-70a6912f8833" containerID="21db5f6a20c590d5e9d2b07886d71650d4cf04292946c5c5cb7613f4d486c65b" exitCode=0
Jul 10 22:43:29.987118 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:29.986708    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gl9bt" event={"ID":"bd433807-db54-456a-adf3-70a6912f8833","Type":"ContainerDied","Data":"21db5f6a20c590d5e9d2b07886d71650d4cf04292946c5c5cb7613f4d486c65b"}
Jul 10 22:43:30.634097 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:30.634062    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6rq2s"]
Jul 10 22:43:30.634270 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:30.634254    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:30.634661 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:30.634444    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:30.634905 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:30.634884    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j56vp"]
Jul 10 22:43:30.635000 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:30.634990    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:30.635111 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:30.635088    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:30.635504 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:30.635481    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x5vjs"]
Jul 10 22:43:30.635590 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:30.635574    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:30.635674 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:30.635656    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:30.991533 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:30.991306    2566 generic.go:356] "Generic (PLEG): container finished" podID="bd433807-db54-456a-adf3-70a6912f8833" containerID="ccc3e4016411ae934498b48d46fcb713341936821cad0497bc2b5601aab74bfb" exitCode=0
Jul 10 22:43:30.991930 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:30.991390    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gl9bt" event={"ID":"bd433807-db54-456a-adf3-70a6912f8833","Type":"ContainerDied","Data":"ccc3e4016411ae934498b48d46fcb713341936821cad0497bc2b5601aab74bfb"}
Jul 10 22:43:32.801271 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:32.801241    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:32.801919 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:32.801346    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:32.801919 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:32.801477    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:32.801919 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:32.801527    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:32.801919 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:32.801605    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:32.801919 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:32.801688    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:34.532665 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:34.532621    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:34.533217 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:34.532682    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs\") pod \"network-metrics-daemon-6rq2s\" (UID: \"3efa918d-27f0-4c41-912b-519868eaf758\") " pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:34.533217 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:34.532804    2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:34.533217 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:34.532812    2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:34.533217 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:34.532878    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret podName:010f1cce-27b5-4536-b7b9-9be0187fb5d6 nodeName:}" failed. No retries permitted until 2026-07-10 22:44:06.532857065 +0000 UTC m=+66.226215340 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret") pod "global-pull-secret-syncer-j56vp" (UID: "010f1cce-27b5-4536-b7b9-9be0187fb5d6") : object "kube-system"/"original-pull-secret" not registered
Jul 10 22:43:34.533217 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:34.532901    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs podName:3efa918d-27f0-4c41-912b-519868eaf758 nodeName:}" failed. No retries permitted until 2026-07-10 22:44:06.532890442 +0000 UTC m=+66.226248697 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs") pod "network-metrics-daemon-6rq2s" (UID: "3efa918d-27f0-4c41-912b-519868eaf758") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 22:43:34.633805 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:34.633750    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lg2s\" (UniqueName: \"kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s\") pod \"network-check-target-x5vjs\" (UID: \"38498cbc-be4a-4489-a927-0d38b32a8e53\") " pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:34.633974 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:34.633922    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 22:43:34.633974 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:34.633952    2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 22:43:34.633974 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:34.633965    2566 projected.go:196] Error preparing data for projected volume kube-api-access-2lg2s for pod openshift-network-diagnostics/network-check-target-x5vjs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:34.634087 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:34.634031    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s podName:38498cbc-be4a-4489-a927-0d38b32a8e53 nodeName:}" failed. No retries permitted until 2026-07-10 22:44:06.634011422 +0000 UTC m=+66.327369687 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2lg2s" (UniqueName: "kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s") pod "network-check-target-x5vjs" (UID: "38498cbc-be4a-4489-a927-0d38b32a8e53") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 22:43:34.800455 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:34.800379    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:34.800706 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:34.800499    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:34.800706 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:34.800515    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rq2s" podUID="3efa918d-27f0-4c41-912b-519868eaf758"
Jul 10 22:43:34.800706 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:34.800526    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:34.800706 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:34.800584    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j56vp" podUID="010f1cce-27b5-4536-b7b9-9be0187fb5d6"
Jul 10 22:43:34.800706 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:34.800657    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x5vjs" podUID="38498cbc-be4a-4489-a927-0d38b32a8e53"
Jul 10 22:43:35.621035 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.621005    2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-215.ec2.internal" event="NodeReady"
Jul 10 22:43:35.621557 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.621137    2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 22:43:35.654135 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.654104    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59f78bd545-p6q49"]
Jul 10 22:43:35.656969 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.656944    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.659211 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.659190    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 22:43:35.659407 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.659375    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 22:43:35.659560 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.659543    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zw2wb\""
Jul 10 22:43:35.659609 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.659590    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 22:43:35.665249 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.665228    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2lsjh"]
Jul 10 22:43:35.666339 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.666321    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 22:43:35.668241 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.668227    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.670734 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.670714    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9cmwm"]
Jul 10 22:43:35.671217 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.671195    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-spbmt\""
Jul 10 22:43:35.671742 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.671526    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 22:43:35.671742 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.671550    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 22:43:35.671742 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.671599    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 22:43:35.671742 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.671632    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 22:43:35.673948 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.673929    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f78bd545-p6q49"]
Jul 10 22:43:35.674055 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.674016    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:35.679086 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.679063    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j4q74\""
Jul 10 22:43:35.679213 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.679061    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 22:43:35.679213 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.679122    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 22:43:35.683654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.683630    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2lsjh"]
Jul 10 22:43:35.685960 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.685940    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9cmwm"]
Jul 10 22:43:35.742084 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742052    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34ed569e-239a-4853-8031-a3358e2d1c15-trusted-ca\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.742084 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742087    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c99b28af-3d79-4e40-9921-fb05ce03d720-crio-socket\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.742301 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742113    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99b28af-3d79-4e40-9921-fb05ce03d720-data-volume\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.742301 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742142    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhdd5\" (UniqueName: \"kubernetes.io/projected/34ed569e-239a-4853-8031-a3358e2d1c15-kube-api-access-jhdd5\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.742301 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742213    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34ed569e-239a-4853-8031-a3358e2d1c15-registry-tls\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.742301 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742239    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvzq8\" (UniqueName: \"kubernetes.io/projected/c99b28af-3d79-4e40-9921-fb05ce03d720-kube-api-access-tvzq8\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.742301 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742265    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34ed569e-239a-4853-8031-a3358e2d1c15-bound-sa-token\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.742301 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742288    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4532fa7b-76be-4b64-93f8-b35e2f436878-metrics-tls\") pod \"dns-default-9cmwm\" (UID: \"4532fa7b-76be-4b64-93f8-b35e2f436878\") " pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:35.742574 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742305    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34ed569e-239a-4853-8031-a3358e2d1c15-ca-trust-extracted\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.742574 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742354    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34ed569e-239a-4853-8031-a3358e2d1c15-registry-certificates\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.742574 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742389    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4532fa7b-76be-4b64-93f8-b35e2f436878-config-volume\") pod \"dns-default-9cmwm\" (UID: \"4532fa7b-76be-4b64-93f8-b35e2f436878\") " pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:35.742574 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742404    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34ed569e-239a-4853-8031-a3358e2d1c15-installation-pull-secrets\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.742574 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742421    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4532fa7b-76be-4b64-93f8-b35e2f436878-tmp-dir\") pod \"dns-default-9cmwm\" (UID: \"4532fa7b-76be-4b64-93f8-b35e2f436878\") " pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:35.742574 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742448    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgzm7\" (UniqueName: \"kubernetes.io/projected/4532fa7b-76be-4b64-93f8-b35e2f436878-kube-api-access-wgzm7\") pod \"dns-default-9cmwm\" (UID: \"4532fa7b-76be-4b64-93f8-b35e2f436878\") " pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:35.742574 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742477    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34ed569e-239a-4853-8031-a3358e2d1c15-image-registry-private-configuration\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.742574 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742496    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c99b28af-3d79-4e40-9921-fb05ce03d720-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.742574 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.742517    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c99b28af-3d79-4e40-9921-fb05ce03d720-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.768440 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.768404    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sq52g"]
Jul 10 22:43:35.771020 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.770998    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sq52g"
Jul 10 22:43:35.773357 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.773333    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 22:43:35.773482 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.773382    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d7gcw\""
Jul 10 22:43:35.773671 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.773656    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 22:43:35.773843 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.773755    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 22:43:35.779573 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.779552    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sq52g"]
Jul 10 22:43:35.843061 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843025    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4532fa7b-76be-4b64-93f8-b35e2f436878-config-volume\") pod \"dns-default-9cmwm\" (UID: \"4532fa7b-76be-4b64-93f8-b35e2f436878\") " pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:35.843239 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843064    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34ed569e-239a-4853-8031-a3358e2d1c15-installation-pull-secrets\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.843239 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843092    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4532fa7b-76be-4b64-93f8-b35e2f436878-tmp-dir\") pod \"dns-default-9cmwm\" (UID: \"4532fa7b-76be-4b64-93f8-b35e2f436878\") " pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:35.843239 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843114    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgzm7\" (UniqueName: \"kubernetes.io/projected/4532fa7b-76be-4b64-93f8-b35e2f436878-kube-api-access-wgzm7\") pod \"dns-default-9cmwm\" (UID: \"4532fa7b-76be-4b64-93f8-b35e2f436878\") " pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:35.843239 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843137    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34ed569e-239a-4853-8031-a3358e2d1c15-image-registry-private-configuration\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.843239 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843160    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c99b28af-3d79-4e40-9921-fb05ce03d720-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.843239 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843187    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c99b28af-3d79-4e40-9921-fb05ce03d720-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.843239 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843213    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34ed569e-239a-4853-8031-a3358e2d1c15-trusted-ca\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.843239 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843238    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c99b28af-3d79-4e40-9921-fb05ce03d720-crio-socket\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.843623 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843265    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99b28af-3d79-4e40-9921-fb05ce03d720-data-volume\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.843623 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843298    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhdd5\" (UniqueName: \"kubernetes.io/projected/34ed569e-239a-4853-8031-a3358e2d1c15-kube-api-access-jhdd5\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.843623 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843335    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34ed569e-239a-4853-8031-a3358e2d1c15-registry-tls\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.843623 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843359    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvzq8\" (UniqueName: \"kubernetes.io/projected/c99b28af-3d79-4e40-9921-fb05ce03d720-kube-api-access-tvzq8\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.843623 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843386    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34ed569e-239a-4853-8031-a3358e2d1c15-bound-sa-token\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.843623 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843415    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60050627-b76e-41d3-bc89-328d6c4c12bd-cert\") pod \"ingress-canary-sq52g\" (UID: \"60050627-b76e-41d3-bc89-328d6c4c12bd\") " pod="openshift-ingress-canary/ingress-canary-sq52g"
Jul 10 22:43:35.843623 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843449    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4532fa7b-76be-4b64-93f8-b35e2f436878-metrics-tls\") pod \"dns-default-9cmwm\" (UID: \"4532fa7b-76be-4b64-93f8-b35e2f436878\") " pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:35.843623 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843471    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4532fa7b-76be-4b64-93f8-b35e2f436878-tmp-dir\") pod \"dns-default-9cmwm\" (UID: \"4532fa7b-76be-4b64-93f8-b35e2f436878\") " pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:35.843623 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843475    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34ed569e-239a-4853-8031-a3358e2d1c15-ca-trust-extracted\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.843623 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843542    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34ed569e-239a-4853-8031-a3358e2d1c15-registry-certificates\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.843623 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843575    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvl76\" (UniqueName: \"kubernetes.io/projected/60050627-b76e-41d3-bc89-328d6c4c12bd-kube-api-access-rvl76\") pod \"ingress-canary-sq52g\" (UID: \"60050627-b76e-41d3-bc89-328d6c4c12bd\") " pod="openshift-ingress-canary/ingress-canary-sq52g"
Jul 10 22:43:35.844201 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843739    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4532fa7b-76be-4b64-93f8-b35e2f436878-config-volume\") pod \"dns-default-9cmwm\" (UID: \"4532fa7b-76be-4b64-93f8-b35e2f436878\") " pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:35.844201 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843938    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34ed569e-239a-4853-8031-a3358e2d1c15-ca-trust-extracted\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.844201 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.843972    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c99b28af-3d79-4e40-9921-fb05ce03d720-data-volume\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.844201 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.844123    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c99b28af-3d79-4e40-9921-fb05ce03d720-crio-socket\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.844390 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.844331    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c99b28af-3d79-4e40-9921-fb05ce03d720-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.844631 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.844609    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34ed569e-239a-4853-8031-a3358e2d1c15-registry-certificates\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.844810 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.844790    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34ed569e-239a-4853-8031-a3358e2d1c15-trusted-ca\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.848021 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.847905    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c99b28af-3d79-4e40-9921-fb05ce03d720-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.848021 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.848017    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34ed569e-239a-4853-8031-a3358e2d1c15-image-registry-private-configuration\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.848160 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.848025    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34ed569e-239a-4853-8031-a3358e2d1c15-registry-tls\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.848160 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.847957    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34ed569e-239a-4853-8031-a3358e2d1c15-installation-pull-secrets\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.848227 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.848166    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4532fa7b-76be-4b64-93f8-b35e2f436878-metrics-tls\") pod \"dns-default-9cmwm\" (UID: \"4532fa7b-76be-4b64-93f8-b35e2f436878\") " pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:35.851499 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.851474    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34ed569e-239a-4853-8031-a3358e2d1c15-bound-sa-token\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.851987 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.851972    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvzq8\" (UniqueName: \"kubernetes.io/projected/c99b28af-3d79-4e40-9921-fb05ce03d720-kube-api-access-tvzq8\") pod \"insights-runtime-extractor-2lsjh\" (UID: \"c99b28af-3d79-4e40-9921-fb05ce03d720\") " pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.852042 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.852022    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhdd5\" (UniqueName: \"kubernetes.io/projected/34ed569e-239a-4853-8031-a3358e2d1c15-kube-api-access-jhdd5\") pod \"image-registry-59f78bd545-p6q49\" (UID: \"34ed569e-239a-4853-8031-a3358e2d1c15\") " pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.852486 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.852467    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgzm7\" (UniqueName: \"kubernetes.io/projected/4532fa7b-76be-4b64-93f8-b35e2f436878-kube-api-access-wgzm7\") pod \"dns-default-9cmwm\" (UID: \"4532fa7b-76be-4b64-93f8-b35e2f436878\") " pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:35.943976 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.943892    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvl76\" (UniqueName: \"kubernetes.io/projected/60050627-b76e-41d3-bc89-328d6c4c12bd-kube-api-access-rvl76\") pod \"ingress-canary-sq52g\" (UID: \"60050627-b76e-41d3-bc89-328d6c4c12bd\") " pod="openshift-ingress-canary/ingress-canary-sq52g"
Jul 10 22:43:35.943976 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.943970    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60050627-b76e-41d3-bc89-328d6c4c12bd-cert\") pod \"ingress-canary-sq52g\" (UID: \"60050627-b76e-41d3-bc89-328d6c4c12bd\") " pod="openshift-ingress-canary/ingress-canary-sq52g"
Jul 10 22:43:35.946214 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.946197    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60050627-b76e-41d3-bc89-328d6c4c12bd-cert\") pod \"ingress-canary-sq52g\" (UID: \"60050627-b76e-41d3-bc89-328d6c4c12bd\") " pod="openshift-ingress-canary/ingress-canary-sq52g"
Jul 10 22:43:35.953125 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.953091    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvl76\" (UniqueName: \"kubernetes.io/projected/60050627-b76e-41d3-bc89-328d6c4c12bd-kube-api-access-rvl76\") pod \"ingress-canary-sq52g\" (UID: \"60050627-b76e-41d3-bc89-328d6c4c12bd\") " pod="openshift-ingress-canary/ingress-canary-sq52g"
Jul 10 22:43:35.966937 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.966909    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:35.980484 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.980462    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2lsjh"
Jul 10 22:43:35.987465 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:35.987439    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:36.008867 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.008831    2566 generic.go:356] "Generic (PLEG): container finished" podID="bd433807-db54-456a-adf3-70a6912f8833" containerID="f92bfd4060c680648029384f00533b88ad186857e12cad91d1a612974f99b89c" exitCode=0
Jul 10 22:43:36.009019 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.008908    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gl9bt" event={"ID":"bd433807-db54-456a-adf3-70a6912f8833","Type":"ContainerDied","Data":"f92bfd4060c680648029384f00533b88ad186857e12cad91d1a612974f99b89c"}
Jul 10 22:43:36.079749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.079705    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sq52g"
Jul 10 22:43:36.155312 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.154624    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59f78bd545-p6q49"]
Jul 10 22:43:36.159864 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.159470    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2lsjh"]
Jul 10 22:43:36.170330 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.170301    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9cmwm"]
Jul 10 22:43:36.232398 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.232297    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sq52g"]
Jul 10 22:43:36.236362 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:36.236329    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ed569e_239a_4853_8031_a3358e2d1c15.slice/crio-701edb1203ed817ebf41d8a95461b8d687b35493a9fd5bdfcc7526708d7eab01 WatchSource:0}: Error finding container 701edb1203ed817ebf41d8a95461b8d687b35493a9fd5bdfcc7526708d7eab01: Status 404 returned error can't find the container with id 701edb1203ed817ebf41d8a95461b8d687b35493a9fd5bdfcc7526708d7eab01
Jul 10 22:43:36.237021 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:36.236991    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4532fa7b_76be_4b64_93f8_b35e2f436878.slice/crio-e489a5a1df1cbe126cc1f2611ebb3cfca646b543f02a3bb665e5020f41cba71c WatchSource:0}: Error finding container e489a5a1df1cbe126cc1f2611ebb3cfca646b543f02a3bb665e5020f41cba71c: Status 404 returned error can't find the container with id e489a5a1df1cbe126cc1f2611ebb3cfca646b543f02a3bb665e5020f41cba71c
Jul 10 22:43:36.237288 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:36.237266    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99b28af_3d79_4e40_9921_fb05ce03d720.slice/crio-8a56f7a5741d3f9bbbdc9f919e1634a15a5f539bdd41c06c8cd9c1e88d993d13 WatchSource:0}: Error finding container 8a56f7a5741d3f9bbbdc9f919e1634a15a5f539bdd41c06c8cd9c1e88d993d13: Status 404 returned error can't find the container with id 8a56f7a5741d3f9bbbdc9f919e1634a15a5f539bdd41c06c8cd9c1e88d993d13
Jul 10 22:43:36.238388 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:36.238361    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60050627_b76e_41d3_bc89_328d6c4c12bd.slice/crio-37aa31d2b95b8fb96efa94f7c1d69fe96bf608d86352a7d0352a34da1ba0569f WatchSource:0}: Error finding container 37aa31d2b95b8fb96efa94f7c1d69fe96bf608d86352a7d0352a34da1ba0569f: Status 404 returned error can't find the container with id 37aa31d2b95b8fb96efa94f7c1d69fe96bf608d86352a7d0352a34da1ba0569f
Jul 10 22:43:36.800821 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.796906    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:43:36.800821 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.797667    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:43:36.800821 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.798158    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:43:36.803220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.803197    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 22:43:36.803746 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.803725    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 22:43:36.809848 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.805915    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vx2kj\""
Jul 10 22:43:36.809848 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.806292    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 22:43:36.809848 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.807233    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 22:43:36.809848 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:36.807620    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wwzq4\""
Jul 10 22:43:37.016876 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:37.016670    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sq52g" event={"ID":"60050627-b76e-41d3-bc89-328d6c4c12bd","Type":"ContainerStarted","Data":"37aa31d2b95b8fb96efa94f7c1d69fe96bf608d86352a7d0352a34da1ba0569f"}
Jul 10 22:43:37.022054 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:37.022020    2566 generic.go:356] "Generic (PLEG): container finished" podID="bd433807-db54-456a-adf3-70a6912f8833" containerID="19951ee4db5b984a0eeefa3a6221a1e741265422dccaaa08f27b78ac26d4734a" exitCode=0
Jul 10 22:43:37.022223 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:37.022106    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gl9bt" event={"ID":"bd433807-db54-456a-adf3-70a6912f8833","Type":"ContainerDied","Data":"19951ee4db5b984a0eeefa3a6221a1e741265422dccaaa08f27b78ac26d4734a"}
Jul 10 22:43:37.025105 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:37.025015    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9cmwm" event={"ID":"4532fa7b-76be-4b64-93f8-b35e2f436878","Type":"ContainerStarted","Data":"e489a5a1df1cbe126cc1f2611ebb3cfca646b543f02a3bb665e5020f41cba71c"}
Jul 10 22:43:37.027528 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:37.027445    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2lsjh" event={"ID":"c99b28af-3d79-4e40-9921-fb05ce03d720","Type":"ContainerStarted","Data":"8a56f7a5741d3f9bbbdc9f919e1634a15a5f539bdd41c06c8cd9c1e88d993d13"}
Jul 10 22:43:37.034122 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:37.034095    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f78bd545-p6q49" event={"ID":"34ed569e-239a-4853-8031-a3358e2d1c15","Type":"ContainerStarted","Data":"cee55eff1ca3462750735b6ffc1a035a4da5ce2181df68efa0b55211dab61052"}
Jul 10 22:43:37.034242 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:37.034146    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59f78bd545-p6q49" event={"ID":"34ed569e-239a-4853-8031-a3358e2d1c15","Type":"ContainerStarted","Data":"701edb1203ed817ebf41d8a95461b8d687b35493a9fd5bdfcc7526708d7eab01"}
Jul 10 22:43:37.034302 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:37.034270    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:37.066459 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:37.066335    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59f78bd545-p6q49" podStartSLOduration=8.066314343 podStartE2EDuration="8.066314343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:43:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:37.066060629 +0000 UTC m=+36.759418930" watchObservedRunningTime="2026-07-10 22:43:37.066314343 +0000 UTC m=+36.759672613"
Jul 10 22:43:38.043505 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:38.043467    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gl9bt" event={"ID":"bd433807-db54-456a-adf3-70a6912f8833","Type":"ContainerStarted","Data":"6f6838d5ba2dfbcdd14c24958783f8903b6e9af0da6bb3aab9860aff31603b40"}
Jul 10 22:43:38.066669 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:38.066427    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gl9bt" podStartSLOduration=8.679092246 podStartE2EDuration="38.066407601s" totalImagesPullingTime="29.387315355s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:43:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:38.064553372 +0000 UTC m=+37.757911646" watchObservedRunningTime="2026-07-10 22:43:38.066407601 +0000 UTC m=+37.759765880"
Jul 10 22:43:42.913939 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:42.913908    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f485"]
Jul 10 22:43:42.938437 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:42.938409    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f485"]
Jul 10 22:43:42.938576 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:42.938521    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f485"
Jul 10 22:43:42.944650 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:42.944628    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ct7k8\""
Jul 10 22:43:42.944790 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:42.944746    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 10 22:43:43.062726 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:43.062688    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9cmwm" event={"ID":"4532fa7b-76be-4b64-93f8-b35e2f436878","Type":"ContainerStarted","Data":"8b9dc64b5f94f2410dc661d9a7296a5b3152f1a9f8c3bf1b1132979be76323bb"}
Jul 10 22:43:43.062925 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:43.062809    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:43.062925 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:43.062839    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9cmwm" event={"ID":"4532fa7b-76be-4b64-93f8-b35e2f436878","Type":"ContainerStarted","Data":"b3044ef327befe74d8f0cb2603289e0047da4266d5cfd2932ed188e88749f590"}
Jul 10 22:43:43.064484 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:43.064459    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2lsjh" event={"ID":"c99b28af-3d79-4e40-9921-fb05ce03d720","Type":"ContainerStarted","Data":"d1d45b1425b05611029c610ff505306080473944047e70900f4777bc086d8d86"}
Jul 10 22:43:43.066194 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:43.066168    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sq52g" event={"ID":"60050627-b76e-41d3-bc89-328d6c4c12bd","Type":"ContainerStarted","Data":"58d9ca4775ba3fa5d890ad0fc8f6a5d32f3cca154df4f4c1a270ffbd0a69befa"}
Jul 10 22:43:43.083558 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:43.083512    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9cmwm" podStartSLOduration=2.129502381 podStartE2EDuration="8.08349684s" totalImagesPullingTime="5.953994459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:43.083119495 +0000 UTC m=+42.776477771" watchObservedRunningTime="2026-07-10 22:43:43.08349684 +0000 UTC m=+42.776855107"
Jul 10 22:43:43.106222 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:43.106171    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sq52g" podStartSLOduration=2.146860541 podStartE2EDuration="8.106154494s" totalImagesPullingTime="5.959293953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:43.105592536 +0000 UTC m=+42.798950814" watchObservedRunningTime="2026-07-10 22:43:43.106154494 +0000 UTC m=+42.799512768"
Jul 10 22:43:43.107827 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:43.107802    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f46f123f-a9ca-4a39-ae80-0a2e4852c906-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-9f485\" (UID: \"f46f123f-a9ca-4a39-ae80-0a2e4852c906\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f485"
Jul 10 22:43:43.209246 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:43.209166    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f46f123f-a9ca-4a39-ae80-0a2e4852c906-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-9f485\" (UID: \"f46f123f-a9ca-4a39-ae80-0a2e4852c906\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f485"
Jul 10 22:43:43.213183 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:43.213158    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f46f123f-a9ca-4a39-ae80-0a2e4852c906-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-9f485\" (UID: \"f46f123f-a9ca-4a39-ae80-0a2e4852c906\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f485"
Jul 10 22:43:43.246844 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:43.246811    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f485"
Jul 10 22:43:43.419898 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:43.419865    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f485"]
Jul 10 22:43:43.424428 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:43.424404    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46f123f_a9ca_4a39_ae80_0a2e4852c906.slice/crio-c04c99a19ea45a2d52fb9605e0b448a1b07a8407b80da246dbb6e663167b3068 WatchSource:0}: Error finding container c04c99a19ea45a2d52fb9605e0b448a1b07a8407b80da246dbb6e663167b3068: Status 404 returned error can't find the container with id c04c99a19ea45a2d52fb9605e0b448a1b07a8407b80da246dbb6e663167b3068
Jul 10 22:43:44.070912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:44.070827    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f485" event={"ID":"f46f123f-a9ca-4a39-ae80-0a2e4852c906","Type":"ContainerStarted","Data":"c04c99a19ea45a2d52fb9605e0b448a1b07a8407b80da246dbb6e663167b3068"}
Jul 10 22:43:44.072629 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:44.072599    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2lsjh" event={"ID":"c99b28af-3d79-4e40-9921-fb05ce03d720","Type":"ContainerStarted","Data":"0d192aa384c40184ce20c0bff91750529a282aae4a80905d67ac6714d8327151"}
Jul 10 22:43:46.081971 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:46.081930    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f485" event={"ID":"f46f123f-a9ca-4a39-ae80-0a2e4852c906","Type":"ContainerStarted","Data":"12adb7eb213b764a94bccee32918843a9491aee482b481b3704bb7b4e05f59f7"}
Jul 10 22:43:46.082468 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:46.082159    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f485"
Jul 10 22:43:46.087627 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:46.087602    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f485"
Jul 10 22:43:46.098357 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:46.098274    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f485" podStartSLOduration=2.333489902 podStartE2EDuration="4.098251656s" totalImagesPullingTime="1.764761754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:43:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:46.097005339 +0000 UTC m=+45.790363614" watchObservedRunningTime="2026-07-10 22:43:46.098251656 +0000 UTC m=+45.791609932"
Jul 10 22:43:47.088615 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:47.088577    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2lsjh" event={"ID":"c99b28af-3d79-4e40-9921-fb05ce03d720","Type":"ContainerStarted","Data":"9cac4ce6be597c2e11f4d590cbefb30cd40bacd9d40c5104db73510264f3be8f"}
Jul 10 22:43:47.106273 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:47.106207    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2lsjh" podStartSLOduration=1.631922677 podStartE2EDuration="12.10618844s" totalImagesPullingTime="10.474265763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:43:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:47.105666556 +0000 UTC m=+46.799024869" watchObservedRunningTime="2026-07-10 22:43:47.10618844 +0000 UTC m=+46.799546716"
Jul 10 22:43:51.302099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.302067    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"]
Jul 10 22:43:51.316785 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.316732    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rdqpv"]
Jul 10 22:43:51.316938 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.316841    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.319264 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.319243    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 22:43:51.319389 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.319326    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-v8vnh\""
Jul 10 22:43:51.320291 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.320269    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 10 22:43:51.320384 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.320319    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 10 22:43:51.320459 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.320445    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 22:43:51.320510 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.320456    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 10 22:43:51.320567 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.320552    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 22:43:51.324998 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.324978    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.327587 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.327569    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jwtnd\""
Jul 10 22:43:51.327695 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.327620    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 22:43:51.327835 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.327819    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 22:43:51.327920 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.327903    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 22:43:51.331784 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.331746    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"]
Jul 10 22:43:51.465570 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.465531    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-textfile\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.465570 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.465568    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-wtmp\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.465827 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.465589    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.465827 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.465633    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c780dbf8-77f6-43b0-b0fd-5b682c281fda-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.465827 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.465678    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5bb25c3-c5e8-486a-8e50-577262e99b9a-sys\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.465827 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.465727    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x64xh\" (UniqueName: \"kubernetes.io/projected/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-api-access-x64xh\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.465827 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.465756    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.465827 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.465815    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c780dbf8-77f6-43b0-b0fd-5b682c281fda-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.466039 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.465832    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.466039 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.465859    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5bb25c3-c5e8-486a-8e50-577262e99b9a-metrics-client-ca\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.466039 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.465893    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.466039 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.465947    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.466039 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.465999    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-tls\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.466039 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.466015    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5bb25c3-c5e8-486a-8e50-577262e99b9a-root\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.466224 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.466042    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjsx6\" (UniqueName: \"kubernetes.io/projected/d5bb25c3-c5e8-486a-8e50-577262e99b9a-kube-api-access-gjsx6\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.567076 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.566982    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.567076 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567035    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c780dbf8-77f6-43b0-b0fd-5b682c281fda-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.567261 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567089    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.567261 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567131    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5bb25c3-c5e8-486a-8e50-577262e99b9a-metrics-client-ca\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.567261 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567159    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.567261 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567189    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.567261 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567251    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-tls\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.567491 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567269    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5bb25c3-c5e8-486a-8e50-577262e99b9a-root\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.567491 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567309    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjsx6\" (UniqueName: \"kubernetes.io/projected/d5bb25c3-c5e8-486a-8e50-577262e99b9a-kube-api-access-gjsx6\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.567491 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567343    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-textfile\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.567491 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567369    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-wtmp\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.567491 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567391    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.567491 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567428    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c780dbf8-77f6-43b0-b0fd-5b682c281fda-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.567491 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567447    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c780dbf8-77f6-43b0-b0fd-5b682c281fda-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.568020 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567503    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5bb25c3-c5e8-486a-8e50-577262e99b9a-root\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.568020 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567510    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5bb25c3-c5e8-486a-8e50-577262e99b9a-sys\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.568020 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567453    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5bb25c3-c5e8-486a-8e50-577262e99b9a-sys\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.568020 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567557    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x64xh\" (UniqueName: \"kubernetes.io/projected/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-api-access-x64xh\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.568020 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567950    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5bb25c3-c5e8-486a-8e50-577262e99b9a-metrics-client-ca\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.568020 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.567983    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.568333 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:51.568070    2566 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 10 22:43:51.568333 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.568102    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-wtmp\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.568333 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:51.568139    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-state-metrics-tls podName:c780dbf8-77f6-43b0-b0fd-5b682c281fda nodeName:}" failed. No retries permitted until 2026-07-10 22:43:52.068118814 +0000 UTC m=+51.761477088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-qxhv2" (UID: "c780dbf8-77f6-43b0-b0fd-5b682c281fda") : secret "kube-state-metrics-tls" not found
Jul 10 22:43:51.568333 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.568200    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-textfile\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.568502 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.568365    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.568502 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.568479    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c780dbf8-77f6-43b0-b0fd-5b682c281fda-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.569867 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.569846    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.569934 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.569865    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-tls\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.570065 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.570049    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5bb25c3-c5e8-486a-8e50-577262e99b9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.577086 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.577057    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x64xh\" (UniqueName: \"kubernetes.io/projected/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-api-access-x64xh\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:51.577086 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.577068    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjsx6\" (UniqueName: \"kubernetes.io/projected/d5bb25c3-c5e8-486a-8e50-577262e99b9a-kube-api-access-gjsx6\") pod \"node-exporter-rdqpv\" (UID: \"d5bb25c3-c5e8-486a-8e50-577262e99b9a\") " pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.633930 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:51.633895    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rdqpv"
Jul 10 22:43:51.654915 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:51.654887    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bb25c3_c5e8_486a_8e50_577262e99b9a.slice/crio-eac6c808d859cd4ff68c4593d15647278698421e3b296485a840fad3bf064ab6 WatchSource:0}: Error finding container eac6c808d859cd4ff68c4593d15647278698421e3b296485a840fad3bf064ab6: Status 404 returned error can't find the container with id eac6c808d859cd4ff68c4593d15647278698421e3b296485a840fad3bf064ab6
Jul 10 22:43:52.071606 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.071570    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:52.074108 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.074088    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c780dbf8-77f6-43b0-b0fd-5b682c281fda-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-qxhv2\" (UID: \"c780dbf8-77f6-43b0-b0fd-5b682c281fda\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:52.105737 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.105703    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rdqpv" event={"ID":"d5bb25c3-c5e8-486a-8e50-577262e99b9a","Type":"ContainerStarted","Data":"eac6c808d859cd4ff68c4593d15647278698421e3b296485a840fad3bf064ab6"}
Jul 10 22:43:52.225900 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.225863    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"
Jul 10 22:43:52.378205 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.378174    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 22:43:52.395397 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.395364    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-qxhv2"]
Jul 10 22:43:52.395788 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.395612    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.397260 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.397234    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 22:43:52.397698 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:52.397667    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc780dbf8_77f6_43b0_b0fd_5b682c281fda.slice/crio-c1e7631e03d74badef8b7a6b131ab33fc28cf727eec8d3b7be2f7bae0f9ede5f WatchSource:0}: Error finding container c1e7631e03d74badef8b7a6b131ab33fc28cf727eec8d3b7be2f7bae0f9ede5f: Status 404 returned error can't find the container with id c1e7631e03d74badef8b7a6b131ab33fc28cf727eec8d3b7be2f7bae0f9ede5f
Jul 10 22:43:52.399979 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.399514    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 22:43:52.399979 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.399818    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 22:43:52.399979 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.399971    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 22:43:52.400213 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.400195    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 22:43:52.400252 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.400201    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 22:43:52.400284 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.400262    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 22:43:52.400939 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.400549    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 22:43:52.400939 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.400556    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 22:43:52.400939 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.400610    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 22:43:52.400939 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.400564    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-t7n4v\""
Jul 10 22:43:52.576422 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.576378    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.576422 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.576413    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06eaae49-d25f-43a5-bcb6-ec0748c8191c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.576651 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.576518    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06eaae49-d25f-43a5-bcb6-ec0748c8191c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.576651 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.576552    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.576651 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.576573    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06eaae49-d25f-43a5-bcb6-ec0748c8191c-config-out\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.576651 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.576594    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.576864 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.576650    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06eaae49-d25f-43a5-bcb6-ec0748c8191c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.576864 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.576794    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.576864 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.576824    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-web-config\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.577045 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.576917    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06eaae49-d25f-43a5-bcb6-ec0748c8191c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.577045 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.576942    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-config-volume\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.577045 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.576974    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj65r\" (UniqueName: \"kubernetes.io/projected/06eaae49-d25f-43a5-bcb6-ec0748c8191c-kube-api-access-nj65r\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.577152 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.577049    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.677839 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.677801    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.678043 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.677859    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.678043 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.677886    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06eaae49-d25f-43a5-bcb6-ec0748c8191c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.678043 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.677937    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06eaae49-d25f-43a5-bcb6-ec0748c8191c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.678043 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.677962    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.678043 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.677987    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06eaae49-d25f-43a5-bcb6-ec0748c8191c-config-out\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.678043 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.678009    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.678043 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.678031    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06eaae49-d25f-43a5-bcb6-ec0748c8191c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.678369 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.678078    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.678369 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.678101    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-web-config\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.678369 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:52.678147    2566 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 10 22:43:52.678369 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.678190    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06eaae49-d25f-43a5-bcb6-ec0748c8191c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.678369 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:43:52.678223    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-main-tls podName:06eaae49-d25f-43a5-bcb6-ec0748c8191c nodeName:}" failed. No retries permitted until 2026-07-10 22:43:53.178199939 +0000 UTC m=+52.871558199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c") : secret "alertmanager-main-tls" not found
Jul 10 22:43:52.678369 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.678259    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-config-volume\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.678369 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.678289    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj65r\" (UniqueName: \"kubernetes.io/projected/06eaae49-d25f-43a5-bcb6-ec0748c8191c-kube-api-access-nj65r\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.680125 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.678995    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06eaae49-d25f-43a5-bcb6-ec0748c8191c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.680125 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.679225    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06eaae49-d25f-43a5-bcb6-ec0748c8191c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.680125 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.680082    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06eaae49-d25f-43a5-bcb6-ec0748c8191c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.681003 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.680970    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.681114 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.681027    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.682108 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.682069    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.682232 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.682216    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06eaae49-d25f-43a5-bcb6-ec0748c8191c-config-out\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.682484 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.682461    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-config-volume\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.682646 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.682623    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.682958 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.682936    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06eaae49-d25f-43a5-bcb6-ec0748c8191c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.683490 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.683470    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-web-config\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:52.689020 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:52.688990    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj65r\" (UniqueName: \"kubernetes.io/projected/06eaae49-d25f-43a5-bcb6-ec0748c8191c-kube-api-access-nj65r\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:53.075897 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:53.075868    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9cmwm"
Jul 10 22:43:53.111016 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:53.110941    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2" event={"ID":"c780dbf8-77f6-43b0-b0fd-5b682c281fda","Type":"ContainerStarted","Data":"c1e7631e03d74badef8b7a6b131ab33fc28cf727eec8d3b7be2f7bae0f9ede5f"}
Jul 10 22:43:53.182024 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:53.181980    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:53.185102 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:53.185051    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:53.309632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:53.309596    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:43:53.465692 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:53.465637    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 22:43:53.468203 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:53.468171    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06eaae49_d25f_43a5_bcb6_ec0748c8191c.slice/crio-89866878abef73a38f9913ac459f220ba2b14a59d7974f8188faec6d95e46fcb WatchSource:0}: Error finding container 89866878abef73a38f9913ac459f220ba2b14a59d7974f8188faec6d95e46fcb: Status 404 returned error can't find the container with id 89866878abef73a38f9913ac459f220ba2b14a59d7974f8188faec6d95e46fcb
Jul 10 22:43:54.117844 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:54.117808    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2" event={"ID":"c780dbf8-77f6-43b0-b0fd-5b682c281fda","Type":"ContainerStarted","Data":"27d2510ae8b782d40e8351eaf649f6e2f3285e5c21d38d58f1362637fbf1e837"}
Jul 10 22:43:54.117986 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:54.117904    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2" event={"ID":"c780dbf8-77f6-43b0-b0fd-5b682c281fda","Type":"ContainerStarted","Data":"9db3c770703236a56e4ffa1372909b1df82f3e92aa944841fd29076952438fd4"}
Jul 10 22:43:54.120149 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:54.120099    2566 generic.go:356] "Generic (PLEG): container finished" podID="d5bb25c3-c5e8-486a-8e50-577262e99b9a" containerID="1a44beb1636475c8702302feb02d7f900fc4476de8f60a13ebc96ca87b003445" exitCode=0
Jul 10 22:43:54.120292 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:54.120195    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rdqpv" event={"ID":"d5bb25c3-c5e8-486a-8e50-577262e99b9a","Type":"ContainerDied","Data":"1a44beb1636475c8702302feb02d7f900fc4476de8f60a13ebc96ca87b003445"}
Jul 10 22:43:54.122363 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:54.122268    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerStarted","Data":"89866878abef73a38f9913ac459f220ba2b14a59d7974f8188faec6d95e46fcb"}
Jul 10 22:43:55.126494 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.126459    2566 generic.go:356] "Generic (PLEG): container finished" podID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerID="294dc1e58c03443f813997ab90be4996df1dd26c600fc910f5fed0b762715885" exitCode=0
Jul 10 22:43:55.126928 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.126540    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerDied","Data":"294dc1e58c03443f813997ab90be4996df1dd26c600fc910f5fed0b762715885"}
Jul 10 22:43:55.128782 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.128741    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2" event={"ID":"c780dbf8-77f6-43b0-b0fd-5b682c281fda","Type":"ContainerStarted","Data":"c61fae9b7b7dc48f9b0e4736f18d8204544eb59d74e2f0fabc37ef91b898d500"}
Jul 10 22:43:55.131005 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.130984    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rdqpv" event={"ID":"d5bb25c3-c5e8-486a-8e50-577262e99b9a","Type":"ContainerStarted","Data":"6cbef9ef4359da1c8d6832e69173239351a721d9dc0ac9e58f02cb83be7dc72d"}
Jul 10 22:43:55.131075 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.131023    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rdqpv" event={"ID":"d5bb25c3-c5e8-486a-8e50-577262e99b9a","Type":"ContainerStarted","Data":"2bf1ada866379ca16168dbe2f635da64504649d68eefb6607206c722abbe4b18"}
Jul 10 22:43:55.173081 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.173028    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rdqpv" podStartSLOduration=2.6714238359999998 podStartE2EDuration="4.173012966s" totalImagesPullingTime="1.40775908s" totalInitContainerRuntime="93.83005ms" isStatefulPod=true podCreationTimestamp="2026-07-10 22:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:55.171720294 +0000 UTC m=+54.865078573" watchObservedRunningTime="2026-07-10 22:43:55.173012966 +0000 UTC m=+54.866371240"
Jul 10 22:43:55.189638 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.189585    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-qxhv2" podStartSLOduration=2.609851089 podStartE2EDuration="4.18956963s" totalImagesPullingTime="1.579718541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:55.188623359 +0000 UTC m=+54.881981646" watchObservedRunningTime="2026-07-10 22:43:55.18956963 +0000 UTC m=+54.882927920"
Jul 10 22:43:55.604137 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.604097    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-h8mzp"]
Jul 10 22:43:55.606176 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.606152    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-h8mzp"
Jul 10 22:43:55.608752 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.608728    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 22:43:55.608893 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.608792    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 22:43:55.609203 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.609188    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jqx5v\""
Jul 10 22:43:55.619916 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.619894    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-h8mzp"]
Jul 10 22:43:55.705970 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.705925    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbdtb\" (UniqueName: \"kubernetes.io/projected/566f3458-5854-4902-a388-4b7ca1f953d2-kube-api-access-wbdtb\") pod \"downloads-68c9cbb497-h8mzp\" (UID: \"566f3458-5854-4902-a388-4b7ca1f953d2\") " pod="openshift-console/downloads-68c9cbb497-h8mzp"
Jul 10 22:43:55.807141 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.807106    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbdtb\" (UniqueName: \"kubernetes.io/projected/566f3458-5854-4902-a388-4b7ca1f953d2-kube-api-access-wbdtb\") pod \"downloads-68c9cbb497-h8mzp\" (UID: \"566f3458-5854-4902-a388-4b7ca1f953d2\") " pod="openshift-console/downloads-68c9cbb497-h8mzp"
Jul 10 22:43:55.815280 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.815254    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbdtb\" (UniqueName: \"kubernetes.io/projected/566f3458-5854-4902-a388-4b7ca1f953d2-kube-api-access-wbdtb\") pod \"downloads-68c9cbb497-h8mzp\" (UID: \"566f3458-5854-4902-a388-4b7ca1f953d2\") " pod="openshift-console/downloads-68c9cbb497-h8mzp"
Jul 10 22:43:55.914984 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.914894    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-h8mzp"
Jul 10 22:43:55.972541 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.972507    2566 patch_prober.go:28] interesting pod/image-registry-59f78bd545-p6q49 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 10 22:43:55.972703 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:55.972569    2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59f78bd545-p6q49" podUID="34ed569e-239a-4853-8031-a3358e2d1c15" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 22:43:56.054159 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:56.054128    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-h8mzp"]
Jul 10 22:43:56.055629 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:56.055597    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod566f3458_5854_4902_a388_4b7ca1f953d2.slice/crio-c9069e7c905ddefe09bef75603bed5165a3e958b8b240c27f1d443b9b71283eb WatchSource:0}: Error finding container c9069e7c905ddefe09bef75603bed5165a3e958b8b240c27f1d443b9b71283eb: Status 404 returned error can't find the container with id c9069e7c905ddefe09bef75603bed5165a3e958b8b240c27f1d443b9b71283eb
Jul 10 22:43:56.135676 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:56.135638    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-h8mzp" event={"ID":"566f3458-5854-4902-a388-4b7ca1f953d2","Type":"ContainerStarted","Data":"c9069e7c905ddefe09bef75603bed5165a3e958b8b240c27f1d443b9b71283eb"}
Jul 10 22:43:57.149310 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.149285    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerStarted","Data":"c30f41b65f2a70d241f53c3c03b6a0ce6dc0043bbf7e71e69ad1384d37282906"}
Jul 10 22:43:57.149749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.149347    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerStarted","Data":"76ea9a49611aab83e2177c9e31c4240c8f73a6d680ede052c4094d2c65bccc3d"}
Jul 10 22:43:57.149749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.149375    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerStarted","Data":"a57cf81baa474980e294d529e85beca30a50869776516bb072c6245be6be2e1c"}
Jul 10 22:43:57.605297 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.605264    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 22:43:57.610545 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.609862    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.613115 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.613076    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 22:43:57.613280 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.613078    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 22:43:57.613280 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.613159    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wthfd\""
Jul 10 22:43:57.613429 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.613337    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 22:43:57.613498 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.613433    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 22:43:57.613498 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.613458    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7lh2um85g8onp\""
Jul 10 22:43:57.613603 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.613529    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 22:43:57.613830 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.613809    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 22:43:57.613941 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.613810    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 22:43:57.613941 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.613868    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 22:43:57.613941 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.613811    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 22:43:57.613941 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.613873    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 22:43:57.614195 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.613978    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 22:43:57.614195 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.614035    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 22:43:57.614589 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.614426    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 22:43:57.617091 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.617063    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 22:43:57.620233 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.620210    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 22:43:57.624674 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.624650    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 22:43:57.725492 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.725459    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48db2bfb-9638-43a9-9a95-e8c6e60347fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.725640 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.725501    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48db2bfb-9638-43a9-9a95-e8c6e60347fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.725640 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.725549    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.725640 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.725579    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.725640 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.725615    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.725855 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.725678    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.725855 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.725780    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.725855 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.725817    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.725855 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.725840    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.726019 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.725862    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cpwn\" (UniqueName: \"kubernetes.io/projected/48db2bfb-9638-43a9-9a95-e8c6e60347fc-kube-api-access-7cpwn\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.726019 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.725903    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.726019 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.725983    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.726169 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.726055    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.726169 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.726121    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.726169 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.726153    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.726292 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.726190    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.726292 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.726256    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.726292 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.726280    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.726406 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.726312    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.726406 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.726342    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-config\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827235 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827193    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827434 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827243    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827434 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827269    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827434 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827293    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cpwn\" (UniqueName: \"kubernetes.io/projected/48db2bfb-9638-43a9-9a95-e8c6e60347fc-kube-api-access-7cpwn\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827434 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827331    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827434 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827380    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827434 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827420    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827741 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827464    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827741 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827496    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827741 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827521    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827741 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827553    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827741 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827580    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827741 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827614    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827741 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827643    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-config\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827741 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827667    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48db2bfb-9638-43a9-9a95-e8c6e60347fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827741 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827689    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48db2bfb-9638-43a9-9a95-e8c6e60347fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.827741 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827727    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.828129 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827754    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.828129 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827813    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.828129 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.827843    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.828129 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.828108    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.828286 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.828233    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.828824 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.828799    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.829587 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.829522    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.832115 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.830321    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-web-config\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.832115 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.831267    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.832115 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.831702    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.832332 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.832287    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.832388 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.832339    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-config\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.832791 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.832702    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.833864 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.833021    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.833864 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.833826    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.833864 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.833852    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.834329 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.834282    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.834604 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.834563    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.834733 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.834675    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.835435 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.835410    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48db2bfb-9638-43a9-9a95-e8c6e60347fc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.835667 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.835646    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48db2bfb-9638-43a9-9a95-e8c6e60347fc-config-out\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.836082 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.836064    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.839335 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.839307    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cpwn\" (UniqueName: \"kubernetes.io/projected/48db2bfb-9638-43a9-9a95-e8c6e60347fc-kube-api-access-7cpwn\") pod \"prometheus-k8s-0\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:57.923737 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:57.923522    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:43:58.048949 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:58.048917    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59f78bd545-p6q49"
Jul 10 22:43:58.083555 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:58.083434    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 22:43:58.089983 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:43:58.089946    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48db2bfb_9638_43a9_9a95_e8c6e60347fc.slice/crio-f7ad13b6a19f65d2270107d11f9d5a0e70ee5bcf754004b0ed9459780f5cd1af WatchSource:0}: Error finding container f7ad13b6a19f65d2270107d11f9d5a0e70ee5bcf754004b0ed9459780f5cd1af: Status 404 returned error can't find the container with id f7ad13b6a19f65d2270107d11f9d5a0e70ee5bcf754004b0ed9459780f5cd1af
Jul 10 22:43:58.155600 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:58.155569    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerStarted","Data":"f7ad13b6a19f65d2270107d11f9d5a0e70ee5bcf754004b0ed9459780f5cd1af"}
Jul 10 22:43:58.159565 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:58.159523    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerStarted","Data":"f1f53322babcbe24f5321eb544b8b2e97036f0dc54858a58651b0e9e45838756"}
Jul 10 22:43:58.159676 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:58.159596    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerStarted","Data":"46eae29efc7149e726699de0958f84b08dcfe9f6869071e0765f3a032c9f5fd7"}
Jul 10 22:43:58.159676 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:58.159638    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerStarted","Data":"431c4b52b54ab9ef53abdd5f44753639030928d69cbbc3ddd6be8128a40dc8de"}
Jul 10 22:43:58.186678 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:58.186613    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.397354518 podStartE2EDuration="6.186590379s" totalImagesPullingTime="3.774043031s" totalInitContainerRuntime="15.19283ms" isStatefulPod=false podCreationTimestamp="2026-07-10 22:43:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:43:58.184989361 +0000 UTC m=+57.878347672" watchObservedRunningTime="2026-07-10 22:43:58.186590379 +0000 UTC m=+57.879948656"
Jul 10 22:43:59.165635 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:59.165598    2566 generic.go:356] "Generic (PLEG): container finished" podID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerID="9b23c14dfce56f984e0749ed1a4659c050bf08265f81220e8e9fcd4e37c600dd" exitCode=0
Jul 10 22:43:59.166147 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:43:59.165685    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerDied","Data":"9b23c14dfce56f984e0749ed1a4659c050bf08265f81220e8e9fcd4e37c600dd"}
Jul 10 22:44:01.012404 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:01.012366    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wmsn"
Jul 10 22:44:03.184186 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:03.184151    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerStarted","Data":"002ce6e2fc7acc7216eb490b5464053308923d24dabd5b674fe3fb9c22aac3f8"}
Jul 10 22:44:03.184569 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:03.184228    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerStarted","Data":"5067ed4c25b519dff317f693467a13d168570ffa6b999fa5a5eafa6b5b88f5ad"}
Jul 10 22:44:05.195511 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:05.195426    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerStarted","Data":"b5b4182c7ac74e0e306ec5ca1bb40acdd8807d561fd7443afa275566c94915eb"}
Jul 10 22:44:05.195511 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:05.195490    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerStarted","Data":"f40083dbeb15dcb37ef7459e04bba896ef3cbf64a51a59758c634712a3514822"}
Jul 10 22:44:05.195913 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:05.195516    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerStarted","Data":"85d0f47b05560f8bef3c1bf490679d5513e819543842f5f1a197a43ad0febea7"}
Jul 10 22:44:05.195913 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:05.195539    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerStarted","Data":"15e04b47265f4e78a30d53fd548be82ee145424b15efa2b6200f069a44713f18"}
Jul 10 22:44:05.225993 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:05.225911    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.832036527 podStartE2EDuration="8.22588778s" totalImagesPullingTime="5.373808305s" totalInitContainerRuntime="20.042948ms" isStatefulPod=false podCreationTimestamp="2026-07-10 22:43:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:44:05.223807441 +0000 UTC m=+64.917165742" watchObservedRunningTime="2026-07-10 22:44:05.22588778 +0000 UTC m=+64.919246056"
Jul 10 22:44:06.623262 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.623223    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs\") pod \"network-metrics-daemon-6rq2s\" (UID: \"3efa918d-27f0-4c41-912b-519868eaf758\") " pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:44:06.623726 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.623298    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:44:06.625914 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.625883    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 22:44:06.626757 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.626732    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 22:44:06.636108 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.636075    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3efa918d-27f0-4c41-912b-519868eaf758-metrics-certs\") pod \"network-metrics-daemon-6rq2s\" (UID: \"3efa918d-27f0-4c41-912b-519868eaf758\") " pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:44:06.636239 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.636073    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/010f1cce-27b5-4536-b7b9-9be0187fb5d6-original-pull-secret\") pod \"global-pull-secret-syncer-j56vp\" (UID: \"010f1cce-27b5-4536-b7b9-9be0187fb5d6\") " pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:44:06.724315 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.724276    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lg2s\" (UniqueName: \"kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s\") pod \"network-check-target-x5vjs\" (UID: \"38498cbc-be4a-4489-a927-0d38b32a8e53\") " pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:44:06.726752 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.726720    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 22:44:06.736878 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.736845    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 22:44:06.748787 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.748719    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lg2s\" (UniqueName: \"kubernetes.io/projected/38498cbc-be4a-4489-a927-0d38b32a8e53-kube-api-access-2lg2s\") pod \"network-check-target-x5vjs\" (UID: \"38498cbc-be4a-4489-a927-0d38b32a8e53\") " pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:44:06.823368 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.823334    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vx2kj\""
Jul 10 22:44:06.831303 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.831271    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rq2s"
Jul 10 22:44:06.832496 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.832474    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j56vp"
Jul 10 22:44:06.842808 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.842754    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wwzq4\""
Jul 10 22:44:06.851159 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:06.851137    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:44:07.059791 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:07.059730    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6rq2s"]
Jul 10 22:44:07.080187 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:07.080165    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j56vp"]
Jul 10 22:44:07.103402 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:07.103370    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x5vjs"]
Jul 10 22:44:07.924388 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:07.924355    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:14.076818 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:44:14.076779    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38498cbc_be4a_4489_a927_0d38b32a8e53.slice/crio-90bba3488c52d5d69f38effc6c51ff92587d42a2eafc0cca660db774521a8899 WatchSource:0}: Error finding container 90bba3488c52d5d69f38effc6c51ff92587d42a2eafc0cca660db774521a8899: Status 404 returned error can't find the container with id 90bba3488c52d5d69f38effc6c51ff92587d42a2eafc0cca660db774521a8899
Jul 10 22:44:14.077551 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:44:14.077526    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010f1cce_27b5_4536_b7b9_9be0187fb5d6.slice/crio-b2b527aaefe21de4f7987ba75f220ec3ed712ee351e511b51ff7f7756b923867 WatchSource:0}: Error finding container b2b527aaefe21de4f7987ba75f220ec3ed712ee351e511b51ff7f7756b923867: Status 404 returned error can't find the container with id b2b527aaefe21de4f7987ba75f220ec3ed712ee351e511b51ff7f7756b923867
Jul 10 22:44:14.078419 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:44:14.078396    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3efa918d_27f0_4c41_912b_519868eaf758.slice/crio-3e39de04bb03a828a1d076b276b25e0c700a2db2005828dbd03f6f3361cc45e1 WatchSource:0}: Error finding container 3e39de04bb03a828a1d076b276b25e0c700a2db2005828dbd03f6f3361cc45e1: Status 404 returned error can't find the container with id 3e39de04bb03a828a1d076b276b25e0c700a2db2005828dbd03f6f3361cc45e1
Jul 10 22:44:14.233298 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:14.233263    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-h8mzp" event={"ID":"566f3458-5854-4902-a388-4b7ca1f953d2","Type":"ContainerStarted","Data":"edf99a60e5ef06c39665584bbbd15e3974aec91d7bc87b05b2682ab514bb9987"}
Jul 10 22:44:14.233542 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:14.233524    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-h8mzp"
Jul 10 22:44:14.234616 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:14.234591    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j56vp" event={"ID":"010f1cce-27b5-4536-b7b9-9be0187fb5d6","Type":"ContainerStarted","Data":"b2b527aaefe21de4f7987ba75f220ec3ed712ee351e511b51ff7f7756b923867"}
Jul 10 22:44:14.235197 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:14.235165    2566 patch_prober.go:28] interesting pod/downloads-68c9cbb497-h8mzp container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused" start-of-body=
Jul 10 22:44:14.235299 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:14.235213    2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-68c9cbb497-h8mzp" podUID="566f3458-5854-4902-a388-4b7ca1f953d2" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused"
Jul 10 22:44:14.235901 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:14.235876    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6rq2s" event={"ID":"3efa918d-27f0-4c41-912b-519868eaf758","Type":"ContainerStarted","Data":"3e39de04bb03a828a1d076b276b25e0c700a2db2005828dbd03f6f3361cc45e1"}
Jul 10 22:44:14.237205 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:14.237183    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x5vjs" event={"ID":"38498cbc-be4a-4489-a927-0d38b32a8e53","Type":"ContainerStarted","Data":"90bba3488c52d5d69f38effc6c51ff92587d42a2eafc0cca660db774521a8899"}
Jul 10 22:44:14.253313 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:14.253259    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-h8mzp" podStartSLOduration=1.141915961 podStartE2EDuration="19.253243162s" totalImagesPullingTime="18.111327201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:44:14.25182781 +0000 UTC m=+73.945186100" watchObservedRunningTime="2026-07-10 22:44:14.253243162 +0000 UTC m=+73.946601438"
Jul 10 22:44:15.260097 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:15.260017    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-h8mzp"
Jul 10 22:44:16.257384 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:16.257248    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6rq2s" event={"ID":"3efa918d-27f0-4c41-912b-519868eaf758","Type":"ContainerStarted","Data":"61194dd9b75a139622fe5fe60796d7c332c8cf951d688cf95665c0de7d6d3790"}
Jul 10 22:44:17.265463 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:17.264674    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6rq2s" event={"ID":"3efa918d-27f0-4c41-912b-519868eaf758","Type":"ContainerStarted","Data":"f9cddfec55c7b83912da80d8c11712d7f4c63df0d40e1f034eae58cbeb302b94"}
Jul 10 22:44:17.285294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:17.285211    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6rq2s" podStartSLOduration=75.30723788 podStartE2EDuration="1m17.285188347s" totalImagesPullingTime="1.977950467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:44:17.284067739 +0000 UTC m=+76.977426014" watchObservedRunningTime="2026-07-10 22:44:17.285188347 +0000 UTC m=+76.978546623"
Jul 10 22:44:21.285697 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:21.285655    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j56vp" event={"ID":"010f1cce-27b5-4536-b7b9-9be0187fb5d6","Type":"ContainerStarted","Data":"a7b6a272190833ec922c0960c182668877fd234ff83d140f037be96fad5403b4"}
Jul 10 22:44:21.287632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:21.287604    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x5vjs" event={"ID":"38498cbc-be4a-4489-a927-0d38b32a8e53","Type":"ContainerStarted","Data":"17a45e26a13d26bfc183d852a4664fe8f8605e6619e10c761714777f6d59245f"}
Jul 10 22:44:21.287799 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:21.287748    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:44:21.300972 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:21.300912    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j56vp" podStartSLOduration=73.612876839 podStartE2EDuration="1m20.300892904s" totalImagesPullingTime="6.688016065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 22:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:44:21.29969022 +0000 UTC m=+80.993048496" watchObservedRunningTime="2026-07-10 22:44:21.300892904 +0000 UTC m=+80.994251179"
Jul 10 22:44:21.314931 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:21.314880    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x5vjs" podStartSLOduration=73.639815951 podStartE2EDuration="1m20.314863568s" totalImagesPullingTime="6.675047617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:43:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:44:21.313616178 +0000 UTC m=+81.006974483" watchObservedRunningTime="2026-07-10 22:44:21.314863568 +0000 UTC m=+81.008221843"
Jul 10 22:44:28.976331 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:28.976288    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:29.044507 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:29.044479    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:29.335654 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:29.335582    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:41.659874 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:41.659837    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 22:44:41.660344 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:41.660106    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="alertmanager" containerID="cri-o://a57cf81baa474980e294d529e85beca30a50869776516bb072c6245be6be2e1c" gracePeriod=120
Jul 10 22:44:41.660344 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:41.660186    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="kube-rbac-proxy-metric" containerID="cri-o://46eae29efc7149e726699de0958f84b08dcfe9f6869071e0765f3a032c9f5fd7" gracePeriod=120
Jul 10 22:44:41.660344 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:41.660241    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="prom-label-proxy" containerID="cri-o://f1f53322babcbe24f5321eb544b8b2e97036f0dc54858a58651b0e9e45838756" gracePeriod=120
Jul 10 22:44:41.660344 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:41.660271    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="kube-rbac-proxy" containerID="cri-o://431c4b52b54ab9ef53abdd5f44753639030928d69cbbc3ddd6be8128a40dc8de" gracePeriod=120
Jul 10 22:44:41.660560 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:41.660271    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="config-reloader" containerID="cri-o://76ea9a49611aab83e2177c9e31c4240c8f73a6d680ede052c4094d2c65bccc3d" gracePeriod=120
Jul 10 22:44:41.660560 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:41.660219    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="kube-rbac-proxy-web" containerID="cri-o://c30f41b65f2a70d241f53c3c03b6a0ce6dc0043bbf7e71e69ad1384d37282906" gracePeriod=120
Jul 10 22:44:42.379361 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.379329    2566 generic.go:356] "Generic (PLEG): container finished" podID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerID="f1f53322babcbe24f5321eb544b8b2e97036f0dc54858a58651b0e9e45838756" exitCode=0
Jul 10 22:44:42.379361 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.379352    2566 generic.go:356] "Generic (PLEG): container finished" podID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerID="46eae29efc7149e726699de0958f84b08dcfe9f6869071e0765f3a032c9f5fd7" exitCode=0
Jul 10 22:44:42.379361 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.379358    2566 generic.go:356] "Generic (PLEG): container finished" podID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerID="431c4b52b54ab9ef53abdd5f44753639030928d69cbbc3ddd6be8128a40dc8de" exitCode=0
Jul 10 22:44:42.379361 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.379364    2566 generic.go:356] "Generic (PLEG): container finished" podID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerID="76ea9a49611aab83e2177c9e31c4240c8f73a6d680ede052c4094d2c65bccc3d" exitCode=0
Jul 10 22:44:42.379361 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.379370    2566 generic.go:356] "Generic (PLEG): container finished" podID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerID="a57cf81baa474980e294d529e85beca30a50869776516bb072c6245be6be2e1c" exitCode=0
Jul 10 22:44:42.379646 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.379402    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerDied","Data":"f1f53322babcbe24f5321eb544b8b2e97036f0dc54858a58651b0e9e45838756"}
Jul 10 22:44:42.379646 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.379489    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerDied","Data":"46eae29efc7149e726699de0958f84b08dcfe9f6869071e0765f3a032c9f5fd7"}
Jul 10 22:44:42.379646 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.379515    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerDied","Data":"431c4b52b54ab9ef53abdd5f44753639030928d69cbbc3ddd6be8128a40dc8de"}
Jul 10 22:44:42.379646 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.379540    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerDied","Data":"76ea9a49611aab83e2177c9e31c4240c8f73a6d680ede052c4094d2c65bccc3d"}
Jul 10 22:44:42.379646 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.379565    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerDied","Data":"a57cf81baa474980e294d529e85beca30a50869776516bb072c6245be6be2e1c"}
Jul 10 22:44:42.908078 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.908054    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:42.945546 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.945503    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj65r\" (UniqueName: \"kubernetes.io/projected/06eaae49-d25f-43a5-bcb6-ec0748c8191c-kube-api-access-nj65r\") pod \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") "
Jul 10 22:44:42.945846 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.945562    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-config-volume\") pod \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") "
Jul 10 22:44:42.945846 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.945626    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06eaae49-d25f-43a5-bcb6-ec0748c8191c-config-out\") pod \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") "
Jul 10 22:44:42.945846 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.945682    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-main-tls\") pod \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") "
Jul 10 22:44:42.945846 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.945746    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy-web\") pod \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") "
Jul 10 22:44:42.945846 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.945790    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06eaae49-d25f-43a5-bcb6-ec0748c8191c-tls-assets\") pod \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") "
Jul 10 22:44:42.945846 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.945816    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-cluster-tls-config\") pod \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") "
Jul 10 22:44:42.946207 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.945877    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06eaae49-d25f-43a5-bcb6-ec0748c8191c-alertmanager-trusted-ca-bundle\") pod \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") "
Jul 10 22:44:42.946207 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.945908    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-web-config\") pod \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") "
Jul 10 22:44:42.946207 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.945941    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06eaae49-d25f-43a5-bcb6-ec0748c8191c-alertmanager-main-db\") pod \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") "
Jul 10 22:44:42.946207 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.945976    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06eaae49-d25f-43a5-bcb6-ec0748c8191c-metrics-client-ca\") pod \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") "
Jul 10 22:44:42.946207 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.946015    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy\") pod \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") "
Jul 10 22:44:42.946207 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.946046    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\" (UID: \"06eaae49-d25f-43a5-bcb6-ec0748c8191c\") "
Jul 10 22:44:42.947307 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.947217    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06eaae49-d25f-43a5-bcb6-ec0748c8191c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "06eaae49-d25f-43a5-bcb6-ec0748c8191c" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 22:44:42.947307 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.947235    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06eaae49-d25f-43a5-bcb6-ec0748c8191c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "06eaae49-d25f-43a5-bcb6-ec0748c8191c" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:44:42.947530 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.947498    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06eaae49-d25f-43a5-bcb6-ec0748c8191c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "06eaae49-d25f-43a5-bcb6-ec0748c8191c" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 22:44:42.951139 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.951091    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06eaae49-d25f-43a5-bcb6-ec0748c8191c-kube-api-access-nj65r" (OuterVolumeSpecName: "kube-api-access-nj65r") pod "06eaae49-d25f-43a5-bcb6-ec0748c8191c" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c"). InnerVolumeSpecName "kube-api-access-nj65r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:44:42.951139 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.951107    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-config-volume" (OuterVolumeSpecName: "config-volume") pod "06eaae49-d25f-43a5-bcb6-ec0748c8191c" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:42.951321 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.951137    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06eaae49-d25f-43a5-bcb6-ec0748c8191c-config-out" (OuterVolumeSpecName: "config-out") pod "06eaae49-d25f-43a5-bcb6-ec0748c8191c" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:44:42.951321 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.951270    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "06eaae49-d25f-43a5-bcb6-ec0748c8191c" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:42.951444 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.951355    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "06eaae49-d25f-43a5-bcb6-ec0748c8191c" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:42.951504 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.951492    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "06eaae49-d25f-43a5-bcb6-ec0748c8191c" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:42.951938 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.951910    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "06eaae49-d25f-43a5-bcb6-ec0748c8191c" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:42.952221 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.952190    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06eaae49-d25f-43a5-bcb6-ec0748c8191c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "06eaae49-d25f-43a5-bcb6-ec0748c8191c" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:44:42.957165 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.957136    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "06eaae49-d25f-43a5-bcb6-ec0748c8191c" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:42.964275 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:42.964254    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-web-config" (OuterVolumeSpecName: "web-config") pod "06eaae49-d25f-43a5-bcb6-ec0748c8191c" (UID: "06eaae49-d25f-43a5-bcb6-ec0748c8191c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:43.046749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.046653    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:43.046749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.046686    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:43.046749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.046700    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj65r\" (UniqueName: \"kubernetes.io/projected/06eaae49-d25f-43a5-bcb6-ec0748c8191c-kube-api-access-nj65r\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:43.046749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.046737    2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-config-volume\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:43.046749 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.046750    2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06eaae49-d25f-43a5-bcb6-ec0748c8191c-config-out\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:43.047059 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.046788    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-main-tls\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:43.047059 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.046801    2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:43.047059 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.046813    2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06eaae49-d25f-43a5-bcb6-ec0748c8191c-tls-assets\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:43.047059 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.046824    2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-cluster-tls-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:43.047059 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.046835    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06eaae49-d25f-43a5-bcb6-ec0748c8191c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:43.047059 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.046846    2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06eaae49-d25f-43a5-bcb6-ec0748c8191c-web-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:43.047059 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.046857    2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06eaae49-d25f-43a5-bcb6-ec0748c8191c-alertmanager-main-db\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:43.047059 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.046868    2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06eaae49-d25f-43a5-bcb6-ec0748c8191c-metrics-client-ca\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:43.385874 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.385839    2566 generic.go:356] "Generic (PLEG): container finished" podID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerID="c30f41b65f2a70d241f53c3c03b6a0ce6dc0043bbf7e71e69ad1384d37282906" exitCode=0
Jul 10 22:44:43.386046 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.385910    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.386046 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.385911    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerDied","Data":"c30f41b65f2a70d241f53c3c03b6a0ce6dc0043bbf7e71e69ad1384d37282906"}
Jul 10 22:44:43.386046 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.386037    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06eaae49-d25f-43a5-bcb6-ec0748c8191c","Type":"ContainerDied","Data":"89866878abef73a38f9913ac459f220ba2b14a59d7974f8188faec6d95e46fcb"}
Jul 10 22:44:43.386174 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.386072    2566 scope.go:117] "RemoveContainer" containerID="f1f53322babcbe24f5321eb544b8b2e97036f0dc54858a58651b0e9e45838756"
Jul 10 22:44:43.394328 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.394307    2566 scope.go:117] "RemoveContainer" containerID="46eae29efc7149e726699de0958f84b08dcfe9f6869071e0765f3a032c9f5fd7"
Jul 10 22:44:43.401238 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.401217    2566 scope.go:117] "RemoveContainer" containerID="431c4b52b54ab9ef53abdd5f44753639030928d69cbbc3ddd6be8128a40dc8de"
Jul 10 22:44:43.408210 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.408138    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 22:44:43.408210 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.408185    2566 scope.go:117] "RemoveContainer" containerID="c30f41b65f2a70d241f53c3c03b6a0ce6dc0043bbf7e71e69ad1384d37282906"
Jul 10 22:44:43.413090 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.413066    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 22:44:43.415780 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.415751    2566 scope.go:117] "RemoveContainer" containerID="76ea9a49611aab83e2177c9e31c4240c8f73a6d680ede052c4094d2c65bccc3d"
Jul 10 22:44:43.422350 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.422333    2566 scope.go:117] "RemoveContainer" containerID="a57cf81baa474980e294d529e85beca30a50869776516bb072c6245be6be2e1c"
Jul 10 22:44:43.428853 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.428831    2566 scope.go:117] "RemoveContainer" containerID="294dc1e58c03443f813997ab90be4996df1dd26c600fc910f5fed0b762715885"
Jul 10 22:44:43.435573 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.435354    2566 scope.go:117] "RemoveContainer" containerID="f1f53322babcbe24f5321eb544b8b2e97036f0dc54858a58651b0e9e45838756"
Jul 10 22:44:43.436115 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:43.436079    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f53322babcbe24f5321eb544b8b2e97036f0dc54858a58651b0e9e45838756\": container with ID starting with f1f53322babcbe24f5321eb544b8b2e97036f0dc54858a58651b0e9e45838756 not found: ID does not exist" containerID="f1f53322babcbe24f5321eb544b8b2e97036f0dc54858a58651b0e9e45838756"
Jul 10 22:44:43.436218 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.436124    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f53322babcbe24f5321eb544b8b2e97036f0dc54858a58651b0e9e45838756"} err="failed to get container status \"f1f53322babcbe24f5321eb544b8b2e97036f0dc54858a58651b0e9e45838756\": rpc error: code = NotFound desc = could not find container \"f1f53322babcbe24f5321eb544b8b2e97036f0dc54858a58651b0e9e45838756\": container with ID starting with f1f53322babcbe24f5321eb544b8b2e97036f0dc54858a58651b0e9e45838756 not found: ID does not exist"
Jul 10 22:44:43.436218 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.436167    2566 scope.go:117] "RemoveContainer" containerID="46eae29efc7149e726699de0958f84b08dcfe9f6869071e0765f3a032c9f5fd7"
Jul 10 22:44:43.436455 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:43.436426    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46eae29efc7149e726699de0958f84b08dcfe9f6869071e0765f3a032c9f5fd7\": container with ID starting with 46eae29efc7149e726699de0958f84b08dcfe9f6869071e0765f3a032c9f5fd7 not found: ID does not exist" containerID="46eae29efc7149e726699de0958f84b08dcfe9f6869071e0765f3a032c9f5fd7"
Jul 10 22:44:43.436533 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.436460    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46eae29efc7149e726699de0958f84b08dcfe9f6869071e0765f3a032c9f5fd7"} err="failed to get container status \"46eae29efc7149e726699de0958f84b08dcfe9f6869071e0765f3a032c9f5fd7\": rpc error: code = NotFound desc = could not find container \"46eae29efc7149e726699de0958f84b08dcfe9f6869071e0765f3a032c9f5fd7\": container with ID starting with 46eae29efc7149e726699de0958f84b08dcfe9f6869071e0765f3a032c9f5fd7 not found: ID does not exist"
Jul 10 22:44:43.436533 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.436482    2566 scope.go:117] "RemoveContainer" containerID="431c4b52b54ab9ef53abdd5f44753639030928d69cbbc3ddd6be8128a40dc8de"
Jul 10 22:44:43.436758 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:43.436740    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"431c4b52b54ab9ef53abdd5f44753639030928d69cbbc3ddd6be8128a40dc8de\": container with ID starting with 431c4b52b54ab9ef53abdd5f44753639030928d69cbbc3ddd6be8128a40dc8de not found: ID does not exist" containerID="431c4b52b54ab9ef53abdd5f44753639030928d69cbbc3ddd6be8128a40dc8de"
Jul 10 22:44:43.436843 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.436784    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"431c4b52b54ab9ef53abdd5f44753639030928d69cbbc3ddd6be8128a40dc8de"} err="failed to get container status \"431c4b52b54ab9ef53abdd5f44753639030928d69cbbc3ddd6be8128a40dc8de\": rpc error: code = NotFound desc = could not find container \"431c4b52b54ab9ef53abdd5f44753639030928d69cbbc3ddd6be8128a40dc8de\": container with ID starting with 431c4b52b54ab9ef53abdd5f44753639030928d69cbbc3ddd6be8128a40dc8de not found: ID does not exist"
Jul 10 22:44:43.436843 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.436810    2566 scope.go:117] "RemoveContainer" containerID="c30f41b65f2a70d241f53c3c03b6a0ce6dc0043bbf7e71e69ad1384d37282906"
Jul 10 22:44:43.437082 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:43.437067    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c30f41b65f2a70d241f53c3c03b6a0ce6dc0043bbf7e71e69ad1384d37282906\": container with ID starting with c30f41b65f2a70d241f53c3c03b6a0ce6dc0043bbf7e71e69ad1384d37282906 not found: ID does not exist" containerID="c30f41b65f2a70d241f53c3c03b6a0ce6dc0043bbf7e71e69ad1384d37282906"
Jul 10 22:44:43.437128 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437089    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30f41b65f2a70d241f53c3c03b6a0ce6dc0043bbf7e71e69ad1384d37282906"} err="failed to get container status \"c30f41b65f2a70d241f53c3c03b6a0ce6dc0043bbf7e71e69ad1384d37282906\": rpc error: code = NotFound desc = could not find container \"c30f41b65f2a70d241f53c3c03b6a0ce6dc0043bbf7e71e69ad1384d37282906\": container with ID starting with c30f41b65f2a70d241f53c3c03b6a0ce6dc0043bbf7e71e69ad1384d37282906 not found: ID does not exist"
Jul 10 22:44:43.437128 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437107    2566 scope.go:117] "RemoveContainer" containerID="76ea9a49611aab83e2177c9e31c4240c8f73a6d680ede052c4094d2c65bccc3d"
Jul 10 22:44:43.437341 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:43.437320    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76ea9a49611aab83e2177c9e31c4240c8f73a6d680ede052c4094d2c65bccc3d\": container with ID starting with 76ea9a49611aab83e2177c9e31c4240c8f73a6d680ede052c4094d2c65bccc3d not found: ID does not exist" containerID="76ea9a49611aab83e2177c9e31c4240c8f73a6d680ede052c4094d2c65bccc3d"
Jul 10 22:44:43.437410 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437339    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 22:44:43.437410 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437350    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76ea9a49611aab83e2177c9e31c4240c8f73a6d680ede052c4094d2c65bccc3d"} err="failed to get container status \"76ea9a49611aab83e2177c9e31c4240c8f73a6d680ede052c4094d2c65bccc3d\": rpc error: code = NotFound desc = could not find container \"76ea9a49611aab83e2177c9e31c4240c8f73a6d680ede052c4094d2c65bccc3d\": container with ID starting with 76ea9a49611aab83e2177c9e31c4240c8f73a6d680ede052c4094d2c65bccc3d not found: ID does not exist"
Jul 10 22:44:43.437410 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437369    2566 scope.go:117] "RemoveContainer" containerID="a57cf81baa474980e294d529e85beca30a50869776516bb072c6245be6be2e1c"
Jul 10 22:44:43.437605 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:43.437590    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a57cf81baa474980e294d529e85beca30a50869776516bb072c6245be6be2e1c\": container with ID starting with a57cf81baa474980e294d529e85beca30a50869776516bb072c6245be6be2e1c not found: ID does not exist" containerID="a57cf81baa474980e294d529e85beca30a50869776516bb072c6245be6be2e1c"
Jul 10 22:44:43.437660 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437610    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a57cf81baa474980e294d529e85beca30a50869776516bb072c6245be6be2e1c"} err="failed to get container status \"a57cf81baa474980e294d529e85beca30a50869776516bb072c6245be6be2e1c\": rpc error: code = NotFound desc = could not find container \"a57cf81baa474980e294d529e85beca30a50869776516bb072c6245be6be2e1c\": container with ID starting with a57cf81baa474980e294d529e85beca30a50869776516bb072c6245be6be2e1c not found: ID does not exist"
Jul 10 22:44:43.437660 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437628    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="kube-rbac-proxy"
Jul 10 22:44:43.437660 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437645    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="kube-rbac-proxy"
Jul 10 22:44:43.437660 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437657    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="alertmanager"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437663    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="alertmanager"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437672    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="kube-rbac-proxy-web"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437677    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="kube-rbac-proxy-web"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437686    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="init-config-reloader"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437692    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="init-config-reloader"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437698    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="kube-rbac-proxy-metric"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437704    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="kube-rbac-proxy-metric"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437629    2566 scope.go:117] "RemoveContainer" containerID="294dc1e58c03443f813997ab90be4996df1dd26c600fc910f5fed0b762715885"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437715    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="prom-label-proxy"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437720    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="prom-label-proxy"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437726    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="config-reloader"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437731    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="config-reloader"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437795    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="config-reloader"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437804    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="prom-label-proxy"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437811    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="kube-rbac-proxy"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437828    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="alertmanager"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437836    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="kube-rbac-proxy-web"
Jul 10 22:44:43.437912 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.437841    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" containerName="kube-rbac-proxy-metric"
Jul 10 22:44:43.438401 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:43.437978    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"294dc1e58c03443f813997ab90be4996df1dd26c600fc910f5fed0b762715885\": container with ID starting with 294dc1e58c03443f813997ab90be4996df1dd26c600fc910f5fed0b762715885 not found: ID does not exist" containerID="294dc1e58c03443f813997ab90be4996df1dd26c600fc910f5fed0b762715885"
Jul 10 22:44:43.438401 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.438002    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"294dc1e58c03443f813997ab90be4996df1dd26c600fc910f5fed0b762715885"} err="failed to get container status \"294dc1e58c03443f813997ab90be4996df1dd26c600fc910f5fed0b762715885\": rpc error: code = NotFound desc = could not find container \"294dc1e58c03443f813997ab90be4996df1dd26c600fc910f5fed0b762715885\": container with ID starting with 294dc1e58c03443f813997ab90be4996df1dd26c600fc910f5fed0b762715885 not found: ID does not exist"
Jul 10 22:44:43.441201 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.441186    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.443426 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.443406    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 22:44:43.443565 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.443407    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 22:44:43.443565 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.443441    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 22:44:43.443565 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.443513    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 22:44:43.443730 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.443668    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 22:44:43.443730 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.443705    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 22:44:43.443884 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.443735    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 22:44:43.443884 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.443733    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-t7n4v\""
Jul 10 22:44:43.444031 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.444011    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 22:44:43.449157 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.448993    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 22:44:43.456344 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.456322    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 22:44:43.550453 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.550414    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.550453 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.550453    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fa655c0-b60b-44c1-8286-2ff003035306-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.550704 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.550472    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fa655c0-b60b-44c1-8286-2ff003035306-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.550704 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.550565    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fa655c0-b60b-44c1-8286-2ff003035306-config-out\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.550704 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.550600    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.550704 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.550634    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-web-config\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.550704 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.550683    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.550946 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.550709    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8fa655c0-b60b-44c1-8286-2ff003035306-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.550946 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.550737    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk4r6\" (UniqueName: \"kubernetes.io/projected/8fa655c0-b60b-44c1-8286-2ff003035306-kube-api-access-gk4r6\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.550946 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.550794    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa655c0-b60b-44c1-8286-2ff003035306-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.550946 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.550841    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.550946 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.550902    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.550946 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.550932    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-config-volume\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.652139 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.652043    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.652139 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.652086    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-config-volume\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.652362 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.652211    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.652362 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.652244    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fa655c0-b60b-44c1-8286-2ff003035306-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.652362 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.652274    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fa655c0-b60b-44c1-8286-2ff003035306-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.652362 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.652307    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fa655c0-b60b-44c1-8286-2ff003035306-config-out\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.652362 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.652325    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.652362 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.652348    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-web-config\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.652653 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.652379    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.652653 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.652404    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8fa655c0-b60b-44c1-8286-2ff003035306-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.652653 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.652428    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk4r6\" (UniqueName: \"kubernetes.io/projected/8fa655c0-b60b-44c1-8286-2ff003035306-kube-api-access-gk4r6\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.652653 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.652465    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa655c0-b60b-44c1-8286-2ff003035306-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.652653 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.652500    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.653865 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.653007    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8fa655c0-b60b-44c1-8286-2ff003035306-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.653865 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.653570    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8fa655c0-b60b-44c1-8286-2ff003035306-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.654746 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.654716    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8fa655c0-b60b-44c1-8286-2ff003035306-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.655238 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.655108    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8fa655c0-b60b-44c1-8286-2ff003035306-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.655238 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.655189    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.655378 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.655342    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.655623 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.655602    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.655679 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.655628    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.655877 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.655853    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-config-volume\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.656111 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.656092    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-web-config\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.656458 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.656441    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8fa655c0-b60b-44c1-8286-2ff003035306-config-out\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.656822 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.656806    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8fa655c0-b60b-44c1-8286-2ff003035306-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.661077 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.661057    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk4r6\" (UniqueName: \"kubernetes.io/projected/8fa655c0-b60b-44c1-8286-2ff003035306-kube-api-access-gk4r6\") pod \"alertmanager-main-0\" (UID: \"8fa655c0-b60b-44c1-8286-2ff003035306\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.751961 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.751931    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 22:44:43.890632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:43.890341    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 22:44:43.893044 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:44:43.893014    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa655c0_b60b_44c1_8286_2ff003035306.slice/crio-2789e77afb6d63688dd78c76133c8021275d7f1ad31e8d56921fbc509dc0d429 WatchSource:0}: Error finding container 2789e77afb6d63688dd78c76133c8021275d7f1ad31e8d56921fbc509dc0d429: Status 404 returned error can't find the container with id 2789e77afb6d63688dd78c76133c8021275d7f1ad31e8d56921fbc509dc0d429
Jul 10 22:44:44.391571 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:44.391532    2566 generic.go:356] "Generic (PLEG): container finished" podID="8fa655c0-b60b-44c1-8286-2ff003035306" containerID="433b853c2b4236a3f745eea8f926786115ba70d9e093dbf60355e926d51761df" exitCode=0
Jul 10 22:44:44.391571 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:44.391575    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fa655c0-b60b-44c1-8286-2ff003035306","Type":"ContainerDied","Data":"433b853c2b4236a3f745eea8f926786115ba70d9e093dbf60355e926d51761df"}
Jul 10 22:44:44.391992 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:44.391667    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fa655c0-b60b-44c1-8286-2ff003035306","Type":"ContainerStarted","Data":"2789e77afb6d63688dd78c76133c8021275d7f1ad31e8d56921fbc509dc0d429"}
Jul 10 22:44:44.803023 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:44.802990    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06eaae49-d25f-43a5-bcb6-ec0748c8191c" path="/var/lib/kubelet/pods/06eaae49-d25f-43a5-bcb6-ec0748c8191c/volumes"
Jul 10 22:44:45.398671 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.398632    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fa655c0-b60b-44c1-8286-2ff003035306","Type":"ContainerStarted","Data":"7b9d45b9461a8f01b72f966e61153dfcb96bb25afef81959463f3f3086d45bf0"}
Jul 10 22:44:45.399284 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.398710    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fa655c0-b60b-44c1-8286-2ff003035306","Type":"ContainerStarted","Data":"51747308ba6b7c4bbf5c83c55f541afb303b1398a8789bda55db7c4764e9c388"}
Jul 10 22:44:45.399284 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.398754    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fa655c0-b60b-44c1-8286-2ff003035306","Type":"ContainerStarted","Data":"9a54c4c4c4a06114675d6b0aa759e26d1f091b954cea0d2138a2cd28917c0b10"}
Jul 10 22:44:45.399284 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.398822    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fa655c0-b60b-44c1-8286-2ff003035306","Type":"ContainerStarted","Data":"1cccc09b23aff478b5a33ec40e7cc6a6bde60afaf4ee178cc5b8ce235cc15437"}
Jul 10 22:44:45.399284 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.398871    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fa655c0-b60b-44c1-8286-2ff003035306","Type":"ContainerStarted","Data":"ea682c6e8555f851361e9e5ce2ba9e1c9c6e50b32b4c38b1814adab06ac68466"}
Jul 10 22:44:45.399284 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.398907    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8fa655c0-b60b-44c1-8286-2ff003035306","Type":"ContainerStarted","Data":"86bd0cc53d0399bb88f9fa8b6c168714de0c5f24ed293e82205dd4f8d1744cf6"}
Jul 10 22:44:45.430041 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.429979    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.4136739289999998 podStartE2EDuration="2.429958091s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.284162ms" isStatefulPod=false podCreationTimestamp="2026-07-10 22:44:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:44:45.428094461 +0000 UTC m=+105.121452776" watchObservedRunningTime="2026-07-10 22:44:45.429958091 +0000 UTC m=+105.123316368"
Jul 10 22:44:45.996931 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.996903    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 22:44:45.997301 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.997199    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="prometheus" containerID="cri-o://5067ed4c25b519dff317f693467a13d168570ffa6b999fa5a5eafa6b5b88f5ad" gracePeriod=600
Jul 10 22:44:45.997301 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.997239    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b5b4182c7ac74e0e306ec5ca1bb40acdd8807d561fd7443afa275566c94915eb" gracePeriod=600
Jul 10 22:44:45.997301 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.997246    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="kube-rbac-proxy" containerID="cri-o://f40083dbeb15dcb37ef7459e04bba896ef3cbf64a51a59758c634712a3514822" gracePeriod=600
Jul 10 22:44:45.997534 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.997239    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="config-reloader" containerID="cri-o://002ce6e2fc7acc7216eb490b5464053308923d24dabd5b674fe3fb9c22aac3f8" gracePeriod=600
Jul 10 22:44:45.997534 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.997231    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="thanos-sidecar" containerID="cri-o://15e04b47265f4e78a30d53fd548be82ee145424b15efa2b6200f069a44713f18" gracePeriod=600
Jul 10 22:44:45.997534 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:45.997213    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="kube-rbac-proxy-web" containerID="cri-o://85d0f47b05560f8bef3c1bf490679d5513e819543842f5f1a197a43ad0febea7" gracePeriod=600
Jul 10 22:44:46.405447 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:46.405415    2566 generic.go:356] "Generic (PLEG): container finished" podID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerID="b5b4182c7ac74e0e306ec5ca1bb40acdd8807d561fd7443afa275566c94915eb" exitCode=0
Jul 10 22:44:46.405447 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:46.405439    2566 generic.go:356] "Generic (PLEG): container finished" podID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerID="f40083dbeb15dcb37ef7459e04bba896ef3cbf64a51a59758c634712a3514822" exitCode=0
Jul 10 22:44:46.405447 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:46.405446    2566 generic.go:356] "Generic (PLEG): container finished" podID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerID="15e04b47265f4e78a30d53fd548be82ee145424b15efa2b6200f069a44713f18" exitCode=0
Jul 10 22:44:46.405447 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:46.405452    2566 generic.go:356] "Generic (PLEG): container finished" podID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerID="002ce6e2fc7acc7216eb490b5464053308923d24dabd5b674fe3fb9c22aac3f8" exitCode=0
Jul 10 22:44:46.405934 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:46.405458    2566 generic.go:356] "Generic (PLEG): container finished" podID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerID="5067ed4c25b519dff317f693467a13d168570ffa6b999fa5a5eafa6b5b88f5ad" exitCode=0
Jul 10 22:44:46.405934 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:46.405485    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerDied","Data":"b5b4182c7ac74e0e306ec5ca1bb40acdd8807d561fd7443afa275566c94915eb"}
Jul 10 22:44:46.405934 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:46.405560    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerDied","Data":"f40083dbeb15dcb37ef7459e04bba896ef3cbf64a51a59758c634712a3514822"}
Jul 10 22:44:46.405934 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:46.405598    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerDied","Data":"15e04b47265f4e78a30d53fd548be82ee145424b15efa2b6200f069a44713f18"}
Jul 10 22:44:46.405934 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:46.405640    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerDied","Data":"002ce6e2fc7acc7216eb490b5464053308923d24dabd5b674fe3fb9c22aac3f8"}
Jul 10 22:44:46.405934 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:46.405675    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerDied","Data":"5067ed4c25b519dff317f693467a13d168570ffa6b999fa5a5eafa6b5b88f5ad"}
Jul 10 22:44:47.238058 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.238033    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.286462 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286381    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-trusted-ca-bundle\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.286462 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286419    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-1\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.286462 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286453    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-thanos-prometheus-http-client-file\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.286728 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286591    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-config\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.286728 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286642    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-kube-rbac-proxy\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.286728 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286673    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-tls\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.286728 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286698    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-web-config\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.286961 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286730    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48db2bfb-9638-43a9-9a95-e8c6e60347fc-config-out\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.286961 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286756    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-metrics-client-ca\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.286961 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286794    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 22:44:47.286961 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286819    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-serving-certs-ca-bundle\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.286961 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286846    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-metrics-client-certs\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.286961 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286845    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 22:44:47.286961 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286868    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-kubelet-serving-ca-bundle\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.286961 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286908    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48db2bfb-9638-43a9-9a95-e8c6e60347fc-tls-assets\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.287335 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.286986    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-2\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.287335 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.287019    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-grpc-tls\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.287335 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.287067    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-db\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.287335 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.287132    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cpwn\" (UniqueName: \"kubernetes.io/projected/48db2bfb-9638-43a9-9a95-e8c6e60347fc-kube-api-access-7cpwn\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.287335 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.287171    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.287335 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.287202    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-0\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.287335 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.287239    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\" (UID: \"48db2bfb-9638-43a9-9a95-e8c6e60347fc\") "
Jul 10 22:44:47.287335 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.287253    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 22:44:47.287720 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.287503    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.287720 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.287523    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.287720 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.287540    2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-metrics-client-ca\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.287895 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.287728    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 22:44:47.288009 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.287982    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 22:44:47.289074 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.288990    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:44:47.290528 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.289384    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 22:44:47.291141 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.291080    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 22:44:47.292305 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.292276    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48db2bfb-9638-43a9-9a95-e8c6e60347fc-config-out" (OuterVolumeSpecName: "config-out") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:44:47.292711 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.292682    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:47.292879 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.292819    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:47.293145 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.293017    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:47.293290 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.293266    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:47.293376 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.293316    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48db2bfb-9638-43a9-9a95-e8c6e60347fc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:44:47.293445 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.293379    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-config" (OuterVolumeSpecName: "config") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:47.293445 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.293432    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:47.293555 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.293515    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:47.293604 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.293568    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:47.293672 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.293651    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48db2bfb-9638-43a9-9a95-e8c6e60347fc-kube-api-access-7cpwn" (OuterVolumeSpecName: "kube-api-access-7cpwn") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "kube-api-access-7cpwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:44:47.302545 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.302515    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-web-config" (OuterVolumeSpecName: "web-config") pod "48db2bfb-9638-43a9-9a95-e8c6e60347fc" (UID: "48db2bfb-9638-43a9-9a95-e8c6e60347fc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:44:47.388058 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388020    2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388058 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388052    2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388058 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388063    2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-kube-rbac-proxy\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388074    2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388084    2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-web-config\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388094    2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48db2bfb-9638-43a9-9a95-e8c6e60347fc-config-out\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388102    2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388112    2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-metrics-client-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388121    2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388129    2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48db2bfb-9638-43a9-9a95-e8c6e60347fc-tls-assets\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388138    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388147    2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-grpc-tls\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388155    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-db\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388164    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cpwn\" (UniqueName: \"kubernetes.io/projected/48db2bfb-9638-43a9-9a95-e8c6e60347fc-kube-api-access-7cpwn\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388174    2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388182    2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48db2bfb-9638-43a9-9a95-e8c6e60347fc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.388294 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.388191    2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48db2bfb-9638-43a9-9a95-e8c6e60347fc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:44:47.412617 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.412585    2566 generic.go:356] "Generic (PLEG): container finished" podID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerID="85d0f47b05560f8bef3c1bf490679d5513e819543842f5f1a197a43ad0febea7" exitCode=0
Jul 10 22:44:47.413003 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.412658    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.413003 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.412666    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerDied","Data":"85d0f47b05560f8bef3c1bf490679d5513e819543842f5f1a197a43ad0febea7"}
Jul 10 22:44:47.413003 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.412732    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48db2bfb-9638-43a9-9a95-e8c6e60347fc","Type":"ContainerDied","Data":"f7ad13b6a19f65d2270107d11f9d5a0e70ee5bcf754004b0ed9459780f5cd1af"}
Jul 10 22:44:47.413003 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.412783    2566 scope.go:117] "RemoveContainer" containerID="b5b4182c7ac74e0e306ec5ca1bb40acdd8807d561fd7443afa275566c94915eb"
Jul 10 22:44:47.421099 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.421080    2566 scope.go:117] "RemoveContainer" containerID="f40083dbeb15dcb37ef7459e04bba896ef3cbf64a51a59758c634712a3514822"
Jul 10 22:44:47.431037 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.431020    2566 scope.go:117] "RemoveContainer" containerID="85d0f47b05560f8bef3c1bf490679d5513e819543842f5f1a197a43ad0febea7"
Jul 10 22:44:47.438286 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.438264    2566 scope.go:117] "RemoveContainer" containerID="15e04b47265f4e78a30d53fd548be82ee145424b15efa2b6200f069a44713f18"
Jul 10 22:44:47.438828 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.438809    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 22:44:47.444649 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.444625    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 22:44:47.446054 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.446033    2566 scope.go:117] "RemoveContainer" containerID="002ce6e2fc7acc7216eb490b5464053308923d24dabd5b674fe3fb9c22aac3f8"
Jul 10 22:44:47.452790 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.452751    2566 scope.go:117] "RemoveContainer" containerID="5067ed4c25b519dff317f693467a13d168570ffa6b999fa5a5eafa6b5b88f5ad"
Jul 10 22:44:47.459736 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.459721    2566 scope.go:117] "RemoveContainer" containerID="9b23c14dfce56f984e0749ed1a4659c050bf08265f81220e8e9fcd4e37c600dd"
Jul 10 22:44:47.466664 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.466647    2566 scope.go:117] "RemoveContainer" containerID="b5b4182c7ac74e0e306ec5ca1bb40acdd8807d561fd7443afa275566c94915eb"
Jul 10 22:44:47.466953 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:47.466926    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5b4182c7ac74e0e306ec5ca1bb40acdd8807d561fd7443afa275566c94915eb\": container with ID starting with b5b4182c7ac74e0e306ec5ca1bb40acdd8807d561fd7443afa275566c94915eb not found: ID does not exist" containerID="b5b4182c7ac74e0e306ec5ca1bb40acdd8807d561fd7443afa275566c94915eb"
Jul 10 22:44:47.467048 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.466956    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5b4182c7ac74e0e306ec5ca1bb40acdd8807d561fd7443afa275566c94915eb"} err="failed to get container status \"b5b4182c7ac74e0e306ec5ca1bb40acdd8807d561fd7443afa275566c94915eb\": rpc error: code = NotFound desc = could not find container \"b5b4182c7ac74e0e306ec5ca1bb40acdd8807d561fd7443afa275566c94915eb\": container with ID starting with b5b4182c7ac74e0e306ec5ca1bb40acdd8807d561fd7443afa275566c94915eb not found: ID does not exist"
Jul 10 22:44:47.467048 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.466978    2566 scope.go:117] "RemoveContainer" containerID="f40083dbeb15dcb37ef7459e04bba896ef3cbf64a51a59758c634712a3514822"
Jul 10 22:44:47.467256 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:47.467240    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f40083dbeb15dcb37ef7459e04bba896ef3cbf64a51a59758c634712a3514822\": container with ID starting with f40083dbeb15dcb37ef7459e04bba896ef3cbf64a51a59758c634712a3514822 not found: ID does not exist" containerID="f40083dbeb15dcb37ef7459e04bba896ef3cbf64a51a59758c634712a3514822"
Jul 10 22:44:47.467297 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.467261    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f40083dbeb15dcb37ef7459e04bba896ef3cbf64a51a59758c634712a3514822"} err="failed to get container status \"f40083dbeb15dcb37ef7459e04bba896ef3cbf64a51a59758c634712a3514822\": rpc error: code = NotFound desc = could not find container \"f40083dbeb15dcb37ef7459e04bba896ef3cbf64a51a59758c634712a3514822\": container with ID starting with f40083dbeb15dcb37ef7459e04bba896ef3cbf64a51a59758c634712a3514822 not found: ID does not exist"
Jul 10 22:44:47.467297 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.467276    2566 scope.go:117] "RemoveContainer" containerID="85d0f47b05560f8bef3c1bf490679d5513e819543842f5f1a197a43ad0febea7"
Jul 10 22:44:47.467514 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:47.467496    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85d0f47b05560f8bef3c1bf490679d5513e819543842f5f1a197a43ad0febea7\": container with ID starting with 85d0f47b05560f8bef3c1bf490679d5513e819543842f5f1a197a43ad0febea7 not found: ID does not exist" containerID="85d0f47b05560f8bef3c1bf490679d5513e819543842f5f1a197a43ad0febea7"
Jul 10 22:44:47.467555 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.467522    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85d0f47b05560f8bef3c1bf490679d5513e819543842f5f1a197a43ad0febea7"} err="failed to get container status \"85d0f47b05560f8bef3c1bf490679d5513e819543842f5f1a197a43ad0febea7\": rpc error: code = NotFound desc = could not find container \"85d0f47b05560f8bef3c1bf490679d5513e819543842f5f1a197a43ad0febea7\": container with ID starting with 85d0f47b05560f8bef3c1bf490679d5513e819543842f5f1a197a43ad0febea7 not found: ID does not exist"
Jul 10 22:44:47.467555 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.467540    2566 scope.go:117] "RemoveContainer" containerID="15e04b47265f4e78a30d53fd548be82ee145424b15efa2b6200f069a44713f18"
Jul 10 22:44:47.467809 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:47.467791    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15e04b47265f4e78a30d53fd548be82ee145424b15efa2b6200f069a44713f18\": container with ID starting with 15e04b47265f4e78a30d53fd548be82ee145424b15efa2b6200f069a44713f18 not found: ID does not exist" containerID="15e04b47265f4e78a30d53fd548be82ee145424b15efa2b6200f069a44713f18"
Jul 10 22:44:47.467869 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.467813    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15e04b47265f4e78a30d53fd548be82ee145424b15efa2b6200f069a44713f18"} err="failed to get container status \"15e04b47265f4e78a30d53fd548be82ee145424b15efa2b6200f069a44713f18\": rpc error: code = NotFound desc = could not find container \"15e04b47265f4e78a30d53fd548be82ee145424b15efa2b6200f069a44713f18\": container with ID starting with 15e04b47265f4e78a30d53fd548be82ee145424b15efa2b6200f069a44713f18 not found: ID does not exist"
Jul 10 22:44:47.467869 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.467827    2566 scope.go:117] "RemoveContainer" containerID="002ce6e2fc7acc7216eb490b5464053308923d24dabd5b674fe3fb9c22aac3f8"
Jul 10 22:44:47.468065 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:47.468046    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"002ce6e2fc7acc7216eb490b5464053308923d24dabd5b674fe3fb9c22aac3f8\": container with ID starting with 002ce6e2fc7acc7216eb490b5464053308923d24dabd5b674fe3fb9c22aac3f8 not found: ID does not exist" containerID="002ce6e2fc7acc7216eb490b5464053308923d24dabd5b674fe3fb9c22aac3f8"
Jul 10 22:44:47.468110 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.468070    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002ce6e2fc7acc7216eb490b5464053308923d24dabd5b674fe3fb9c22aac3f8"} err="failed to get container status \"002ce6e2fc7acc7216eb490b5464053308923d24dabd5b674fe3fb9c22aac3f8\": rpc error: code = NotFound desc = could not find container \"002ce6e2fc7acc7216eb490b5464053308923d24dabd5b674fe3fb9c22aac3f8\": container with ID starting with 002ce6e2fc7acc7216eb490b5464053308923d24dabd5b674fe3fb9c22aac3f8 not found: ID does not exist"
Jul 10 22:44:47.468110 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.468086    2566 scope.go:117] "RemoveContainer" containerID="5067ed4c25b519dff317f693467a13d168570ffa6b999fa5a5eafa6b5b88f5ad"
Jul 10 22:44:47.468294 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:47.468281    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5067ed4c25b519dff317f693467a13d168570ffa6b999fa5a5eafa6b5b88f5ad\": container with ID starting with 5067ed4c25b519dff317f693467a13d168570ffa6b999fa5a5eafa6b5b88f5ad not found: ID does not exist" containerID="5067ed4c25b519dff317f693467a13d168570ffa6b999fa5a5eafa6b5b88f5ad"
Jul 10 22:44:47.468345 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.468300    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5067ed4c25b519dff317f693467a13d168570ffa6b999fa5a5eafa6b5b88f5ad"} err="failed to get container status \"5067ed4c25b519dff317f693467a13d168570ffa6b999fa5a5eafa6b5b88f5ad\": rpc error: code = NotFound desc = could not find container \"5067ed4c25b519dff317f693467a13d168570ffa6b999fa5a5eafa6b5b88f5ad\": container with ID starting with 5067ed4c25b519dff317f693467a13d168570ffa6b999fa5a5eafa6b5b88f5ad not found: ID does not exist"
Jul 10 22:44:47.468345 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.468312    2566 scope.go:117] "RemoveContainer" containerID="9b23c14dfce56f984e0749ed1a4659c050bf08265f81220e8e9fcd4e37c600dd"
Jul 10 22:44:47.468540 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:44:47.468525    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b23c14dfce56f984e0749ed1a4659c050bf08265f81220e8e9fcd4e37c600dd\": container with ID starting with 9b23c14dfce56f984e0749ed1a4659c050bf08265f81220e8e9fcd4e37c600dd not found: ID does not exist" containerID="9b23c14dfce56f984e0749ed1a4659c050bf08265f81220e8e9fcd4e37c600dd"
Jul 10 22:44:47.468586 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.468542    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b23c14dfce56f984e0749ed1a4659c050bf08265f81220e8e9fcd4e37c600dd"} err="failed to get container status \"9b23c14dfce56f984e0749ed1a4659c050bf08265f81220e8e9fcd4e37c600dd\": rpc error: code = NotFound desc = could not find container \"9b23c14dfce56f984e0749ed1a4659c050bf08265f81220e8e9fcd4e37c600dd\": container with ID starting with 9b23c14dfce56f984e0749ed1a4659c050bf08265f81220e8e9fcd4e37c600dd not found: ID does not exist"
Jul 10 22:44:47.475174 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475150    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 22:44:47.475413 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475401    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="init-config-reloader"
Jul 10 22:44:47.475456 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475414    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="init-config-reloader"
Jul 10 22:44:47.475456 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475422    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="config-reloader"
Jul 10 22:44:47.475456 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475428    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="config-reloader"
Jul 10 22:44:47.475456 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475444    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="prometheus"
Jul 10 22:44:47.475456 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475450    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="prometheus"
Jul 10 22:44:47.475456 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475456    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="thanos-sidecar"
Jul 10 22:44:47.475626 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475461    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="thanos-sidecar"
Jul 10 22:44:47.475626 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475468    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="kube-rbac-proxy-thanos"
Jul 10 22:44:47.475626 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475474    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="kube-rbac-proxy-thanos"
Jul 10 22:44:47.475626 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475480    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="kube-rbac-proxy"
Jul 10 22:44:47.475626 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475486    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="kube-rbac-proxy"
Jul 10 22:44:47.475626 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475493    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="kube-rbac-proxy-web"
Jul 10 22:44:47.475626 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475499    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="kube-rbac-proxy-web"
Jul 10 22:44:47.475626 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475542    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="kube-rbac-proxy-web"
Jul 10 22:44:47.475626 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475550    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="config-reloader"
Jul 10 22:44:47.475626 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475557    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="prometheus"
Jul 10 22:44:47.475626 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475563    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="kube-rbac-proxy"
Jul 10 22:44:47.475626 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475569    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="kube-rbac-proxy-thanos"
Jul 10 22:44:47.475626 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.475575    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" containerName="thanos-sidecar"
Jul 10 22:44:47.485692 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.485674    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.488499 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.488478    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 22:44:47.488917 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.488892    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7lh2um85g8onp\""
Jul 10 22:44:47.488917 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.488910    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 22:44:47.489069 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.488936    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 22:44:47.489069 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.488943    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 22:44:47.489069 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.488910    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 22:44:47.489293 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.489281    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 22:44:47.489364 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.489351    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 22:44:47.489421 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.489382    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 22:44:47.489421 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.489398    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 22:44:47.489511 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.489350    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 22:44:47.489511 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.489437    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wthfd\""
Jul 10 22:44:47.489729 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.489712    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 22:44:47.489855 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.489840    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 22:44:47.489947 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.489853    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 22:44:47.494274 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.494256    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 22:44:47.496751 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.496734    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 22:44:47.501702 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.501683    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 22:44:47.589774 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.589660    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.589774 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.589704    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.589774 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.589743    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590070 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.589799    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-config\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590070 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.589833    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590070 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.589862    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590070 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.589887    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590070 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.589914    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590070 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.589968    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590070 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.589998    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590070 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.590032    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590070 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.590061    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590446 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.590089    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49a1e075-949b-4212-aef4-73b68865aa24-config-out\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590446 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.590122    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590446 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.590153    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-web-config\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590446 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.590179    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590446 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.590205    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590446 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.590230    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szdbz\" (UniqueName: \"kubernetes.io/projected/49a1e075-949b-4212-aef4-73b68865aa24-kube-api-access-szdbz\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590446 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.590273    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49a1e075-949b-4212-aef4-73b68865aa24-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.590446 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.590296    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.690902 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.690867    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.690902 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.690902    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691120 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.690924    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691120 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.690943    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691120 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.690990    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49a1e075-949b-4212-aef4-73b68865aa24-config-out\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691120 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691014    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691120 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691035    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-web-config\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691120 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691060    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691120 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691082    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691120 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691104    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szdbz\" (UniqueName: \"kubernetes.io/projected/49a1e075-949b-4212-aef4-73b68865aa24-kube-api-access-szdbz\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691495 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691131    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49a1e075-949b-4212-aef4-73b68865aa24-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691495 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691147    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691495 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691189    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691495 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691215    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691495 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691251    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691495 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691279    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-config\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691495 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691308    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691495 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691336    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691495 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691367    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.691495 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691396    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.692139 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691712    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.692139 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.691872    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.692139 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.692072    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.692475 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.692450    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.694195 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.694165    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.694195 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.694184    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.694357 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.694281    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49a1e075-949b-4212-aef4-73b68865aa24-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.694611 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.694583    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.694801 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.694778    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.694884 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.694794    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.695142 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.695103    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.695222 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.695127    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.695807 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.695350    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/49a1e075-949b-4212-aef4-73b68865aa24-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.695807 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.695625    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49a1e075-949b-4212-aef4-73b68865aa24-config-out\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.695807 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.695747    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.696467 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.696445    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-web-config\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.696646 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.696622    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.697110 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.697090    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.697185 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.697139    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/49a1e075-949b-4212-aef4-73b68865aa24-config\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.702930 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.702914    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szdbz\" (UniqueName: \"kubernetes.io/projected/49a1e075-949b-4212-aef4-73b68865aa24-kube-api-access-szdbz\") pod \"prometheus-k8s-0\" (UID: \"49a1e075-949b-4212-aef4-73b68865aa24\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.796979 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.796943    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:44:47.963077 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:47.963025    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 22:44:47.965511 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:44:47.965482    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a1e075_949b_4212_aef4_73b68865aa24.slice/crio-70f63e7d47ccea8721b58e39be9850dcb9d721b1db73dcfaf8018e867e24ed67 WatchSource:0}: Error finding container 70f63e7d47ccea8721b58e39be9850dcb9d721b1db73dcfaf8018e867e24ed67: Status 404 returned error can't find the container with id 70f63e7d47ccea8721b58e39be9850dcb9d721b1db73dcfaf8018e867e24ed67
Jul 10 22:44:48.419542 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:48.419451    2566 generic.go:356] "Generic (PLEG): container finished" podID="49a1e075-949b-4212-aef4-73b68865aa24" containerID="d2b8dc59a76906aeff7ed048624e388eaebef02dfa325423ad725d3ea8776c69" exitCode=0
Jul 10 22:44:48.419542 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:48.419498    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"49a1e075-949b-4212-aef4-73b68865aa24","Type":"ContainerDied","Data":"d2b8dc59a76906aeff7ed048624e388eaebef02dfa325423ad725d3ea8776c69"}
Jul 10 22:44:48.419951 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:48.419595    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"49a1e075-949b-4212-aef4-73b68865aa24","Type":"ContainerStarted","Data":"70f63e7d47ccea8721b58e39be9850dcb9d721b1db73dcfaf8018e867e24ed67"}
Jul 10 22:44:48.801706 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:48.801671    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48db2bfb-9638-43a9-9a95-e8c6e60347fc" path="/var/lib/kubelet/pods/48db2bfb-9638-43a9-9a95-e8c6e60347fc/volumes"
Jul 10 22:44:49.427314 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:49.427282    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"49a1e075-949b-4212-aef4-73b68865aa24","Type":"ContainerStarted","Data":"301f6d1faf06151cfbee5ee34a5157c7aeae13ff034a75bc0a10113a563709ed"}
Jul 10 22:44:49.427674 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:49.427354    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"49a1e075-949b-4212-aef4-73b68865aa24","Type":"ContainerStarted","Data":"b142bd8063ab1f092da9b753c9a7762ef2898a80a59d005f4de6788060cfa8eb"}
Jul 10 22:44:49.427674 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:49.427382    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"49a1e075-949b-4212-aef4-73b68865aa24","Type":"ContainerStarted","Data":"c1716bc64228b5db4fabf11ce4bd3da35ec28bc8b5ae8ce4fb74ef40c8d1ffd1"}
Jul 10 22:44:49.427674 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:49.427413    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"49a1e075-949b-4212-aef4-73b68865aa24","Type":"ContainerStarted","Data":"da62fe6cc3057a45ed038181ba5878a41b5f43a0ec3d6b9a4914ba256ece76e8"}
Jul 10 22:44:49.427674 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:49.427440    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"49a1e075-949b-4212-aef4-73b68865aa24","Type":"ContainerStarted","Data":"35f1ec12c954b598d75a8c59e594cde4e75fbee871295a48dc4ffbb49a53fbd4"}
Jul 10 22:44:49.427674 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:49.427462    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"49a1e075-949b-4212-aef4-73b68865aa24","Type":"ContainerStarted","Data":"952c3a5ab5f1e9aa8fb09601b4b0fd2f7fcc272107e2d10973dfaa1c9e518b57"}
Jul 10 22:44:49.454038 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:49.453973    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.4313053 podStartE2EDuration="2.453949558s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.644258ms" isStatefulPod=false podCreationTimestamp="2026-07-10 22:44:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:44:49.452262229 +0000 UTC m=+109.145620505" watchObservedRunningTime="2026-07-10 22:44:49.453949558 +0000 UTC m=+109.147307834"
Jul 10 22:44:52.294543 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:52.294511    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x5vjs"
Jul 10 22:44:52.807153 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:44:52.805717    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:45:47.797831 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:45:47.797791    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:45:47.813083 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:45:47.813053    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:45:48.659199 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:45:48.659173    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 22:47:22.413720 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.413631    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x9hh4"]
Jul 10 22:47:22.415542 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.415526    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x9hh4"
Jul 10 22:47:22.419044 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.419021    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 10 22:47:22.419359 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.419339    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-j4d54\""
Jul 10 22:47:22.419943 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.419926    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 10 22:47:22.428031 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.428009    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x9hh4"]
Jul 10 22:47:22.480612 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.480577    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1fee533d-f4e8-4e6a-85d3-b218695d4fd4-bound-sa-token\") pod \"cert-manager-55b4d954d5-x9hh4\" (UID: \"1fee533d-f4e8-4e6a-85d3-b218695d4fd4\") " pod="cert-manager/cert-manager-55b4d954d5-x9hh4"
Jul 10 22:47:22.480612 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.480617    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pphzf\" (UniqueName: \"kubernetes.io/projected/1fee533d-f4e8-4e6a-85d3-b218695d4fd4-kube-api-access-pphzf\") pod \"cert-manager-55b4d954d5-x9hh4\" (UID: \"1fee533d-f4e8-4e6a-85d3-b218695d4fd4\") " pod="cert-manager/cert-manager-55b4d954d5-x9hh4"
Jul 10 22:47:22.581668 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.581629    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1fee533d-f4e8-4e6a-85d3-b218695d4fd4-bound-sa-token\") pod \"cert-manager-55b4d954d5-x9hh4\" (UID: \"1fee533d-f4e8-4e6a-85d3-b218695d4fd4\") " pod="cert-manager/cert-manager-55b4d954d5-x9hh4"
Jul 10 22:47:22.581668 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.581668    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pphzf\" (UniqueName: \"kubernetes.io/projected/1fee533d-f4e8-4e6a-85d3-b218695d4fd4-kube-api-access-pphzf\") pod \"cert-manager-55b4d954d5-x9hh4\" (UID: \"1fee533d-f4e8-4e6a-85d3-b218695d4fd4\") " pod="cert-manager/cert-manager-55b4d954d5-x9hh4"
Jul 10 22:47:22.589475 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.589439    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1fee533d-f4e8-4e6a-85d3-b218695d4fd4-bound-sa-token\") pod \"cert-manager-55b4d954d5-x9hh4\" (UID: \"1fee533d-f4e8-4e6a-85d3-b218695d4fd4\") " pod="cert-manager/cert-manager-55b4d954d5-x9hh4"
Jul 10 22:47:22.589623 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.589605    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pphzf\" (UniqueName: \"kubernetes.io/projected/1fee533d-f4e8-4e6a-85d3-b218695d4fd4-kube-api-access-pphzf\") pod \"cert-manager-55b4d954d5-x9hh4\" (UID: \"1fee533d-f4e8-4e6a-85d3-b218695d4fd4\") " pod="cert-manager/cert-manager-55b4d954d5-x9hh4"
Jul 10 22:47:22.739986 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.739899    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-x9hh4"
Jul 10 22:47:22.880453 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.880415    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-x9hh4"]
Jul 10 22:47:22.885261 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:47:22.885235    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fee533d_f4e8_4e6a_85d3_b218695d4fd4.slice/crio-a6dd5fa677ee8a26ebf565ee895d88d96a129306a3c71264fc4a6c8293d260bb WatchSource:0}: Error finding container a6dd5fa677ee8a26ebf565ee895d88d96a129306a3c71264fc4a6c8293d260bb: Status 404 returned error can't find the container with id a6dd5fa677ee8a26ebf565ee895d88d96a129306a3c71264fc4a6c8293d260bb
Jul 10 22:47:22.972575 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:22.972538    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x9hh4" event={"ID":"1fee533d-f4e8-4e6a-85d3-b218695d4fd4","Type":"ContainerStarted","Data":"a6dd5fa677ee8a26ebf565ee895d88d96a129306a3c71264fc4a6c8293d260bb"}
Jul 10 22:47:25.986308 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:25.986266    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-x9hh4" event={"ID":"1fee533d-f4e8-4e6a-85d3-b218695d4fd4","Type":"ContainerStarted","Data":"161c4be7f4d80d8d6b86a2b8b44bd25375ea9baeef6b7c8576e3f25db30b202a"}
Jul 10 22:47:26.004679 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:26.004612    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-x9hh4" podStartSLOduration=1.2985761230000001 podStartE2EDuration="4.004590667s" totalImagesPullingTime="2.706014544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:47:26.003221644 +0000 UTC m=+265.696579934" watchObservedRunningTime="2026-07-10 22:47:26.004590667 +0000 UTC m=+265.697948942"
Jul 10 22:47:41.319665 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.319629    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"]
Jul 10 22:47:41.322282 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.322248    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.329991 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.329971    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l7nx4\""
Jul 10 22:47:41.330118 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.330089    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 22:47:41.330454 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.330434    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 22:47:41.330566 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.330473    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 22:47:41.330566 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.330495    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 22:47:41.341509 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.341485    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"]
Jul 10 22:47:41.436963 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.436922    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f9555bb-21ad-457b-96dd-224f4d8ea451-tmp\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.437168 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.436988    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f9555bb-21ad-457b-96dd-224f4d8ea451-manifests\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.437168 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.437037    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f9555bb-21ad-457b-96dd-224f4d8ea451-apiservice-cert\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.437168 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.437107    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq2pd\" (UniqueName: \"kubernetes.io/projected/6f9555bb-21ad-457b-96dd-224f4d8ea451-kube-api-access-gq2pd\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.437293 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.437157    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f9555bb-21ad-457b-96dd-224f4d8ea451-webhook-cert\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.537883 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.537845    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f9555bb-21ad-457b-96dd-224f4d8ea451-apiservice-cert\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.538061 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.537911    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq2pd\" (UniqueName: \"kubernetes.io/projected/6f9555bb-21ad-457b-96dd-224f4d8ea451-kube-api-access-gq2pd\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.538061 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.537949    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f9555bb-21ad-457b-96dd-224f4d8ea451-webhook-cert\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.538061 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.537975    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f9555bb-21ad-457b-96dd-224f4d8ea451-tmp\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.538061 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.538033    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f9555bb-21ad-457b-96dd-224f4d8ea451-manifests\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.538437 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.538408    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6f9555bb-21ad-457b-96dd-224f4d8ea451-manifests\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.540395 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.540367    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f9555bb-21ad-457b-96dd-224f4d8ea451-tmp\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.540539 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.540521    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6f9555bb-21ad-457b-96dd-224f4d8ea451-apiservice-cert\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.540682 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.540660    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f9555bb-21ad-457b-96dd-224f4d8ea451-webhook-cert\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.546413 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.546385    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq2pd\" (UniqueName: \"kubernetes.io/projected/6f9555bb-21ad-457b-96dd-224f4d8ea451-kube-api-access-gq2pd\") pod \"opendatahub-operator-controller-manager-845b6c684-tzkjm\" (UID: \"6f9555bb-21ad-457b-96dd-224f4d8ea451\") " pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.632243 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.632196    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:41.776835 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:41.776810    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"]
Jul 10 22:47:41.779522 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:47:41.779490    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9555bb_21ad_457b_96dd_224f4d8ea451.slice/crio-70560e04ac5b897369a6be339cb32f16965bb7517943147474ade679c28d2a54 WatchSource:0}: Error finding container 70560e04ac5b897369a6be339cb32f16965bb7517943147474ade679c28d2a54: Status 404 returned error can't find the container with id 70560e04ac5b897369a6be339cb32f16965bb7517943147474ade679c28d2a54
Jul 10 22:47:42.043849 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:42.043746    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm" event={"ID":"6f9555bb-21ad-457b-96dd-224f4d8ea451","Type":"ContainerStarted","Data":"70560e04ac5b897369a6be339cb32f16965bb7517943147474ade679c28d2a54"}
Jul 10 22:47:45.057546 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:45.057460    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm" event={"ID":"6f9555bb-21ad-457b-96dd-224f4d8ea451","Type":"ContainerStarted","Data":"18ed9e21539a9dd76556f3a328f27c5b4d4b1ccdc77931f173267051381856c0"}
Jul 10 22:47:46.063084 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:46.062988    2566 generic.go:356] "Generic (PLEG): container finished" podID="6f9555bb-21ad-457b-96dd-224f4d8ea451" containerID="18ed9e21539a9dd76556f3a328f27c5b4d4b1ccdc77931f173267051381856c0" exitCode=0
Jul 10 22:47:46.063084 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:46.063047    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm" event={"ID":"6f9555bb-21ad-457b-96dd-224f4d8ea451","Type":"ContainerDied","Data":"18ed9e21539a9dd76556f3a328f27c5b4d4b1ccdc77931f173267051381856c0"}
Jul 10 22:47:47.068864 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:47.068821    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm" event={"ID":"6f9555bb-21ad-457b-96dd-224f4d8ea451","Type":"ContainerStarted","Data":"d49b0f5dd03654ea1b87774d36f6170511efc4222f242b10be50198553f89fd9"}
Jul 10 22:47:47.069227 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:47.068906    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:47:47.094098 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:47.094045    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm" podStartSLOduration=1.744368243 podStartE2EDuration="6.094027167s" totalImagesPullingTime="3.275692377s" totalInitContainerRuntime="1.073966547s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:47:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:47:47.092702309 +0000 UTC m=+286.786060595" watchObservedRunningTime="2026-07-10 22:47:47.094027167 +0000 UTC m=+286.787385442"
Jul 10 22:47:58.075542 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:47:58.075511    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-845b6c684-tzkjm"
Jul 10 22:48:00.244570 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.244534    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"]
Jul 10 22:48:00.341359 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.341327    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"]
Jul 10 22:48:00.341560 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.341461    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.347340 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.347315    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4pml6\""
Jul 10 22:48:00.347733 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.347712    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 22:48:00.348549 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.348531    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 10 22:48:00.355552 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.355533    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 10 22:48:00.357613 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.357598    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 10 22:48:00.358568 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.358552    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 22:48:00.500574 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.500492    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4mxp\" (UniqueName: \"kubernetes.io/projected/cffe6ee2-912c-4468-aad4-3a340c8533a9-kube-api-access-c4mxp\") pod \"lws-controller-manager-7c7f744b8d-prl2n\" (UID: \"cffe6ee2-912c-4468-aad4-3a340c8533a9\") " pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.500574 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.500535    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cffe6ee2-912c-4468-aad4-3a340c8533a9-metrics-cert\") pod \"lws-controller-manager-7c7f744b8d-prl2n\" (UID: \"cffe6ee2-912c-4468-aad4-3a340c8533a9\") " pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.500759 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.500586    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cffe6ee2-912c-4468-aad4-3a340c8533a9-cert\") pod \"lws-controller-manager-7c7f744b8d-prl2n\" (UID: \"cffe6ee2-912c-4468-aad4-3a340c8533a9\") " pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.500759 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.500616    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cffe6ee2-912c-4468-aad4-3a340c8533a9-manager-config\") pod \"lws-controller-manager-7c7f744b8d-prl2n\" (UID: \"cffe6ee2-912c-4468-aad4-3a340c8533a9\") " pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.602060 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.602025    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cffe6ee2-912c-4468-aad4-3a340c8533a9-metrics-cert\") pod \"lws-controller-manager-7c7f744b8d-prl2n\" (UID: \"cffe6ee2-912c-4468-aad4-3a340c8533a9\") " pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.602202 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.602068    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cffe6ee2-912c-4468-aad4-3a340c8533a9-cert\") pod \"lws-controller-manager-7c7f744b8d-prl2n\" (UID: \"cffe6ee2-912c-4468-aad4-3a340c8533a9\") " pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.602202 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.602093    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cffe6ee2-912c-4468-aad4-3a340c8533a9-manager-config\") pod \"lws-controller-manager-7c7f744b8d-prl2n\" (UID: \"cffe6ee2-912c-4468-aad4-3a340c8533a9\") " pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.602283 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.602262    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4mxp\" (UniqueName: \"kubernetes.io/projected/cffe6ee2-912c-4468-aad4-3a340c8533a9-kube-api-access-c4mxp\") pod \"lws-controller-manager-7c7f744b8d-prl2n\" (UID: \"cffe6ee2-912c-4468-aad4-3a340c8533a9\") " pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.602719 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.602686    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cffe6ee2-912c-4468-aad4-3a340c8533a9-manager-config\") pod \"lws-controller-manager-7c7f744b8d-prl2n\" (UID: \"cffe6ee2-912c-4468-aad4-3a340c8533a9\") " pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.604591 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.604564    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cffe6ee2-912c-4468-aad4-3a340c8533a9-metrics-cert\") pod \"lws-controller-manager-7c7f744b8d-prl2n\" (UID: \"cffe6ee2-912c-4468-aad4-3a340c8533a9\") " pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.604774 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.604741    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cffe6ee2-912c-4468-aad4-3a340c8533a9-cert\") pod \"lws-controller-manager-7c7f744b8d-prl2n\" (UID: \"cffe6ee2-912c-4468-aad4-3a340c8533a9\") " pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.622686 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.622655    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4mxp\" (UniqueName: \"kubernetes.io/projected/cffe6ee2-912c-4468-aad4-3a340c8533a9-kube-api-access-c4mxp\") pod \"lws-controller-manager-7c7f744b8d-prl2n\" (UID: \"cffe6ee2-912c-4468-aad4-3a340c8533a9\") " pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.650505 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.650477    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:00.695070 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.695043    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 22:48:00.698129 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.698061    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 22:48:00.705180 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.705154    2566 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 22:48:01.059833 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:48:00.828926    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcffe6ee2_912c_4468_aad4_3a340c8533a9.slice/crio-26510255e2dcbb9b48782d442d5d1cee315f33202aa3a98a804f2dc4ea45d82e WatchSource:0}: Error finding container 26510255e2dcbb9b48782d442d5d1cee315f33202aa3a98a804f2dc4ea45d82e: Status 404 returned error can't find the container with id 26510255e2dcbb9b48782d442d5d1cee315f33202aa3a98a804f2dc4ea45d82e
Jul 10 22:48:01.059833 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:00.837479    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"]
Jul 10 22:48:01.121232 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:01.121194    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n" event={"ID":"cffe6ee2-912c-4468-aad4-3a340c8533a9","Type":"ContainerStarted","Data":"26510255e2dcbb9b48782d442d5d1cee315f33202aa3a98a804f2dc4ea45d82e"}
Jul 10 22:48:04.143782 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:04.143726    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n" event={"ID":"cffe6ee2-912c-4468-aad4-3a340c8533a9","Type":"ContainerStarted","Data":"a52c38edf807c0aad310d0c951dd525880e0b0d35f1384ee313b50917834c99c"}
Jul 10 22:48:04.144161 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:04.143814    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:04.160582 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:04.160528    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n" podStartSLOduration=1.690885717 podStartE2EDuration="4.160509679s" totalImagesPullingTime="2.469623962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:48:04.160295081 +0000 UTC m=+303.853653357" watchObservedRunningTime="2026-07-10 22:48:04.160509679 +0000 UTC m=+303.853867955"
Jul 10 22:48:11.395365 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.395332    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"]
Jul 10 22:48:11.398507 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.398491    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"
Jul 10 22:48:11.401056 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.401030    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 22:48:11.401181 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.401083    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 22:48:11.401326 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.401311    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 22:48:11.401547 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.401527    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 22:48:11.402085 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.402065    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lfrsl\""
Jul 10 22:48:11.410108 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.410089    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"]
Jul 10 22:48:11.494349 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.494293    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204f4523-39c4-45e9-865b-160c758c0c4f-tmp\") pod \"kube-auth-proxy-7454dcb6b8-9xxxc\" (UID: \"204f4523-39c4-45e9-865b-160c758c0c4f\") " pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"
Jul 10 22:48:11.494522 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.494382    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd9p4\" (UniqueName: \"kubernetes.io/projected/204f4523-39c4-45e9-865b-160c758c0c4f-kube-api-access-cd9p4\") pod \"kube-auth-proxy-7454dcb6b8-9xxxc\" (UID: \"204f4523-39c4-45e9-865b-160c758c0c4f\") " pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"
Jul 10 22:48:11.494522 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.494452    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204f4523-39c4-45e9-865b-160c758c0c4f-tls-certs\") pod \"kube-auth-proxy-7454dcb6b8-9xxxc\" (UID: \"204f4523-39c4-45e9-865b-160c758c0c4f\") " pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"
Jul 10 22:48:11.595165 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.595132    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd9p4\" (UniqueName: \"kubernetes.io/projected/204f4523-39c4-45e9-865b-160c758c0c4f-kube-api-access-cd9p4\") pod \"kube-auth-proxy-7454dcb6b8-9xxxc\" (UID: \"204f4523-39c4-45e9-865b-160c758c0c4f\") " pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"
Jul 10 22:48:11.595329 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.595178    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204f4523-39c4-45e9-865b-160c758c0c4f-tls-certs\") pod \"kube-auth-proxy-7454dcb6b8-9xxxc\" (UID: \"204f4523-39c4-45e9-865b-160c758c0c4f\") " pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"
Jul 10 22:48:11.595329 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.595216    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204f4523-39c4-45e9-865b-160c758c0c4f-tmp\") pod \"kube-auth-proxy-7454dcb6b8-9xxxc\" (UID: \"204f4523-39c4-45e9-865b-160c758c0c4f\") " pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"
Jul 10 22:48:11.595397 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:48:11.595352    2566 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 10 22:48:11.595435 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:48:11.595427    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/204f4523-39c4-45e9-865b-160c758c0c4f-tls-certs podName:204f4523-39c4-45e9-865b-160c758c0c4f nodeName:}" failed. No retries permitted until 2026-07-10 22:48:12.095410251 +0000 UTC m=+311.788768504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/204f4523-39c4-45e9-865b-160c758c0c4f-tls-certs") pod "kube-auth-proxy-7454dcb6b8-9xxxc" (UID: "204f4523-39c4-45e9-865b-160c758c0c4f") : secret "kube-auth-proxy-tls" not found
Jul 10 22:48:11.597353 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.597325    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/204f4523-39c4-45e9-865b-160c758c0c4f-tmp\") pod \"kube-auth-proxy-7454dcb6b8-9xxxc\" (UID: \"204f4523-39c4-45e9-865b-160c758c0c4f\") " pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"
Jul 10 22:48:11.615010 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:11.614982    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd9p4\" (UniqueName: \"kubernetes.io/projected/204f4523-39c4-45e9-865b-160c758c0c4f-kube-api-access-cd9p4\") pod \"kube-auth-proxy-7454dcb6b8-9xxxc\" (UID: \"204f4523-39c4-45e9-865b-160c758c0c4f\") " pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"
Jul 10 22:48:12.099244 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:12.099207    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204f4523-39c4-45e9-865b-160c758c0c4f-tls-certs\") pod \"kube-auth-proxy-7454dcb6b8-9xxxc\" (UID: \"204f4523-39c4-45e9-865b-160c758c0c4f\") " pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"
Jul 10 22:48:12.101582 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:12.101563    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/204f4523-39c4-45e9-865b-160c758c0c4f-tls-certs\") pod \"kube-auth-proxy-7454dcb6b8-9xxxc\" (UID: \"204f4523-39c4-45e9-865b-160c758c0c4f\") " pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"
Jul 10 22:48:12.308460 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:12.308423    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"
Jul 10 22:48:12.468946 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:12.468913    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc"]
Jul 10 22:48:12.481530 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:48:12.481501    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204f4523_39c4_45e9_865b_160c758c0c4f.slice/crio-903cabe8de317747b4abd90f12af8cc0ff8e4276d05d90e2ce85b9e4463d76d6 WatchSource:0}: Error finding container 903cabe8de317747b4abd90f12af8cc0ff8e4276d05d90e2ce85b9e4463d76d6: Status 404 returned error can't find the container with id 903cabe8de317747b4abd90f12af8cc0ff8e4276d05d90e2ce85b9e4463d76d6
Jul 10 22:48:12.483289 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:12.483274    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 22:48:13.182434 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:13.182398    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc" event={"ID":"204f4523-39c4-45e9-865b-160c758c0c4f","Type":"ContainerStarted","Data":"903cabe8de317747b4abd90f12af8cc0ff8e4276d05d90e2ce85b9e4463d76d6"}
Jul 10 22:48:15.154785 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:15.150524    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c7f744b8d-prl2n"
Jul 10 22:48:15.193612 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:15.193512    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc" event={"ID":"204f4523-39c4-45e9-865b-160c758c0c4f","Type":"ContainerStarted","Data":"13efcfd6be9d22dbe80915de86d496a36f83514c463140613309aab3d7469ebc"}
Jul 10 22:48:15.212584 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:48:15.212532    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7454dcb6b8-9xxxc" podStartSLOduration=1.777821916 podStartE2EDuration="4.212513815s" totalImagesPullingTime="2.434691899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:48:15.211657564 +0000 UTC m=+314.905015841" watchObservedRunningTime="2026-07-10 22:48:15.212513815 +0000 UTC m=+314.905872081"
Jul 10 22:49:42.264790 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.264739    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"]
Jul 10 22:49:42.268152 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.268123    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:49:42.270985 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.270957    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tj8sl\""
Jul 10 22:49:42.271505 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.271485    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 22:49:42.271933 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.271915    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 22:49:42.289940 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.289898    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"]
Jul 10 22:49:42.368166 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.368122    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74c4c4b5-1e30-4ba8-bd81-e634043d570a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qw9vw\" (UID: \"74c4c4b5-1e30-4ba8-bd81-e634043d570a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:49:42.368361 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.368186    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbzl8\" (UniqueName: \"kubernetes.io/projected/74c4c4b5-1e30-4ba8-bd81-e634043d570a-kube-api-access-hbzl8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qw9vw\" (UID: \"74c4c4b5-1e30-4ba8-bd81-e634043d570a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:49:42.469262 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.469221    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74c4c4b5-1e30-4ba8-bd81-e634043d570a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qw9vw\" (UID: \"74c4c4b5-1e30-4ba8-bd81-e634043d570a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:49:42.469420 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.469285    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbzl8\" (UniqueName: \"kubernetes.io/projected/74c4c4b5-1e30-4ba8-bd81-e634043d570a-kube-api-access-hbzl8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qw9vw\" (UID: \"74c4c4b5-1e30-4ba8-bd81-e634043d570a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:49:42.469690 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.469660    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74c4c4b5-1e30-4ba8-bd81-e634043d570a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qw9vw\" (UID: \"74c4c4b5-1e30-4ba8-bd81-e634043d570a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:49:42.479036 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.479011    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbzl8\" (UniqueName: \"kubernetes.io/projected/74c4c4b5-1e30-4ba8-bd81-e634043d570a-kube-api-access-hbzl8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qw9vw\" (UID: \"74c4c4b5-1e30-4ba8-bd81-e634043d570a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:49:42.579172 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.579073    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:49:42.721559 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:42.721526    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"]
Jul 10 22:49:42.727407 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:49:42.727380    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c4c4b5_1e30_4ba8_bd81_e634043d570a.slice/crio-5b08bd18bfa90f8a28a205afdc8356bbeb550ed0581fbc59335ed65ad5376049 WatchSource:0}: Error finding container 5b08bd18bfa90f8a28a205afdc8356bbeb550ed0581fbc59335ed65ad5376049: Status 404 returned error can't find the container with id 5b08bd18bfa90f8a28a205afdc8356bbeb550ed0581fbc59335ed65ad5376049
Jul 10 22:49:43.549734 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:43.549697    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw" event={"ID":"74c4c4b5-1e30-4ba8-bd81-e634043d570a","Type":"ContainerStarted","Data":"5b08bd18bfa90f8a28a205afdc8356bbeb550ed0581fbc59335ed65ad5376049"}
Jul 10 22:49:48.573632 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:48.573526    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw" event={"ID":"74c4c4b5-1e30-4ba8-bd81-e634043d570a","Type":"ContainerStarted","Data":"f1beb954602b487c936bb6f74de224f4556b9ca607dc2bf0c808864edaacde09"}
Jul 10 22:49:48.574128 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:48.573644    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:49:48.618641 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:48.618584    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw" podStartSLOduration=1.03554341 podStartE2EDuration="6.618567413s" totalImagesPullingTime="5.583024003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:49:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:49:48.61591045 +0000 UTC m=+408.309268746" watchObservedRunningTime="2026-07-10 22:49:48.618567413 +0000 UTC m=+408.311925753"
Jul 10 22:49:50.983344 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:50.983310    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"]
Jul 10 22:49:50.986850 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:50.986831    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"
Jul 10 22:49:50.989286 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:50.989263    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 10 22:49:50.989473 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:50.989455    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-crb7z\""
Jul 10 22:49:50.989875 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:50.989860    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 10 22:49:51.000931 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:51.000907    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"]
Jul 10 22:49:51.045501 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:51.045463    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a05699b-8af3-4fa5-bd80-11aefb327663-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h98nf\" (UID: \"8a05699b-8af3-4fa5-bd80-11aefb327663\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"
Jul 10 22:49:51.045696 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:51.045514    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm9fb\" (UniqueName: \"kubernetes.io/projected/8a05699b-8af3-4fa5-bd80-11aefb327663-kube-api-access-rm9fb\") pod \"kuadrant-console-plugin-66b5774985-h98nf\" (UID: \"8a05699b-8af3-4fa5-bd80-11aefb327663\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"
Jul 10 22:49:51.045696 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:51.045544    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a05699b-8af3-4fa5-bd80-11aefb327663-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h98nf\" (UID: \"8a05699b-8af3-4fa5-bd80-11aefb327663\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"
Jul 10 22:49:51.147054 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:51.147020    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a05699b-8af3-4fa5-bd80-11aefb327663-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h98nf\" (UID: \"8a05699b-8af3-4fa5-bd80-11aefb327663\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"
Jul 10 22:49:51.147221 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:51.147063    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm9fb\" (UniqueName: \"kubernetes.io/projected/8a05699b-8af3-4fa5-bd80-11aefb327663-kube-api-access-rm9fb\") pod \"kuadrant-console-plugin-66b5774985-h98nf\" (UID: \"8a05699b-8af3-4fa5-bd80-11aefb327663\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"
Jul 10 22:49:51.147221 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:49:51.147162    2566 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 10 22:49:51.147221 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:51.147182    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a05699b-8af3-4fa5-bd80-11aefb327663-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h98nf\" (UID: \"8a05699b-8af3-4fa5-bd80-11aefb327663\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"
Jul 10 22:49:51.147350 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:49:51.147227    2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a05699b-8af3-4fa5-bd80-11aefb327663-plugin-serving-cert podName:8a05699b-8af3-4fa5-bd80-11aefb327663 nodeName:}" failed. No retries permitted until 2026-07-10 22:49:51.647210702 +0000 UTC m=+411.340568955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/8a05699b-8af3-4fa5-bd80-11aefb327663-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-h98nf" (UID: "8a05699b-8af3-4fa5-bd80-11aefb327663") : secret "plugin-serving-cert" not found
Jul 10 22:49:51.147811 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:51.147795    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a05699b-8af3-4fa5-bd80-11aefb327663-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-h98nf\" (UID: \"8a05699b-8af3-4fa5-bd80-11aefb327663\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"
Jul 10 22:49:51.158449 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:51.158418    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm9fb\" (UniqueName: \"kubernetes.io/projected/8a05699b-8af3-4fa5-bd80-11aefb327663-kube-api-access-rm9fb\") pod \"kuadrant-console-plugin-66b5774985-h98nf\" (UID: \"8a05699b-8af3-4fa5-bd80-11aefb327663\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"
Jul 10 22:49:51.652419 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:51.652383    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a05699b-8af3-4fa5-bd80-11aefb327663-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h98nf\" (UID: \"8a05699b-8af3-4fa5-bd80-11aefb327663\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"
Jul 10 22:49:51.655007 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:51.654982    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a05699b-8af3-4fa5-bd80-11aefb327663-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-h98nf\" (UID: \"8a05699b-8af3-4fa5-bd80-11aefb327663\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"
Jul 10 22:49:51.896392 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:51.896349    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"
Jul 10 22:49:52.032964 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:52.032934    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf"]
Jul 10 22:49:52.035791 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:49:52.035749    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a05699b_8af3_4fa5_bd80_11aefb327663.slice/crio-57f880e2e0422ae72d95e5fc6a07e5a791ecdfc30805519cf01759f8ea6b087c WatchSource:0}: Error finding container 57f880e2e0422ae72d95e5fc6a07e5a791ecdfc30805519cf01759f8ea6b087c: Status 404 returned error can't find the container with id 57f880e2e0422ae72d95e5fc6a07e5a791ecdfc30805519cf01759f8ea6b087c
Jul 10 22:49:52.591115 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:52.591080    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf" event={"ID":"8a05699b-8af3-4fa5-bd80-11aefb327663","Type":"ContainerStarted","Data":"57f880e2e0422ae72d95e5fc6a07e5a791ecdfc30805519cf01759f8ea6b087c"}
Jul 10 22:49:59.580680 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:49:59.580643    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:50:01.401902 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.401863    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"]
Jul 10 22:50:01.402343 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.402100    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw" podUID="74c4c4b5-1e30-4ba8-bd81-e634043d570a" containerName="manager" containerID="cri-o://f1beb954602b487c936bb6f74de224f4556b9ca607dc2bf0c808864edaacde09" gracePeriod=2
Jul 10 22:50:01.412672 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.412640    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"]
Jul 10 22:50:01.420120 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:50:01.420074    2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"74c4c4b5-1e30-4ba8-bd81-e634043d570a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-qw9vw\": pods \"kuadrant-operator-controller-manager-8684c9ff49-qw9vw\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:50:01.451280 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.451239    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvllk"]
Jul 10 22:50:01.451747 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.451723    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c4c4b5-1e30-4ba8-bd81-e634043d570a" containerName="manager"
Jul 10 22:50:01.451892 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.451751    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c4c4b5-1e30-4ba8-bd81-e634043d570a" containerName="manager"
Jul 10 22:50:01.451955 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.451912    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="74c4c4b5-1e30-4ba8-bd81-e634043d570a" containerName="manager"
Jul 10 22:50:01.455731 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.455706    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvllk"
Jul 10 22:50:01.458501 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.458477    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ztl56\""
Jul 10 22:50:01.468478 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.468444    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvllk"]
Jul 10 22:50:01.490753 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:50:01.490710    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qw9vw\" is forbidden: User \"system:node:ip-10-0-130-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-215.ec2.internal' and this object" podUID="74c4c4b5-1e30-4ba8-bd81-e634043d570a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:50:01.544994 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.544959    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p87rk\" (UniqueName: \"kubernetes.io/projected/bc0bef61-faae-45c4-b2a1-e2ee83eaa84b-kube-api-access-p87rk\") pod \"limitador-operator-controller-manager-859d7b78bd-hvllk\" (UID: \"bc0bef61-faae-45c4-b2a1-e2ee83eaa84b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvllk"
Jul 10 22:50:01.645859 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.645822    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p87rk\" (UniqueName: \"kubernetes.io/projected/bc0bef61-faae-45c4-b2a1-e2ee83eaa84b-kube-api-access-p87rk\") pod \"limitador-operator-controller-manager-859d7b78bd-hvllk\" (UID: \"bc0bef61-faae-45c4-b2a1-e2ee83eaa84b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvllk"
Jul 10 22:50:01.657023 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.656937    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p87rk\" (UniqueName: \"kubernetes.io/projected/bc0bef61-faae-45c4-b2a1-e2ee83eaa84b-kube-api-access-p87rk\") pod \"limitador-operator-controller-manager-859d7b78bd-hvllk\" (UID: \"bc0bef61-faae-45c4-b2a1-e2ee83eaa84b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvllk"
Jul 10 22:50:01.784248 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:01.784209    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvllk"
Jul 10 22:50:13.699225 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:13.699131    2566 generic.go:356] "Generic (PLEG): container finished" podID="74c4c4b5-1e30-4ba8-bd81-e634043d570a" containerID="f1beb954602b487c936bb6f74de224f4556b9ca607dc2bf0c808864edaacde09" exitCode=0
Jul 10 22:50:13.750877 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:13.750851    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:50:13.752960 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:50:13.752935    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qw9vw\" is forbidden: User \"system:node:ip-10-0-130-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-215.ec2.internal' and this object" podUID="74c4c4b5-1e30-4ba8-bd81-e634043d570a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:50:13.759539 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:13.759516    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvllk"]
Jul 10 22:50:13.762647 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:50:13.762622    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0bef61_faae_45c4_b2a1_e2ee83eaa84b.slice/crio-807b252d5d894c81990991edc5ef40d1a76d819046c1318b7748c79e2660c8cf WatchSource:0}: Error finding container 807b252d5d894c81990991edc5ef40d1a76d819046c1318b7748c79e2660c8cf: Status 404 returned error can't find the container with id 807b252d5d894c81990991edc5ef40d1a76d819046c1318b7748c79e2660c8cf
Jul 10 22:50:13.868353 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:13.868264    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74c4c4b5-1e30-4ba8-bd81-e634043d570a-extensions-socket-volume\") pod \"74c4c4b5-1e30-4ba8-bd81-e634043d570a\" (UID: \"74c4c4b5-1e30-4ba8-bd81-e634043d570a\") "
Jul 10 22:50:13.868501 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:13.868378    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbzl8\" (UniqueName: \"kubernetes.io/projected/74c4c4b5-1e30-4ba8-bd81-e634043d570a-kube-api-access-hbzl8\") pod \"74c4c4b5-1e30-4ba8-bd81-e634043d570a\" (UID: \"74c4c4b5-1e30-4ba8-bd81-e634043d570a\") "
Jul 10 22:50:13.868713 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:13.868682    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74c4c4b5-1e30-4ba8-bd81-e634043d570a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "74c4c4b5-1e30-4ba8-bd81-e634043d570a" (UID: "74c4c4b5-1e30-4ba8-bd81-e634043d570a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 22:50:13.870445 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:13.870420    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74c4c4b5-1e30-4ba8-bd81-e634043d570a-kube-api-access-hbzl8" (OuterVolumeSpecName: "kube-api-access-hbzl8") pod "74c4c4b5-1e30-4ba8-bd81-e634043d570a" (UID: "74c4c4b5-1e30-4ba8-bd81-e634043d570a"). InnerVolumeSpecName "kube-api-access-hbzl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:50:13.969512 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:13.969469    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbzl8\" (UniqueName: \"kubernetes.io/projected/74c4c4b5-1e30-4ba8-bd81-e634043d570a-kube-api-access-hbzl8\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:50:13.969512 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:13.969503    2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74c4c4b5-1e30-4ba8-bd81-e634043d570a-extensions-socket-volume\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:50:14.708449 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:14.708410    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf" event={"ID":"8a05699b-8af3-4fa5-bd80-11aefb327663","Type":"ContainerStarted","Data":"6dd7b098ac54232089fbb53485c23c4e044d18e0f7d0c044bb23716516d629cf"}
Jul 10 22:50:14.710019 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:14.709994    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:50:14.710160 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:14.710020    2566 scope.go:117] "RemoveContainer" containerID="f1beb954602b487c936bb6f74de224f4556b9ca607dc2bf0c808864edaacde09"
Jul 10 22:50:14.711000 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:50:14.710913    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qw9vw\" is forbidden: User \"system:node:ip-10-0-130-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-215.ec2.internal' and this object" podUID="74c4c4b5-1e30-4ba8-bd81-e634043d570a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:50:14.711549 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:14.711292    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvllk" event={"ID":"bc0bef61-faae-45c4-b2a1-e2ee83eaa84b","Type":"ContainerStarted","Data":"807b252d5d894c81990991edc5ef40d1a76d819046c1318b7748c79e2660c8cf"}
Jul 10 22:50:14.731832 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:50:14.731785    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qw9vw\" is forbidden: User \"system:node:ip-10-0-130-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-215.ec2.internal' and this object" podUID="74c4c4b5-1e30-4ba8-bd81-e634043d570a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qw9vw"
Jul 10 22:50:14.732197 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:14.732151    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-h98nf" podStartSLOduration=3.066064436 podStartE2EDuration="24.732136226s" totalImagesPullingTime="21.66607179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:50:14.729348394 +0000 UTC m=+434.422706668" watchObservedRunningTime="2026-07-10 22:50:14.732136226 +0000 UTC m=+434.425494500"
Jul 10 22:50:14.804005 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:14.803971    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74c4c4b5-1e30-4ba8-bd81-e634043d570a" path="/var/lib/kubelet/pods/74c4c4b5-1e30-4ba8-bd81-e634043d570a/volumes"
Jul 10 22:50:15.718200 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:15.718164    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvllk" event={"ID":"bc0bef61-faae-45c4-b2a1-e2ee83eaa84b","Type":"ContainerStarted","Data":"1789070c11fa6c9db3beccf4179b91dcc75eca586510145e7444bf38343057c6"}
Jul 10 22:50:15.718627 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:15.718366    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvllk"
Jul 10 22:50:15.736106 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:15.736061    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvllk" podStartSLOduration=13.219065766 podStartE2EDuration="14.736044569s" totalImagesPullingTime="1.516978803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:50:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:50:15.734642865 +0000 UTC m=+435.428001166" watchObservedRunningTime="2026-07-10 22:50:15.736044569 +0000 UTC m=+435.429402907"
Jul 10 22:50:26.725215 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:26.725131    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hvllk"
Jul 10 22:50:50.791688 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:50.791649    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-hxwz6"]
Jul 10 22:50:50.810470 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:50.810435    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hxwz6"]
Jul 10 22:50:50.810628 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:50.810562    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hxwz6"
Jul 10 22:50:50.812991 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:50.812964    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m5d7b\""
Jul 10 22:50:50.893147 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:50.893112    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnlvs\" (UniqueName: \"kubernetes.io/projected/217014d4-0974-455b-8a6f-33d3c05748bb-kube-api-access-gnlvs\") pod \"authorino-58cd955675-hxwz6\" (UID: \"217014d4-0974-455b-8a6f-33d3c05748bb\") " pod="kuadrant-system/authorino-58cd955675-hxwz6"
Jul 10 22:50:50.958569 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:50.958535    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hk8cq"]
Jul 10 22:50:50.962140 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:50.962122    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hk8cq"
Jul 10 22:50:50.967550 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:50.967522    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hk8cq"]
Jul 10 22:50:50.993807 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:50.993752    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnlvs\" (UniqueName: \"kubernetes.io/projected/217014d4-0974-455b-8a6f-33d3c05748bb-kube-api-access-gnlvs\") pod \"authorino-58cd955675-hxwz6\" (UID: \"217014d4-0974-455b-8a6f-33d3c05748bb\") " pod="kuadrant-system/authorino-58cd955675-hxwz6"
Jul 10 22:50:51.002191 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:51.002168    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnlvs\" (UniqueName: \"kubernetes.io/projected/217014d4-0974-455b-8a6f-33d3c05748bb-kube-api-access-gnlvs\") pod \"authorino-58cd955675-hxwz6\" (UID: \"217014d4-0974-455b-8a6f-33d3c05748bb\") " pod="kuadrant-system/authorino-58cd955675-hxwz6"
Jul 10 22:50:51.094500 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:51.094469    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf25f\" (UniqueName: \"kubernetes.io/projected/77902801-788f-4adf-88f9-aa7a7e78d4f4-kube-api-access-kf25f\") pod \"authorino-75d556bd77-hk8cq\" (UID: \"77902801-788f-4adf-88f9-aa7a7e78d4f4\") " pod="kuadrant-system/authorino-75d556bd77-hk8cq"
Jul 10 22:50:51.120583 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:51.120549    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hxwz6"
Jul 10 22:50:51.195553 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:51.195515    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf25f\" (UniqueName: \"kubernetes.io/projected/77902801-788f-4adf-88f9-aa7a7e78d4f4-kube-api-access-kf25f\") pod \"authorino-75d556bd77-hk8cq\" (UID: \"77902801-788f-4adf-88f9-aa7a7e78d4f4\") " pod="kuadrant-system/authorino-75d556bd77-hk8cq"
Jul 10 22:50:51.204173 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:51.204147    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf25f\" (UniqueName: \"kubernetes.io/projected/77902801-788f-4adf-88f9-aa7a7e78d4f4-kube-api-access-kf25f\") pod \"authorino-75d556bd77-hk8cq\" (UID: \"77902801-788f-4adf-88f9-aa7a7e78d4f4\") " pod="kuadrant-system/authorino-75d556bd77-hk8cq"
Jul 10 22:50:51.256972 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:51.256947    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hxwz6"]
Jul 10 22:50:51.259611 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:50:51.259583    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod217014d4_0974_455b_8a6f_33d3c05748bb.slice/crio-e6abb79afb9ab6d3d7d2c2fd57d412712d28bb41d34251f03a9b0d4c91263b1c WatchSource:0}: Error finding container e6abb79afb9ab6d3d7d2c2fd57d412712d28bb41d34251f03a9b0d4c91263b1c: Status 404 returned error can't find the container with id e6abb79afb9ab6d3d7d2c2fd57d412712d28bb41d34251f03a9b0d4c91263b1c
Jul 10 22:50:51.272116 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:51.272085    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hk8cq"
Jul 10 22:50:51.405109 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:51.405078    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hk8cq"]
Jul 10 22:50:51.407858 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:50:51.407826    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77902801_788f_4adf_88f9_aa7a7e78d4f4.slice/crio-2677664ed3b06e0a70e12dd8c140cca21568796d13f7ac9f701674855192a156 WatchSource:0}: Error finding container 2677664ed3b06e0a70e12dd8c140cca21568796d13f7ac9f701674855192a156: Status 404 returned error can't find the container with id 2677664ed3b06e0a70e12dd8c140cca21568796d13f7ac9f701674855192a156
Jul 10 22:50:51.877943 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:51.877848    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hk8cq" event={"ID":"77902801-788f-4adf-88f9-aa7a7e78d4f4","Type":"ContainerStarted","Data":"2677664ed3b06e0a70e12dd8c140cca21568796d13f7ac9f701674855192a156"}
Jul 10 22:50:51.880573 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:51.880503    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hxwz6" event={"ID":"217014d4-0974-455b-8a6f-33d3c05748bb","Type":"ContainerStarted","Data":"e6abb79afb9ab6d3d7d2c2fd57d412712d28bb41d34251f03a9b0d4c91263b1c"}
Jul 10 22:50:54.898530 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:54.898434    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hk8cq" event={"ID":"77902801-788f-4adf-88f9-aa7a7e78d4f4","Type":"ContainerStarted","Data":"4845f1b77e52dbef12dbe46df8852d524078e00ab0aa713a8e69d850f516b047"}
Jul 10 22:50:54.899924 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:54.899901    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hxwz6" event={"ID":"217014d4-0974-455b-8a6f-33d3c05748bb","Type":"ContainerStarted","Data":"231ed48f935625d0f8967de345d0a5ef75a8041563c87e5e71eb74d5e191fb6b"}
Jul 10 22:50:54.913220 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:54.913151    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hk8cq" podStartSLOduration=1.696839795 podStartE2EDuration="4.913131565s" totalImagesPullingTime="3.21629177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:50:54.912686128 +0000 UTC m=+474.606044415" watchObservedRunningTime="2026-07-10 22:50:54.913131565 +0000 UTC m=+474.606489843"
Jul 10 22:50:54.929497 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:54.929443    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-hxwz6" podStartSLOduration=1.569970198 podStartE2EDuration="4.92942234s" totalImagesPullingTime="3.359452142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:50:54.928210383 +0000 UTC m=+474.621568668" watchObservedRunningTime="2026-07-10 22:50:54.92942234 +0000 UTC m=+474.622780614"
Jul 10 22:50:54.954069 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:54.954032    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hxwz6"]
Jul 10 22:50:56.910355 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:56.910310    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-hxwz6" podUID="217014d4-0974-455b-8a6f-33d3c05748bb" containerName="authorino" containerID="cri-o://231ed48f935625d0f8967de345d0a5ef75a8041563c87e5e71eb74d5e191fb6b" gracePeriod=30
Jul 10 22:50:57.151287 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:57.151262    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hxwz6"
Jul 10 22:50:57.254980 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:57.254891    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnlvs\" (UniqueName: \"kubernetes.io/projected/217014d4-0974-455b-8a6f-33d3c05748bb-kube-api-access-gnlvs\") pod \"217014d4-0974-455b-8a6f-33d3c05748bb\" (UID: \"217014d4-0974-455b-8a6f-33d3c05748bb\") "
Jul 10 22:50:57.256928 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:57.256903    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/217014d4-0974-455b-8a6f-33d3c05748bb-kube-api-access-gnlvs" (OuterVolumeSpecName: "kube-api-access-gnlvs") pod "217014d4-0974-455b-8a6f-33d3c05748bb" (UID: "217014d4-0974-455b-8a6f-33d3c05748bb"). InnerVolumeSpecName "kube-api-access-gnlvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:50:57.355897 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:57.355853    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnlvs\" (UniqueName: \"kubernetes.io/projected/217014d4-0974-455b-8a6f-33d3c05748bb-kube-api-access-gnlvs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:50:57.915497 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:57.915463    2566 generic.go:356] "Generic (PLEG): container finished" podID="217014d4-0974-455b-8a6f-33d3c05748bb" containerID="231ed48f935625d0f8967de345d0a5ef75a8041563c87e5e71eb74d5e191fb6b" exitCode=0
Jul 10 22:50:57.916012 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:57.915513    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hxwz6"
Jul 10 22:50:57.916012 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:57.915545    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hxwz6" event={"ID":"217014d4-0974-455b-8a6f-33d3c05748bb","Type":"ContainerDied","Data":"231ed48f935625d0f8967de345d0a5ef75a8041563c87e5e71eb74d5e191fb6b"}
Jul 10 22:50:57.916012 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:57.915591    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hxwz6" event={"ID":"217014d4-0974-455b-8a6f-33d3c05748bb","Type":"ContainerDied","Data":"e6abb79afb9ab6d3d7d2c2fd57d412712d28bb41d34251f03a9b0d4c91263b1c"}
Jul 10 22:50:57.916012 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:57.915609    2566 scope.go:117] "RemoveContainer" containerID="231ed48f935625d0f8967de345d0a5ef75a8041563c87e5e71eb74d5e191fb6b"
Jul 10 22:50:57.924639 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:57.924620    2566 scope.go:117] "RemoveContainer" containerID="231ed48f935625d0f8967de345d0a5ef75a8041563c87e5e71eb74d5e191fb6b"
Jul 10 22:50:57.924961 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:50:57.924942    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"231ed48f935625d0f8967de345d0a5ef75a8041563c87e5e71eb74d5e191fb6b\": container with ID starting with 231ed48f935625d0f8967de345d0a5ef75a8041563c87e5e71eb74d5e191fb6b not found: ID does not exist" containerID="231ed48f935625d0f8967de345d0a5ef75a8041563c87e5e71eb74d5e191fb6b"
Jul 10 22:50:57.925031 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:57.924968    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"231ed48f935625d0f8967de345d0a5ef75a8041563c87e5e71eb74d5e191fb6b"} err="failed to get container status \"231ed48f935625d0f8967de345d0a5ef75a8041563c87e5e71eb74d5e191fb6b\": rpc error: code = NotFound desc = could not find container \"231ed48f935625d0f8967de345d0a5ef75a8041563c87e5e71eb74d5e191fb6b\": container with ID starting with 231ed48f935625d0f8967de345d0a5ef75a8041563c87e5e71eb74d5e191fb6b not found: ID does not exist"
Jul 10 22:50:57.936032 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:57.936004    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hxwz6"]
Jul 10 22:50:57.939816 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:57.939792    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-hxwz6"]
Jul 10 22:50:58.802861 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:50:58.802828    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="217014d4-0974-455b-8a6f-33d3c05748bb" path="/var/lib/kubelet/pods/217014d4-0974-455b-8a6f-33d3c05748bb/volumes"
Jul 10 22:51:19.231118 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.231084    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j99pg"]
Jul 10 22:51:19.231563 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.231437    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="217014d4-0974-455b-8a6f-33d3c05748bb" containerName="authorino"
Jul 10 22:51:19.231563 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.231449    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="217014d4-0974-455b-8a6f-33d3c05748bb" containerName="authorino"
Jul 10 22:51:19.231639 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.231565    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="217014d4-0974-455b-8a6f-33d3c05748bb" containerName="authorino"
Jul 10 22:51:19.234477 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.234458    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j99pg"
Jul 10 22:51:19.241883 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.241501    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j99pg"]
Jul 10 22:51:19.352727 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.352687    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qpcr\" (UniqueName: \"kubernetes.io/projected/8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d-kube-api-access-4qpcr\") pod \"authorino-5d4b67c446-j99pg\" (UID: \"8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d\") " pod="kuadrant-system/authorino-5d4b67c446-j99pg"
Jul 10 22:51:19.454101 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.454064    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qpcr\" (UniqueName: \"kubernetes.io/projected/8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d-kube-api-access-4qpcr\") pod \"authorino-5d4b67c446-j99pg\" (UID: \"8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d\") " pod="kuadrant-system/authorino-5d4b67c446-j99pg"
Jul 10 22:51:19.462090 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.462062    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j99pg"]
Jul 10 22:51:19.462336 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:51:19.462315    2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4qpcr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-j99pg" podUID="8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d"
Jul 10 22:51:19.467519 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.467487    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qpcr\" (UniqueName: \"kubernetes.io/projected/8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d-kube-api-access-4qpcr\") pod \"authorino-5d4b67c446-j99pg\" (UID: \"8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d\") " pod="kuadrant-system/authorino-5d4b67c446-j99pg"
Jul 10 22:51:19.825264 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.825231    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9dbfc64dc-62q58"]
Jul 10 22:51:19.828252 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.828229    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9dbfc64dc-62q58"
Jul 10 22:51:19.831178 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.831154    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 10 22:51:19.837186 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.837160    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9dbfc64dc-62q58"]
Jul 10 22:51:19.857604 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.857562    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8fgt\" (UniqueName: \"kubernetes.io/projected/937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7-kube-api-access-x8fgt\") pod \"authorino-9dbfc64dc-62q58\" (UID: \"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7\") " pod="kuadrant-system/authorino-9dbfc64dc-62q58"
Jul 10 22:51:19.857815 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.857619    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7-tls-cert\") pod \"authorino-9dbfc64dc-62q58\" (UID: \"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7\") " pod="kuadrant-system/authorino-9dbfc64dc-62q58"
Jul 10 22:51:19.958138 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.958099    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8fgt\" (UniqueName: \"kubernetes.io/projected/937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7-kube-api-access-x8fgt\") pod \"authorino-9dbfc64dc-62q58\" (UID: \"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7\") " pod="kuadrant-system/authorino-9dbfc64dc-62q58"
Jul 10 22:51:19.958332 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.958151    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7-tls-cert\") pod \"authorino-9dbfc64dc-62q58\" (UID: \"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7\") " pod="kuadrant-system/authorino-9dbfc64dc-62q58"
Jul 10 22:51:19.960641 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.960611    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7-tls-cert\") pod \"authorino-9dbfc64dc-62q58\" (UID: \"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7\") " pod="kuadrant-system/authorino-9dbfc64dc-62q58"
Jul 10 22:51:19.966114 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:19.966093    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8fgt\" (UniqueName: \"kubernetes.io/projected/937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7-kube-api-access-x8fgt\") pod \"authorino-9dbfc64dc-62q58\" (UID: \"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7\") " pod="kuadrant-system/authorino-9dbfc64dc-62q58"
Jul 10 22:51:20.015027 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:20.014997    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j99pg"
Jul 10 22:51:20.020935 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:20.020912    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j99pg"
Jul 10 22:51:20.059399 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:20.059361    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qpcr\" (UniqueName: \"kubernetes.io/projected/8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d-kube-api-access-4qpcr\") pod \"8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d\" (UID: \"8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d\") "
Jul 10 22:51:20.061367 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:20.061337    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d-kube-api-access-4qpcr" (OuterVolumeSpecName: "kube-api-access-4qpcr") pod "8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d" (UID: "8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d"). InnerVolumeSpecName "kube-api-access-4qpcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:51:20.138210 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:20.138170    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9dbfc64dc-62q58"
Jul 10 22:51:20.160785 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:20.160744    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qpcr\" (UniqueName: \"kubernetes.io/projected/8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d-kube-api-access-4qpcr\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:51:20.266831 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:20.266807    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9dbfc64dc-62q58"]
Jul 10 22:51:20.268671 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:51:20.268646    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod937f7e8f_c7c2_4db1_a9f8_1c07714e6fc7.slice/crio-ad6c97fcb66b39e45952a4aeb599e5630cf8b9367970be8c0891a90e68e2775b WatchSource:0}: Error finding container ad6c97fcb66b39e45952a4aeb599e5630cf8b9367970be8c0891a90e68e2775b: Status 404 returned error can't find the container with id ad6c97fcb66b39e45952a4aeb599e5630cf8b9367970be8c0891a90e68e2775b
Jul 10 22:51:21.021249 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:21.021170    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-j99pg"
Jul 10 22:51:21.021392 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:21.021167    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9dbfc64dc-62q58" event={"ID":"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7","Type":"ContainerStarted","Data":"e23b3980e15d53a49513e3961d1badd450a39c19f4a20bf3c0825f7de449c043"}
Jul 10 22:51:21.021392 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:21.021291    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9dbfc64dc-62q58" event={"ID":"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7","Type":"ContainerStarted","Data":"ad6c97fcb66b39e45952a4aeb599e5630cf8b9367970be8c0891a90e68e2775b"}
Jul 10 22:51:21.039306 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:21.039226    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9dbfc64dc-62q58" podStartSLOduration=1.623330931 podStartE2EDuration="2.039208337s" totalImagesPullingTime="415.877406ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:51:21.038224938 +0000 UTC m=+500.731583213" watchObservedRunningTime="2026-07-10 22:51:21.039208337 +0000 UTC m=+500.732566612"
Jul 10 22:51:21.063392 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:21.063349    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j99pg"]
Jul 10 22:51:21.069559 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:21.069531    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hk8cq"]
Jul 10 22:51:21.069758 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:21.069731    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hk8cq" podUID="77902801-788f-4adf-88f9-aa7a7e78d4f4" containerName="authorino" containerID="cri-o://4845f1b77e52dbef12dbe46df8852d524078e00ab0aa713a8e69d850f516b047" gracePeriod=30
Jul 10 22:51:21.071783 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:21.071743    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-j99pg"]
Jul 10 22:51:21.334622 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:21.334595    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hk8cq"
Jul 10 22:51:21.370011 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:21.369966    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf25f\" (UniqueName: \"kubernetes.io/projected/77902801-788f-4adf-88f9-aa7a7e78d4f4-kube-api-access-kf25f\") pod \"77902801-788f-4adf-88f9-aa7a7e78d4f4\" (UID: \"77902801-788f-4adf-88f9-aa7a7e78d4f4\") "
Jul 10 22:51:21.372126 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:21.372099    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77902801-788f-4adf-88f9-aa7a7e78d4f4-kube-api-access-kf25f" (OuterVolumeSpecName: "kube-api-access-kf25f") pod "77902801-788f-4adf-88f9-aa7a7e78d4f4" (UID: "77902801-788f-4adf-88f9-aa7a7e78d4f4"). InnerVolumeSpecName "kube-api-access-kf25f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:51:21.470913 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:21.470878    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf25f\" (UniqueName: \"kubernetes.io/projected/77902801-788f-4adf-88f9-aa7a7e78d4f4-kube-api-access-kf25f\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:51:22.026844 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:22.026809    2566 generic.go:356] "Generic (PLEG): container finished" podID="77902801-788f-4adf-88f9-aa7a7e78d4f4" containerID="4845f1b77e52dbef12dbe46df8852d524078e00ab0aa713a8e69d850f516b047" exitCode=0
Jul 10 22:51:22.027039 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:22.026853    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hk8cq"
Jul 10 22:51:22.027039 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:22.026900    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hk8cq" event={"ID":"77902801-788f-4adf-88f9-aa7a7e78d4f4","Type":"ContainerDied","Data":"4845f1b77e52dbef12dbe46df8852d524078e00ab0aa713a8e69d850f516b047"}
Jul 10 22:51:22.027039 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:22.026941    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hk8cq" event={"ID":"77902801-788f-4adf-88f9-aa7a7e78d4f4","Type":"ContainerDied","Data":"2677664ed3b06e0a70e12dd8c140cca21568796d13f7ac9f701674855192a156"}
Jul 10 22:51:22.027039 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:22.026959    2566 scope.go:117] "RemoveContainer" containerID="4845f1b77e52dbef12dbe46df8852d524078e00ab0aa713a8e69d850f516b047"
Jul 10 22:51:22.035173 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:22.035154    2566 scope.go:117] "RemoveContainer" containerID="4845f1b77e52dbef12dbe46df8852d524078e00ab0aa713a8e69d850f516b047"
Jul 10 22:51:22.035452 ip-10-0-130-215 kubenswrapper[2566]: E0710 22:51:22.035431    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4845f1b77e52dbef12dbe46df8852d524078e00ab0aa713a8e69d850f516b047\": container with ID starting with 4845f1b77e52dbef12dbe46df8852d524078e00ab0aa713a8e69d850f516b047 not found: ID does not exist" containerID="4845f1b77e52dbef12dbe46df8852d524078e00ab0aa713a8e69d850f516b047"
Jul 10 22:51:22.035518 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:22.035461    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4845f1b77e52dbef12dbe46df8852d524078e00ab0aa713a8e69d850f516b047"} err="failed to get container status \"4845f1b77e52dbef12dbe46df8852d524078e00ab0aa713a8e69d850f516b047\": rpc error: code = NotFound desc = could not find container \"4845f1b77e52dbef12dbe46df8852d524078e00ab0aa713a8e69d850f516b047\": container with ID starting with 4845f1b77e52dbef12dbe46df8852d524078e00ab0aa713a8e69d850f516b047 not found: ID does not exist"
Jul 10 22:51:22.047542 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:22.047512    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hk8cq"]
Jul 10 22:51:22.053504 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:22.053479    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hk8cq"]
Jul 10 22:51:22.803710 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:22.803679    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77902801-788f-4adf-88f9-aa7a7e78d4f4" path="/var/lib/kubelet/pods/77902801-788f-4adf-88f9-aa7a7e78d4f4/volumes"
Jul 10 22:51:22.804174 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:51:22.804156    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d" path="/var/lib/kubelet/pods/8721e8db-eb6e-4f03-8f9c-2e62a4ccab7d/volumes"
Jul 10 22:52:35.925440 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:35.925405    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"]
Jul 10 22:52:35.926226 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:35.925885    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77902801-788f-4adf-88f9-aa7a7e78d4f4" containerName="authorino"
Jul 10 22:52:35.926226 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:35.925904    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="77902801-788f-4adf-88f9-aa7a7e78d4f4" containerName="authorino"
Jul 10 22:52:35.926226 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:35.925979    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="77902801-788f-4adf-88f9-aa7a7e78d4f4" containerName="authorino"
Jul 10 22:52:35.929060 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:35.929042    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:35.932445 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:35.932423    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 22:52:35.932557 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:35.932439    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 22:52:35.932557 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:35.932425    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 10 22:52:35.932557 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:35.932425    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-crclv\""
Jul 10 22:52:35.940695 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:35.940672    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"]
Jul 10 22:52:36.026614 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.026567    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaf1cf42-094b-4a07-b97a-b24816c769a5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.026814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.026631    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaf1cf42-094b-4a07-b97a-b24816c769a5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.026814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.026669    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaf1cf42-094b-4a07-b97a-b24816c769a5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.026814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.026692    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf1cf42-094b-4a07-b97a-b24816c769a5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.026814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.026741    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaf1cf42-094b-4a07-b97a-b24816c769a5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.026814 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.026806    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf77s\" (UniqueName: \"kubernetes.io/projected/eaf1cf42-094b-4a07-b97a-b24816c769a5-kube-api-access-wf77s\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.128249 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.128209    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf77s\" (UniqueName: \"kubernetes.io/projected/eaf1cf42-094b-4a07-b97a-b24816c769a5-kube-api-access-wf77s\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.128249 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.128253    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaf1cf42-094b-4a07-b97a-b24816c769a5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.128508 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.128285    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaf1cf42-094b-4a07-b97a-b24816c769a5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.128508 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.128324    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaf1cf42-094b-4a07-b97a-b24816c769a5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.128508 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.128344    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf1cf42-094b-4a07-b97a-b24816c769a5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.128508 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.128390    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaf1cf42-094b-4a07-b97a-b24816c769a5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.128790 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.128738    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eaf1cf42-094b-4a07-b97a-b24816c769a5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.128871 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.128793    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eaf1cf42-094b-4a07-b97a-b24816c769a5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.128871 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.128824    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eaf1cf42-094b-4a07-b97a-b24816c769a5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.130615 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.130593    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eaf1cf42-094b-4a07-b97a-b24816c769a5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.130885 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.130868    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaf1cf42-094b-4a07-b97a-b24816c769a5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.136844 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.136819    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf77s\" (UniqueName: \"kubernetes.io/projected/eaf1cf42-094b-4a07-b97a-b24816c769a5-kube-api-access-wf77s\") pod \"e2e-trlp-test-simulated-kserve-598466548d-h59cj\" (UID: \"eaf1cf42-094b-4a07-b97a-b24816c769a5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.239093 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.239001    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:36.375345 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:36.375319    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"]
Jul 10 22:52:36.377537 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:52:36.377506    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf1cf42_094b_4a07_b97a_b24816c769a5.slice/crio-215eaa9c9b58c4d25f772e3c56c59f9139b2abe88c07ce0110f1caceb6349399 WatchSource:0}: Error finding container 215eaa9c9b58c4d25f772e3c56c59f9139b2abe88c07ce0110f1caceb6349399: Status 404 returned error can't find the container with id 215eaa9c9b58c4d25f772e3c56c59f9139b2abe88c07ce0110f1caceb6349399
Jul 10 22:52:37.347399 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:37.347368    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj" event={"ID":"eaf1cf42-094b-4a07-b97a-b24816c769a5","Type":"ContainerStarted","Data":"215eaa9c9b58c4d25f772e3c56c59f9139b2abe88c07ce0110f1caceb6349399"}
Jul 10 22:52:38.353996 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:38.353959    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj" event={"ID":"eaf1cf42-094b-4a07-b97a-b24816c769a5","Type":"ContainerStarted","Data":"6d2718c78d339e2309c7527ddfc4853e10d500b40db49169118e2b8ed800cbb4"}
Jul 10 22:52:38.371953 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:38.371900    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj" podStartSLOduration=2.357828029 podStartE2EDuration="3.371885777s" totalImagesPullingTime="1.014057748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:52:38.37087199 +0000 UTC m=+578.064230267" watchObservedRunningTime="2026-07-10 22:52:38.371885777 +0000 UTC m=+578.065244051"
Jul 10 22:52:46.239608 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:46.239573    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:46.240143 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:46.239643    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:46.252204 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:46.252178    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:46.400027 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:46.399998    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-h59cj"
Jul 10 22:52:55.808322 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:55.808280    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"]
Jul 10 22:52:55.812062 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:55.812042    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:55.814454 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:55.814435    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 10 22:52:55.820485 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:55.820464    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"]
Jul 10 22:52:55.902357 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:55.902318    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8195d1d5-7c01-489b-ba0e-3222d5754133-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:55.902527 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:55.902379    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gplc\" (UniqueName: \"kubernetes.io/projected/8195d1d5-7c01-489b-ba0e-3222d5754133-kube-api-access-6gplc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:55.902527 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:55.902419    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8195d1d5-7c01-489b-ba0e-3222d5754133-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:55.902527 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:55.902442    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8195d1d5-7c01-489b-ba0e-3222d5754133-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:55.902527 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:55.902486    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8195d1d5-7c01-489b-ba0e-3222d5754133-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:55.902527 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:55.902520    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8195d1d5-7c01-489b-ba0e-3222d5754133-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.004032 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.003998    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8195d1d5-7c01-489b-ba0e-3222d5754133-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.004032 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.004040    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8195d1d5-7c01-489b-ba0e-3222d5754133-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.004344 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.004067    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8195d1d5-7c01-489b-ba0e-3222d5754133-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.004344 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.004091    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8195d1d5-7c01-489b-ba0e-3222d5754133-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.004344 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.004136    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8195d1d5-7c01-489b-ba0e-3222d5754133-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.004344 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.004175    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gplc\" (UniqueName: \"kubernetes.io/projected/8195d1d5-7c01-489b-ba0e-3222d5754133-kube-api-access-6gplc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.004552 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.004473    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8195d1d5-7c01-489b-ba0e-3222d5754133-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.004596 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.004549    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8195d1d5-7c01-489b-ba0e-3222d5754133-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.004657 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.004640    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8195d1d5-7c01-489b-ba0e-3222d5754133-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.006572 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.006545    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8195d1d5-7c01-489b-ba0e-3222d5754133-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.007110 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.007082    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8195d1d5-7c01-489b-ba0e-3222d5754133-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.012205 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.012180    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gplc\" (UniqueName: \"kubernetes.io/projected/8195d1d5-7c01-489b-ba0e-3222d5754133-kube-api-access-6gplc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9kbds\" (UID: \"8195d1d5-7c01-489b-ba0e-3222d5754133\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.123756 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.123726    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:52:56.258695 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.258670    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"]
Jul 10 22:52:56.260315 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:52:56.260282    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8195d1d5_7c01_489b_ba0e_3222d5754133.slice/crio-193b4aed653827f2463fe198101012c24d69fc80b0d926bd713769d5ee93b305 WatchSource:0}: Error finding container 193b4aed653827f2463fe198101012c24d69fc80b0d926bd713769d5ee93b305: Status 404 returned error can't find the container with id 193b4aed653827f2463fe198101012c24d69fc80b0d926bd713769d5ee93b305
Jul 10 22:52:56.431818 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:56.431718    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds" event={"ID":"8195d1d5-7c01-489b-ba0e-3222d5754133","Type":"ContainerStarted","Data":"193b4aed653827f2463fe198101012c24d69fc80b0d926bd713769d5ee93b305"}
Jul 10 22:52:57.437042 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:57.437006    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds" event={"ID":"8195d1d5-7c01-489b-ba0e-3222d5754133","Type":"ContainerStarted","Data":"8d7834e34c9380ed6cea67161dee24b81789a7661bcaeb25046eeec9bbb304cb"}
Jul 10 22:52:57.456280 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:52:57.456227    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds" podStartSLOduration=2.276443759 podStartE2EDuration="2.456209212s" totalImagesPullingTime="179.765453ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:52:57.454496629 +0000 UTC m=+597.147854904" watchObservedRunningTime="2026-07-10 22:52:57.456209212 +0000 UTC m=+597.149567486"
Jul 10 22:53:00.732178 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:00.732143    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 22:53:00.732620 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:00.732427    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 22:53:06.124400 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:06.124361    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:53:06.126833 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:06.124452    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:53:06.136644 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:06.136624    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:53:06.488156 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:06.488074    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9kbds"
Jul 10 22:53:07.723055 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.723014    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"]
Jul 10 22:53:07.728969 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.728943    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.731482 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.731457    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 10 22:53:07.735374 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.735348    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"]
Jul 10 22:53:07.814851 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.814807    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cc0b91a-1df4-4a12-94f3-1823da6847df-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.815042 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.814880    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cc0b91a-1df4-4a12-94f3-1823da6847df-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.815042 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.814921    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cc0b91a-1df4-4a12-94f3-1823da6847df-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.815042 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.814969    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj7dx\" (UniqueName: \"kubernetes.io/projected/8cc0b91a-1df4-4a12-94f3-1823da6847df-kube-api-access-wj7dx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.815042 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.815038    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cc0b91a-1df4-4a12-94f3-1823da6847df-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.815254 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.815125    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cc0b91a-1df4-4a12-94f3-1823da6847df-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.916579 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.916539    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cc0b91a-1df4-4a12-94f3-1823da6847df-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.916758 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.916600    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cc0b91a-1df4-4a12-94f3-1823da6847df-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.916758 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.916630    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cc0b91a-1df4-4a12-94f3-1823da6847df-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.916758 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.916659    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cc0b91a-1df4-4a12-94f3-1823da6847df-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.916758 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.916692    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj7dx\" (UniqueName: \"kubernetes.io/projected/8cc0b91a-1df4-4a12-94f3-1823da6847df-kube-api-access-wj7dx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.916758 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.916754    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cc0b91a-1df4-4a12-94f3-1823da6847df-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.917063 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.917042    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cc0b91a-1df4-4a12-94f3-1823da6847df-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.917133 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.917077    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cc0b91a-1df4-4a12-94f3-1823da6847df-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.917133 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.917120    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cc0b91a-1df4-4a12-94f3-1823da6847df-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.919051 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.919014    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cc0b91a-1df4-4a12-94f3-1823da6847df-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.919202 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.919181    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cc0b91a-1df4-4a12-94f3-1823da6847df-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:07.924514 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:07.924494    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj7dx\" (UniqueName: \"kubernetes.io/projected/8cc0b91a-1df4-4a12-94f3-1823da6847df-kube-api-access-wj7dx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb\" (UID: \"8cc0b91a-1df4-4a12-94f3-1823da6847df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:08.038433 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:08.038337    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:08.173290 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:08.173186    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"]
Jul 10 22:53:08.175504 ip-10-0-130-215 kubenswrapper[2566]: W0710 22:53:08.175475    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cc0b91a_1df4_4a12_94f3_1823da6847df.slice/crio-6cc57f0166edf40f830f0a99ae74bb84550bd4ea085c404f8fde4c61ed18414d WatchSource:0}: Error finding container 6cc57f0166edf40f830f0a99ae74bb84550bd4ea085c404f8fde4c61ed18414d: Status 404 returned error can't find the container with id 6cc57f0166edf40f830f0a99ae74bb84550bd4ea085c404f8fde4c61ed18414d
Jul 10 22:53:08.487952 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:08.487921    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb" event={"ID":"8cc0b91a-1df4-4a12-94f3-1823da6847df","Type":"ContainerStarted","Data":"e32141f0fca1266fe7a80627082bf870056df5709fb31053ad56b1ee990485ca"}
Jul 10 22:53:08.488142 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:08.487962    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb" event={"ID":"8cc0b91a-1df4-4a12-94f3-1823da6847df","Type":"ContainerStarted","Data":"6cc57f0166edf40f830f0a99ae74bb84550bd4ea085c404f8fde4c61ed18414d"}
Jul 10 22:53:08.504564 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:08.504492    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb" podStartSLOduration=1.336527553 podStartE2EDuration="1.50447361s" totalImagesPullingTime="167.946057ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 22:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 22:53:08.503744783 +0000 UTC m=+608.197103057" watchObservedRunningTime="2026-07-10 22:53:08.50447361 +0000 UTC m=+608.197831886"
Jul 10 22:53:18.038584 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:18.038542    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:18.038584 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:18.038586    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:18.052553 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:18.052524    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:53:18.547199 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:53:18.547171    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb"
Jul 10 22:54:05.607811 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:05.607774    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9dbfc64dc-62q58"]
Jul 10 22:54:05.608524 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:05.608001    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-9dbfc64dc-62q58" podUID="937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7" containerName="authorino" containerID="cri-o://e23b3980e15d53a49513e3961d1badd450a39c19f4a20bf3c0825f7de449c043" gracePeriod=30
Jul 10 22:54:05.750340 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:05.750303    2566 generic.go:356] "Generic (PLEG): container finished" podID="937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7" containerID="e23b3980e15d53a49513e3961d1badd450a39c19f4a20bf3c0825f7de449c043" exitCode=0
Jul 10 22:54:05.750509 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:05.750377    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9dbfc64dc-62q58" event={"ID":"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7","Type":"ContainerDied","Data":"e23b3980e15d53a49513e3961d1badd450a39c19f4a20bf3c0825f7de449c043"}
Jul 10 22:54:05.855750 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:05.855726    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9dbfc64dc-62q58"
Jul 10 22:54:05.958666 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:05.958575    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7-tls-cert\") pod \"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7\" (UID: \"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7\") "
Jul 10 22:54:05.958848 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:05.958674    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8fgt\" (UniqueName: \"kubernetes.io/projected/937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7-kube-api-access-x8fgt\") pod \"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7\" (UID: \"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7\") "
Jul 10 22:54:05.960608 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:05.960575    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7-kube-api-access-x8fgt" (OuterVolumeSpecName: "kube-api-access-x8fgt") pod "937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7" (UID: "937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7"). InnerVolumeSpecName "kube-api-access-x8fgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 22:54:05.968165 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:05.968135    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7" (UID: "937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 22:54:06.060166 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:06.060130    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8fgt\" (UniqueName: \"kubernetes.io/projected/937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7-kube-api-access-x8fgt\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:54:06.060166 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:06.060161    2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7-tls-cert\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 22:54:06.756019 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:06.755991    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9dbfc64dc-62q58"
Jul 10 22:54:06.756472 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:06.755988    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9dbfc64dc-62q58" event={"ID":"937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7","Type":"ContainerDied","Data":"ad6c97fcb66b39e45952a4aeb599e5630cf8b9367970be8c0891a90e68e2775b"}
Jul 10 22:54:06.756472 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:06.756121    2566 scope.go:117] "RemoveContainer" containerID="e23b3980e15d53a49513e3961d1badd450a39c19f4a20bf3c0825f7de449c043"
Jul 10 22:54:06.790878 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:06.790811    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9dbfc64dc-62q58"]
Jul 10 22:54:06.792318 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:06.792298    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-9dbfc64dc-62q58"]
Jul 10 22:54:06.803271 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:54:06.803243    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7" path="/var/lib/kubelet/pods/937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7/volumes"
Jul 10 22:58:00.758703 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:58:00.758672    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 22:58:00.759216 ip-10-0-130-215 kubenswrapper[2566]: I0710 22:58:00.758928    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 23:03:00.790567 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:03:00.790540    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 23:03:00.791878 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:03:00.791856    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 23:08:00.815635 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:08:00.815605    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 23:08:00.819339 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:08:00.819301    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 23:10:43.161790 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.161745    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"]
Jul 10 23:10:43.162213 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.162092    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7" containerName="authorino"
Jul 10 23:10:43.162213 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.162103    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7" containerName="authorino"
Jul 10 23:10:43.162213 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.162155    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="937f7e8f-c7c2-4db1-a9f8-1c07714e6fc7" containerName="authorino"
Jul 10 23:10:43.165093 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.165076    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.173957 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.173936    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ea0b66f6\"/\"openshift-service-ca.crt\""
Jul 10 23:10:43.174245 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.174230    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ea0b66f6\"/\"kube-root-ca.crt\""
Jul 10 23:10:43.174817 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.174804    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ea0b66f6\"/\"default-dockercfg-c7xc4\""
Jul 10 23:10:43.175194 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.175182    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ea0b66f6\"/\"e2e-lifecycle-model-ea0b66f6-kserve-self-signed-certs\""
Jul 10 23:10:43.192912 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.192884    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"]
Jul 10 23:10:43.248832 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.248782    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz5x4\" (UniqueName: \"kubernetes.io/projected/c847c85c-060d-47be-bfef-b8b3fd90737e-kube-api-access-lz5x4\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.249039 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.248902    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-home\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.249039 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.248931    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-tmp-dir\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.249039 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.248957    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c847c85c-060d-47be-bfef-b8b3fd90737e-tls-certs\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.249039 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.248974    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-model-cache\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.249039 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.248993    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-dshm\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.350456 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.350424    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz5x4\" (UniqueName: \"kubernetes.io/projected/c847c85c-060d-47be-bfef-b8b3fd90737e-kube-api-access-lz5x4\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.350647 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.350506    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-home\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.350647 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.350537    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-tmp-dir\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.350647 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.350571    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c847c85c-060d-47be-bfef-b8b3fd90737e-tls-certs\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.350647 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.350616    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-model-cache\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.350852 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.350661    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-dshm\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.350977 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.350953    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-tmp-dir\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.351045 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.351010    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-model-cache\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.351107 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.351077    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-home\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.352875 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.352856    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-dshm\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.353088 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.353072    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c847c85c-060d-47be-bfef-b8b3fd90737e-tls-certs\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.360757 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.360735    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz5x4\" (UniqueName: \"kubernetes.io/projected/c847c85c-060d-47be-bfef-b8b3fd90737e-kube-api-access-lz5x4\") pod \"e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") " pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.474575 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.474487    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:43.616088 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:43.616063    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"]
Jul 10 23:10:43.619440 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:10:43.619410    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc847c85c_060d_47be_bfef_b8b3fd90737e.slice/crio-b52bb31ee2f51518f93f6048052f9b9288b5db2c64b123733a28c7022d181ff0 WatchSource:0}: Error finding container b52bb31ee2f51518f93f6048052f9b9288b5db2c64b123733a28c7022d181ff0: Status 404 returned error can't find the container with id b52bb31ee2f51518f93f6048052f9b9288b5db2c64b123733a28c7022d181ff0
Jul 10 23:10:44.181856 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:44.181820    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz" event={"ID":"c847c85c-060d-47be-bfef-b8b3fd90737e","Type":"ContainerStarted","Data":"17f65dc37dec361bafcb6dfdc80313cc26a60cd0879fff7e7271289b6095de22"}
Jul 10 23:10:44.181856 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:44.181863    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz" event={"ID":"c847c85c-060d-47be-bfef-b8b3fd90737e","Type":"ContainerStarted","Data":"b52bb31ee2f51518f93f6048052f9b9288b5db2c64b123733a28c7022d181ff0"}
Jul 10 23:10:44.201224 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:44.201173    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz" podStartSLOduration=1.201155932 podStartE2EDuration="1.201155932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:10:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:10:44.199937718 +0000 UTC m=+1663.893296008" watchObservedRunningTime="2026-07-10 23:10:44.201155932 +0000 UTC m=+1663.894514207"
Jul 10 23:10:53.475178 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:53.475132    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:53.475621 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:53.475280    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:53.488148 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:53.488118    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:10:54.246542 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:10:54.246510    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:11:16.864191 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:16.864156    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"]
Jul 10 23:11:31.884542 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:31.884471    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz" podUID="c847c85c-060d-47be-bfef-b8b3fd90737e" containerName="main" containerID="cri-o://17f65dc37dec361bafcb6dfdc80313cc26a60cd0879fff7e7271289b6095de22" gracePeriod=45
Jul 10 23:11:32.132780 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.132737    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:11:32.191639 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.191553    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-tmp-dir\") pod \"c847c85c-060d-47be-bfef-b8b3fd90737e\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") "
Jul 10 23:11:32.191639 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.191593    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-home\") pod \"c847c85c-060d-47be-bfef-b8b3fd90737e\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") "
Jul 10 23:11:32.191639 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.191618    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-dshm\") pod \"c847c85c-060d-47be-bfef-b8b3fd90737e\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") "
Jul 10 23:11:32.191946 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.191690    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-model-cache\") pod \"c847c85c-060d-47be-bfef-b8b3fd90737e\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") "
Jul 10 23:11:32.191946 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.191776    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c847c85c-060d-47be-bfef-b8b3fd90737e-tls-certs\") pod \"c847c85c-060d-47be-bfef-b8b3fd90737e\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") "
Jul 10 23:11:32.191946 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.191817    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lz5x4\" (UniqueName: \"kubernetes.io/projected/c847c85c-060d-47be-bfef-b8b3fd90737e-kube-api-access-lz5x4\") pod \"c847c85c-060d-47be-bfef-b8b3fd90737e\" (UID: \"c847c85c-060d-47be-bfef-b8b3fd90737e\") "
Jul 10 23:11:32.191946 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.191885    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-home" (OuterVolumeSpecName: "home") pod "c847c85c-060d-47be-bfef-b8b3fd90737e" (UID: "c847c85c-060d-47be-bfef-b8b3fd90737e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:11:32.191946 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.191896    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c847c85c-060d-47be-bfef-b8b3fd90737e" (UID: "c847c85c-060d-47be-bfef-b8b3fd90737e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:11:32.192211 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.191976    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-model-cache" (OuterVolumeSpecName: "model-cache") pod "c847c85c-060d-47be-bfef-b8b3fd90737e" (UID: "c847c85c-060d-47be-bfef-b8b3fd90737e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:11:32.192211 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.192123    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-model-cache\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:11:32.192211 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.192159    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-tmp-dir\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:11:32.192211 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.192169    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-home\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:11:32.193982 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.193956    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-dshm" (OuterVolumeSpecName: "dshm") pod "c847c85c-060d-47be-bfef-b8b3fd90737e" (UID: "c847c85c-060d-47be-bfef-b8b3fd90737e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:11:32.194096 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.194052    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c847c85c-060d-47be-bfef-b8b3fd90737e-kube-api-access-lz5x4" (OuterVolumeSpecName: "kube-api-access-lz5x4") pod "c847c85c-060d-47be-bfef-b8b3fd90737e" (UID: "c847c85c-060d-47be-bfef-b8b3fd90737e"). InnerVolumeSpecName "kube-api-access-lz5x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:11:32.194140 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.194115    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c847c85c-060d-47be-bfef-b8b3fd90737e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c847c85c-060d-47be-bfef-b8b3fd90737e" (UID: "c847c85c-060d-47be-bfef-b8b3fd90737e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:11:32.292710 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.292675    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c847c85c-060d-47be-bfef-b8b3fd90737e-tls-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:11:32.292710 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.292711    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz5x4\" (UniqueName: \"kubernetes.io/projected/c847c85c-060d-47be-bfef-b8b3fd90737e-kube-api-access-lz5x4\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:11:32.292976 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.292726    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c847c85c-060d-47be-bfef-b8b3fd90737e-dshm\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:11:32.406616 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.406577    2566 generic.go:356] "Generic (PLEG): container finished" podID="c847c85c-060d-47be-bfef-b8b3fd90737e" containerID="17f65dc37dec361bafcb6dfdc80313cc26a60cd0879fff7e7271289b6095de22" exitCode=0
Jul 10 23:11:32.406795 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.406629    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"
Jul 10 23:11:32.406795 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.406637    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz" event={"ID":"c847c85c-060d-47be-bfef-b8b3fd90737e","Type":"ContainerDied","Data":"17f65dc37dec361bafcb6dfdc80313cc26a60cd0879fff7e7271289b6095de22"}
Jul 10 23:11:32.406795 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.406680    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz" event={"ID":"c847c85c-060d-47be-bfef-b8b3fd90737e","Type":"ContainerDied","Data":"b52bb31ee2f51518f93f6048052f9b9288b5db2c64b123733a28c7022d181ff0"}
Jul 10 23:11:32.406795 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.406702    2566 scope.go:117] "RemoveContainer" containerID="17f65dc37dec361bafcb6dfdc80313cc26a60cd0879fff7e7271289b6095de22"
Jul 10 23:11:32.415502 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.415484    2566 scope.go:117] "RemoveContainer" containerID="17f65dc37dec361bafcb6dfdc80313cc26a60cd0879fff7e7271289b6095de22"
Jul 10 23:11:32.415810 ip-10-0-130-215 kubenswrapper[2566]: E0710 23:11:32.415790    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17f65dc37dec361bafcb6dfdc80313cc26a60cd0879fff7e7271289b6095de22\": container with ID starting with 17f65dc37dec361bafcb6dfdc80313cc26a60cd0879fff7e7271289b6095de22 not found: ID does not exist" containerID="17f65dc37dec361bafcb6dfdc80313cc26a60cd0879fff7e7271289b6095de22"
Jul 10 23:11:32.415875 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.415820    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17f65dc37dec361bafcb6dfdc80313cc26a60cd0879fff7e7271289b6095de22"} err="failed to get container status \"17f65dc37dec361bafcb6dfdc80313cc26a60cd0879fff7e7271289b6095de22\": rpc error: code = NotFound desc = could not find container \"17f65dc37dec361bafcb6dfdc80313cc26a60cd0879fff7e7271289b6095de22\": container with ID starting with 17f65dc37dec361bafcb6dfdc80313cc26a60cd0879fff7e7271289b6095de22 not found: ID does not exist"
Jul 10 23:11:32.427678 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.427643    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"]
Jul 10 23:11:32.429968 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.429943    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ea0b66f6/e2e-lifecycle-model-ea0b66f6-kserve-7d74bf7b8c-wzlxz"]
Jul 10 23:11:32.803480 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:11:32.803448    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c847c85c-060d-47be-bfef-b8b3fd90737e" path="/var/lib/kubelet/pods/c847c85c-060d-47be-bfef-b8b3fd90737e/volumes"
Jul 10 23:13:00.841724 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:00.841691    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 23:13:00.845528 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:00.845506    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 23:13:27.899240 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:27.899204    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"]
Jul 10 23:13:27.899643 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:27.899537    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c847c85c-060d-47be-bfef-b8b3fd90737e" containerName="main"
Jul 10 23:13:27.899643 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:27.899548    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c847c85c-060d-47be-bfef-b8b3fd90737e" containerName="main"
Jul 10 23:13:27.899643 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:27.899617    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c847c85c-060d-47be-bfef-b8b3fd90737e" containerName="main"
Jul 10 23:13:27.902846 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:27.902816    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:27.911499 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:27.911480    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1dc3cf\"/\"default-dockercfg-thc6t\""
Jul 10 23:13:27.911852 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:27.911827    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1dc3cf\"/\"openshift-service-ca.crt\""
Jul 10 23:13:27.912470 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:27.912456    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-1dc3cf\"/\"test-model-1dc3cf-kserve-self-signed-certs\""
Jul 10 23:13:27.912625 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:27.912608    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-1dc3cf\"/\"kube-root-ca.crt\""
Jul 10 23:13:27.923569 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:27.923539    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"]
Jul 10 23:13:28.024357 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.024316    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-model-cache\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.024357 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.024365    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-home\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.024575 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.024389    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-tmp-dir\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.024575 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.024470    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-dshm\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.024575 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.024487    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f8e43c-0104-4065-9be2-8372cd80f196-tls-certs\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.024575 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.024519    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cstzd\" (UniqueName: \"kubernetes.io/projected/f0f8e43c-0104-4065-9be2-8372cd80f196-kube-api-access-cstzd\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.125216 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.125183    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-dshm\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.125216 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.125220    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f8e43c-0104-4065-9be2-8372cd80f196-tls-certs\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.125465 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.125248    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cstzd\" (UniqueName: \"kubernetes.io/projected/f0f8e43c-0104-4065-9be2-8372cd80f196-kube-api-access-cstzd\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.125465 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.125272    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-model-cache\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.125465 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.125296    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-home\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.125465 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.125315    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-tmp-dir\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.125714 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.125697    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-tmp-dir\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.125835 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.125809    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-home\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.125903 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.125850    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-model-cache\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.127544 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.127517    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-dshm\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.127887 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.127868    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f8e43c-0104-4065-9be2-8372cd80f196-tls-certs\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.137239 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.137210    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cstzd\" (UniqueName: \"kubernetes.io/projected/f0f8e43c-0104-4065-9be2-8372cd80f196-kube-api-access-cstzd\") pod \"test-model-1dc3cf-kserve-7bbbb6545c-n8dck\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") " pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.213411 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.213319    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:28.353222 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.353196    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"]
Jul 10 23:13:28.355607 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:13:28.355577    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0f8e43c_0104_4065_9be2_8372cd80f196.slice/crio-175d17f69690bb4d86e15f7cd4336026910863d06c0a29ea582173b4cd6046c5 WatchSource:0}: Error finding container 175d17f69690bb4d86e15f7cd4336026910863d06c0a29ea582173b4cd6046c5: Status 404 returned error can't find the container with id 175d17f69690bb4d86e15f7cd4336026910863d06c0a29ea582173b4cd6046c5
Jul 10 23:13:28.928907 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.928860    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck" event={"ID":"f0f8e43c-0104-4065-9be2-8372cd80f196","Type":"ContainerStarted","Data":"d96f1523ead77ac8537e1216e27107507504f8825f7b0747ee6e02debb07c446"}
Jul 10 23:13:28.929360 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.928918    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck" event={"ID":"f0f8e43c-0104-4065-9be2-8372cd80f196","Type":"ContainerStarted","Data":"175d17f69690bb4d86e15f7cd4336026910863d06c0a29ea582173b4cd6046c5"}
Jul 10 23:13:28.946694 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:28.946638    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck" podStartSLOduration=1.9466214929999999 podStartE2EDuration="1.946621493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:13:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:13:28.944804767 +0000 UTC m=+1828.638163042" watchObservedRunningTime="2026-07-10 23:13:28.946621493 +0000 UTC m=+1828.639979767"
Jul 10 23:13:38.214503 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:38.214464    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:38.215124 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:38.214530    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:38.227345 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:38.227317    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:38.985571 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:38.985541    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:13:57.332965 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.332929    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"]
Jul 10 23:13:57.336583 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.336559    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.340041 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.340010    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-51f2b4\"/\"test-model-51f2b4-kserve-self-signed-certs\""
Jul 10 23:13:57.340196 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.340047    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-51f2b4\"/\"default-dockercfg-24nq6\""
Jul 10 23:13:57.340196 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.340086    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-51f2b4\"/\"openshift-service-ca.crt\""
Jul 10 23:13:57.340196 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.340047    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-51f2b4\"/\"kube-root-ca.crt\""
Jul 10 23:13:57.345148 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.345128    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"]
Jul 10 23:13:57.391512 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.391474    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-dshm\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.391689 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.391527    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-model-cache\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.391689 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.391587    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-home\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.391689 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.391630    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-tmp-dir\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.391689 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.391661    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2srg\" (UniqueName: \"kubernetes.io/projected/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-kube-api-access-d2srg\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.391881 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.391738    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-tls-certs\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.492946 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.492903    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-tls-certs\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.493161 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.493002    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-dshm\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.493161 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.493055    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-model-cache\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.493161 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.493083    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-home\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.493161 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.493112    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-tmp-dir\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.493161 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.493147    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2srg\" (UniqueName: \"kubernetes.io/projected/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-kube-api-access-d2srg\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.493541 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.493510    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-model-cache\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.493643 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.493548    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-tmp-dir\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.493643 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.493575    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-home\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.495318 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.495289    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-dshm\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.495511 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.495496    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-tls-certs\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.506146 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.506120    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2srg\" (UniqueName: \"kubernetes.io/projected/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-kube-api-access-d2srg\") pod \"test-model-51f2b4-kserve-bfc8cc87c-prr88\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") " pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.647129 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.647093    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:13:57.781594 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:57.781570    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"]
Jul 10 23:13:57.783116 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:13:57.783091    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaeebbd4b_c5d3_48e0_a977_cb33c1dfa69f.slice/crio-77aec9df9999848cb4cec1e68c1997030d54e4beacd1cab0e66d53eb1b7a8d94 WatchSource:0}: Error finding container 77aec9df9999848cb4cec1e68c1997030d54e4beacd1cab0e66d53eb1b7a8d94: Status 404 returned error can't find the container with id 77aec9df9999848cb4cec1e68c1997030d54e4beacd1cab0e66d53eb1b7a8d94
Jul 10 23:13:58.058120 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:58.058024    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88" event={"ID":"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f","Type":"ContainerStarted","Data":"6427f93e920700265e3e7858cf24d0b56fb2ad647e4d654367c4265ad0f33063"}
Jul 10 23:13:58.058120 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:58.058060    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88" event={"ID":"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f","Type":"ContainerStarted","Data":"77aec9df9999848cb4cec1e68c1997030d54e4beacd1cab0e66d53eb1b7a8d94"}
Jul 10 23:13:58.078506 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:13:58.078456    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88" podStartSLOduration=1.078439391 podStartE2EDuration="1.078439391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:13:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:13:58.077293602 +0000 UTC m=+1857.770651900" watchObservedRunningTime="2026-07-10 23:13:58.078439391 +0000 UTC m=+1857.771797665"
Jul 10 23:14:07.648190 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:07.648147    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:14:07.648591 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:07.648212    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:14:07.660925 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:07.660895    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:14:08.110877 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:08.110845    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:14:24.866594 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:24.866510    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"]
Jul 10 23:14:25.760905 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:25.760865    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"]
Jul 10 23:14:39.886588 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:39.886539    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck" podUID="f0f8e43c-0104-4065-9be2-8372cd80f196" containerName="main" containerID="cri-o://d96f1523ead77ac8537e1216e27107507504f8825f7b0747ee6e02debb07c446" gracePeriod=45
Jul 10 23:14:40.139652 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.139576    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:14:40.182123 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.182083    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-model-cache\") pod \"f0f8e43c-0104-4065-9be2-8372cd80f196\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") "
Jul 10 23:14:40.182294 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.182184    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-dshm\") pod \"f0f8e43c-0104-4065-9be2-8372cd80f196\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") "
Jul 10 23:14:40.182294 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.182218    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cstzd\" (UniqueName: \"kubernetes.io/projected/f0f8e43c-0104-4065-9be2-8372cd80f196-kube-api-access-cstzd\") pod \"f0f8e43c-0104-4065-9be2-8372cd80f196\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") "
Jul 10 23:14:40.182294 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.182247    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f8e43c-0104-4065-9be2-8372cd80f196-tls-certs\") pod \"f0f8e43c-0104-4065-9be2-8372cd80f196\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") "
Jul 10 23:14:40.182294 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.182277    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-home\") pod \"f0f8e43c-0104-4065-9be2-8372cd80f196\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") "
Jul 10 23:14:40.182486 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.182324    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-tmp-dir\") pod \"f0f8e43c-0104-4065-9be2-8372cd80f196\" (UID: \"f0f8e43c-0104-4065-9be2-8372cd80f196\") "
Jul 10 23:14:40.182486 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.182367    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-model-cache" (OuterVolumeSpecName: "model-cache") pod "f0f8e43c-0104-4065-9be2-8372cd80f196" (UID: "f0f8e43c-0104-4065-9be2-8372cd80f196"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:14:40.182597 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.182582    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-model-cache\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:14:40.182651 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.182619    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-home" (OuterVolumeSpecName: "home") pod "f0f8e43c-0104-4065-9be2-8372cd80f196" (UID: "f0f8e43c-0104-4065-9be2-8372cd80f196"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:14:40.182698 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.182653    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f0f8e43c-0104-4065-9be2-8372cd80f196" (UID: "f0f8e43c-0104-4065-9be2-8372cd80f196"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:14:40.184520 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.184487    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-dshm" (OuterVolumeSpecName: "dshm") pod "f0f8e43c-0104-4065-9be2-8372cd80f196" (UID: "f0f8e43c-0104-4065-9be2-8372cd80f196"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:14:40.184520 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.184507    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0f8e43c-0104-4065-9be2-8372cd80f196-kube-api-access-cstzd" (OuterVolumeSpecName: "kube-api-access-cstzd") pod "f0f8e43c-0104-4065-9be2-8372cd80f196" (UID: "f0f8e43c-0104-4065-9be2-8372cd80f196"). InnerVolumeSpecName "kube-api-access-cstzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:14:40.184671 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.184526    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0f8e43c-0104-4065-9be2-8372cd80f196-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f0f8e43c-0104-4065-9be2-8372cd80f196" (UID: "f0f8e43c-0104-4065-9be2-8372cd80f196"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:14:40.241843 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.241808    2566 generic.go:356] "Generic (PLEG): container finished" podID="f0f8e43c-0104-4065-9be2-8372cd80f196" containerID="d96f1523ead77ac8537e1216e27107507504f8825f7b0747ee6e02debb07c446" exitCode=0
Jul 10 23:14:40.242005 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.241896    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"
Jul 10 23:14:40.242005 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.241914    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck" event={"ID":"f0f8e43c-0104-4065-9be2-8372cd80f196","Type":"ContainerDied","Data":"d96f1523ead77ac8537e1216e27107507504f8825f7b0747ee6e02debb07c446"}
Jul 10 23:14:40.242005 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.241951    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck" event={"ID":"f0f8e43c-0104-4065-9be2-8372cd80f196","Type":"ContainerDied","Data":"175d17f69690bb4d86e15f7cd4336026910863d06c0a29ea582173b4cd6046c5"}
Jul 10 23:14:40.242005 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.241969    2566 scope.go:117] "RemoveContainer" containerID="d96f1523ead77ac8537e1216e27107507504f8825f7b0747ee6e02debb07c446"
Jul 10 23:14:40.250709 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.250686    2566 scope.go:117] "RemoveContainer" containerID="d96f1523ead77ac8537e1216e27107507504f8825f7b0747ee6e02debb07c446"
Jul 10 23:14:40.251038 ip-10-0-130-215 kubenswrapper[2566]: E0710 23:14:40.251016    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d96f1523ead77ac8537e1216e27107507504f8825f7b0747ee6e02debb07c446\": container with ID starting with d96f1523ead77ac8537e1216e27107507504f8825f7b0747ee6e02debb07c446 not found: ID does not exist" containerID="d96f1523ead77ac8537e1216e27107507504f8825f7b0747ee6e02debb07c446"
Jul 10 23:14:40.251160 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.251052    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d96f1523ead77ac8537e1216e27107507504f8825f7b0747ee6e02debb07c446"} err="failed to get container status \"d96f1523ead77ac8537e1216e27107507504f8825f7b0747ee6e02debb07c446\": rpc error: code = NotFound desc = could not find container \"d96f1523ead77ac8537e1216e27107507504f8825f7b0747ee6e02debb07c446\": container with ID starting with d96f1523ead77ac8537e1216e27107507504f8825f7b0747ee6e02debb07c446 not found: ID does not exist"
Jul 10 23:14:40.263678 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.263649    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"]
Jul 10 23:14:40.267396 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.267363    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-1dc3cf/test-model-1dc3cf-kserve-7bbbb6545c-n8dck"]
Jul 10 23:14:40.283215 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.283185    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f0f8e43c-0104-4065-9be2-8372cd80f196-tls-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:14:40.283215 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.283214    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-home\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:14:40.283328 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.283241    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-tmp-dir\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:14:40.283328 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.283249    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f0f8e43c-0104-4065-9be2-8372cd80f196-dshm\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:14:40.283328 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.283259    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cstzd\" (UniqueName: \"kubernetes.io/projected/f0f8e43c-0104-4065-9be2-8372cd80f196-kube-api-access-cstzd\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:14:40.785146 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.785104    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88" podUID="aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f" containerName="main" containerID="cri-o://6427f93e920700265e3e7858cf24d0b56fb2ad647e4d654367c4265ad0f33063" gracePeriod=45
Jul 10 23:14:40.803409 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:40.803379    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0f8e43c-0104-4065-9be2-8372cd80f196" path="/var/lib/kubelet/pods/f0f8e43c-0104-4065-9be2-8372cd80f196/volumes"
Jul 10 23:14:41.035042 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.035013    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:14:41.090554 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.090459    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-model-cache\") pod \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") "
Jul 10 23:14:41.090554 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.090519    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-home\") pod \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") "
Jul 10 23:14:41.090810 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.090549    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-dshm\") pod \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") "
Jul 10 23:14:41.090810 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.090598    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-tls-certs\") pod \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") "
Jul 10 23:14:41.090810 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.090674    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2srg\" (UniqueName: \"kubernetes.io/projected/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-kube-api-access-d2srg\") pod \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") "
Jul 10 23:14:41.090810 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.090715    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-tmp-dir\") pod \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\" (UID: \"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f\") "
Jul 10 23:14:41.091013 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.090850    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-model-cache" (OuterVolumeSpecName: "model-cache") pod "aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f" (UID: "aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:14:41.091013 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.090864    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-home" (OuterVolumeSpecName: "home") pod "aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f" (UID: "aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:14:41.091112 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.091039    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f" (UID: "aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:14:41.091164 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.091127    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-tmp-dir\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:14:41.091164 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.091150    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-model-cache\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:14:41.091241 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.091163    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-home\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:14:41.092919 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.092882    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-dshm" (OuterVolumeSpecName: "dshm") pod "aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f" (UID: "aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:14:41.093063 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.092967    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f" (UID: "aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:14:41.093063 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.093004    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-kube-api-access-d2srg" (OuterVolumeSpecName: "kube-api-access-d2srg") pod "aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f" (UID: "aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f"). InnerVolumeSpecName "kube-api-access-d2srg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:14:41.191947 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.191908    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-dshm\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:14:41.191947 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.191939    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-tls-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:14:41.191947 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.191951    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2srg\" (UniqueName: \"kubernetes.io/projected/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f-kube-api-access-d2srg\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:14:41.249104 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.249065    2566 generic.go:356] "Generic (PLEG): container finished" podID="aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f" containerID="6427f93e920700265e3e7858cf24d0b56fb2ad647e4d654367c4265ad0f33063" exitCode=0
Jul 10 23:14:41.249287 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.249115    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"
Jul 10 23:14:41.249287 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.249161    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88" event={"ID":"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f","Type":"ContainerDied","Data":"6427f93e920700265e3e7858cf24d0b56fb2ad647e4d654367c4265ad0f33063"}
Jul 10 23:14:41.249287 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.249206    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88" event={"ID":"aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f","Type":"ContainerDied","Data":"77aec9df9999848cb4cec1e68c1997030d54e4beacd1cab0e66d53eb1b7a8d94"}
Jul 10 23:14:41.249287 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.249228    2566 scope.go:117] "RemoveContainer" containerID="6427f93e920700265e3e7858cf24d0b56fb2ad647e4d654367c4265ad0f33063"
Jul 10 23:14:41.258278 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.258257    2566 scope.go:117] "RemoveContainer" containerID="6427f93e920700265e3e7858cf24d0b56fb2ad647e4d654367c4265ad0f33063"
Jul 10 23:14:41.258546 ip-10-0-130-215 kubenswrapper[2566]: E0710 23:14:41.258526    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6427f93e920700265e3e7858cf24d0b56fb2ad647e4d654367c4265ad0f33063\": container with ID starting with 6427f93e920700265e3e7858cf24d0b56fb2ad647e4d654367c4265ad0f33063 not found: ID does not exist" containerID="6427f93e920700265e3e7858cf24d0b56fb2ad647e4d654367c4265ad0f33063"
Jul 10 23:14:41.258610 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.258553    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6427f93e920700265e3e7858cf24d0b56fb2ad647e4d654367c4265ad0f33063"} err="failed to get container status \"6427f93e920700265e3e7858cf24d0b56fb2ad647e4d654367c4265ad0f33063\": rpc error: code = NotFound desc = could not find container \"6427f93e920700265e3e7858cf24d0b56fb2ad647e4d654367c4265ad0f33063\": container with ID starting with 6427f93e920700265e3e7858cf24d0b56fb2ad647e4d654367c4265ad0f33063 not found: ID does not exist"
Jul 10 23:14:41.270096 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.270067    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"]
Jul 10 23:14:41.275842 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:41.275818    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-51f2b4/test-model-51f2b4-kserve-bfc8cc87c-prr88"]
Jul 10 23:14:42.803598 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:14:42.803558    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f" path="/var/lib/kubelet/pods/aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f/volumes"
Jul 10 23:16:27.608523 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.608492    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"]
Jul 10 23:16:27.609377 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.608855    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0f8e43c-0104-4065-9be2-8372cd80f196" containerName="main"
Jul 10 23:16:27.609377 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.608866    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0f8e43c-0104-4065-9be2-8372cd80f196" containerName="main"
Jul 10 23:16:27.609377 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.608892    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f" containerName="main"
Jul 10 23:16:27.609377 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.608899    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f" containerName="main"
Jul 10 23:16:27.609377 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.608954    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeebbd4b-c5d3-48e0-a977-cb33c1dfa69f" containerName="main"
Jul 10 23:16:27.609377 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.608961    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0f8e43c-0104-4065-9be2-8372cd80f196" containerName="main"
Jul 10 23:16:27.612167 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.612149    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.614976 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.614957    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6d6384\"/\"openshift-service-ca.crt\""
Jul 10 23:16:27.615927 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.615908    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6d6384\"/\"default-dockercfg-t5vv9\""
Jul 10 23:16:27.616000 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.615921    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6d6384\"/\"kube-root-ca.crt\""
Jul 10 23:16:27.616155 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.616135    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6d6384\"/\"auth-test-model-6d6384-kserve-self-signed-certs\""
Jul 10 23:16:27.621937 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.621914    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"]
Jul 10 23:16:27.755162 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.755116    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-model-cache\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.755355 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.755194    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75ce018b-b943-47b7-be86-e96828fca2de-tls-certs\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.755355 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.755216    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4jr8\" (UniqueName: \"kubernetes.io/projected/75ce018b-b943-47b7-be86-e96828fca2de-kube-api-access-s4jr8\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.755355 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.755258    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-dshm\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.755462 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.755347    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-home\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.755462 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.755377    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-tmp-dir\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.856921 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.856881    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-model-cache\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.857104 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.857048    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75ce018b-b943-47b7-be86-e96828fca2de-tls-certs\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.857104 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.857091    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4jr8\" (UniqueName: \"kubernetes.io/projected/75ce018b-b943-47b7-be86-e96828fca2de-kube-api-access-s4jr8\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.857175 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.857165    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-dshm\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.857209 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.857194    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-home\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.857259 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.857218    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-tmp-dir\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.857370 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.857350    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-model-cache\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.857515 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.857493    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-home\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.857587 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.857522    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-tmp-dir\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.859445 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.859390    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-dshm\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.859693 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.859672    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75ce018b-b943-47b7-be86-e96828fca2de-tls-certs\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.865349 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.865322    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4jr8\" (UniqueName: \"kubernetes.io/projected/75ce018b-b943-47b7-be86-e96828fca2de-kube-api-access-s4jr8\") pod \"auth-test-model-6d6384-kserve-6745f87787-nkncs\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") " pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:27.921522 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:27.921485    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:28.058972 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:28.058945    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"]
Jul 10 23:16:28.061387 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:16:28.061357    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75ce018b_b943_47b7_be86_e96828fca2de.slice/crio-80c881ab0641a4e8d690bfb8df1074f3f813326174710df71f6058a6360b4db2 WatchSource:0}: Error finding container 80c881ab0641a4e8d690bfb8df1074f3f813326174710df71f6058a6360b4db2: Status 404 returned error can't find the container with id 80c881ab0641a4e8d690bfb8df1074f3f813326174710df71f6058a6360b4db2
Jul 10 23:16:28.727962 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:28.727927    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs" event={"ID":"75ce018b-b943-47b7-be86-e96828fca2de","Type":"ContainerStarted","Data":"edb9392e8f8b79b6ce435dfc5618e4dfaaab40ed10293c1eb4d684a4aa667480"}
Jul 10 23:16:28.728433 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:28.727970    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs" event={"ID":"75ce018b-b943-47b7-be86-e96828fca2de","Type":"ContainerStarted","Data":"80c881ab0641a4e8d690bfb8df1074f3f813326174710df71f6058a6360b4db2"}
Jul 10 23:16:28.746811 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:28.746736    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs" podStartSLOduration=1.74671996 podStartE2EDuration="1.74671996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:16:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:16:28.745718062 +0000 UTC m=+2008.439076357" watchObservedRunningTime="2026-07-10 23:16:28.74671996 +0000 UTC m=+2008.440078234"
Jul 10 23:16:37.922569 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:37.922526    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:37.923044 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:37.922606    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:37.935373 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:37.935350    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:38.780082 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:38.780051    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:16:50.636305 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.636273    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"]
Jul 10 23:16:50.639216 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.639190    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.641862 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.641836    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-02c498\"/\"default-dockercfg-cdn8s\""
Jul 10 23:16:50.641862 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.641859    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-02c498\"/\"kube-root-ca.crt\""
Jul 10 23:16:50.642026 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.641977    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-02c498\"/\"openshift-service-ca.crt\""
Jul 10 23:16:50.642077 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.642055    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-02c498\"/\"auth-test-model-02c498-kserve-self-signed-certs\""
Jul 10 23:16:50.650644 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.650620    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"]
Jul 10 23:16:50.654113 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.654087    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-dshm\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.654236 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.654119    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-model-cache\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.654236 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.654203    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21c602b9-bda7-4e38-8caf-b8c9440c8976-tls-certs\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.654353 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.654239    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-tmp-dir\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.654353 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.654262    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqcmh\" (UniqueName: \"kubernetes.io/projected/21c602b9-bda7-4e38-8caf-b8c9440c8976-kube-api-access-vqcmh\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.654353 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.654320    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-home\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.755488 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.755449    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21c602b9-bda7-4e38-8caf-b8c9440c8976-tls-certs\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.755488 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.755491    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-tmp-dir\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.755737 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.755519    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqcmh\" (UniqueName: \"kubernetes.io/projected/21c602b9-bda7-4e38-8caf-b8c9440c8976-kube-api-access-vqcmh\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.755737 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.755553    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-home\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.755737 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.755585    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-dshm\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.755737 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.755599    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-model-cache\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.756004 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.755969    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-tmp-dir\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.756121 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.756021    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-model-cache\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.756121 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.756034    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-home\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.757962 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.757939    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-dshm\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.758162 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.758142    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21c602b9-bda7-4e38-8caf-b8c9440c8976-tls-certs\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.763447 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.763420    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqcmh\" (UniqueName: \"kubernetes.io/projected/21c602b9-bda7-4e38-8caf-b8c9440c8976-kube-api-access-vqcmh\") pod \"auth-test-model-02c498-kserve-7cf4bbc955-cnzxj\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") " pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:50.949257 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:50.949165    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:16:51.081116 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:51.081084    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"]
Jul 10 23:16:51.084175 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:16:51.084148    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21c602b9_bda7_4e38_8caf_b8c9440c8976.slice/crio-e350729a9d38e1e9469e46628a35505a042fe5ba0ebc024ec9aa789004ec9711 WatchSource:0}: Error finding container e350729a9d38e1e9469e46628a35505a042fe5ba0ebc024ec9aa789004ec9711: Status 404 returned error can't find the container with id e350729a9d38e1e9469e46628a35505a042fe5ba0ebc024ec9aa789004ec9711
Jul 10 23:16:51.825537 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:51.825503    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj" event={"ID":"21c602b9-bda7-4e38-8caf-b8c9440c8976","Type":"ContainerStarted","Data":"f7470792854caf356e7dac9eb78f4e4a30b7eb23da808a38b088c3baaaee622c"}
Jul 10 23:16:51.825537 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:51.825542    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj" event={"ID":"21c602b9-bda7-4e38-8caf-b8c9440c8976","Type":"ContainerStarted","Data":"e350729a9d38e1e9469e46628a35505a042fe5ba0ebc024ec9aa789004ec9711"}
Jul 10 23:16:51.842106 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:16:51.842052    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj" podStartSLOduration=1.84203385 podStartE2EDuration="1.84203385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:16:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:16:51.841437522 +0000 UTC m=+2031.534795815" watchObservedRunningTime="2026-07-10 23:16:51.84203385 +0000 UTC m=+2031.535392147"
Jul 10 23:17:00.949965 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:17:00.949933    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:17:00.950566 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:17:00.949979    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:17:00.962541 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:17:00.962518    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:17:01.881072 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:17:01.881040    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:18:00.870470 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:18:00.870439    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 23:18:00.875291 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:18:00.875261    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wmsn_858194fe-333d-433b-a093-ba6f5b9af0ee/ovn-acl-logging/0.log"
Jul 10 23:18:56.745381 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:18:56.745293    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"]
Jul 10 23:18:57.720201 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:18:57.720165    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"]
Jul 10 23:19:06.827716 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:06.827675    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"]
Jul 10 23:19:06.831169 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:06.831148    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:06.833712 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:06.833689    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6d6384\"/\"sub-test-model-6d6384-kserve-self-signed-certs\""
Jul 10 23:19:06.841566 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:06.841538    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"]
Jul 10 23:19:06.909002 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:06.908968    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-dshm\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:06.909002 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:06.909004    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-tls-certs\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:06.909201 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:06.909062    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zlp4\" (UniqueName: \"kubernetes.io/projected/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-kube-api-access-6zlp4\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:06.909201 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:06.909083    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-tmp-dir\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:06.909201 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:06.909147    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-home\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:06.909201 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:06.909190    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-model-cache\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.009755 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.009667    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-tls-certs\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.009755 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.009721    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zlp4\" (UniqueName: \"kubernetes.io/projected/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-kube-api-access-6zlp4\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.010044 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.009903    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-tmp-dir\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.010044 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.009949    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-home\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.010044 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.009976    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-model-cache\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.010191 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.010108    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-dshm\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.010289 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.010271    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-tmp-dir\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.010356 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.010334    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-home\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.010413 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.010392    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-model-cache\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.012134 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.012109    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-dshm\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.012306 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.012289    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-tls-certs\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.018199 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.018172    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zlp4\" (UniqueName: \"kubernetes.io/projected/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-kube-api-access-6zlp4\") pod \"sub-test-model-6d6384-kserve-bd68944fc-fmgj9\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") " pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.141238 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.141199    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:07.275902 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.275877    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"]
Jul 10 23:19:07.277665 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:19:07.277631    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9cc535c8_0ddb_43f3_89d9_be47b3a8c58d.slice/crio-9f3c5e59ea16bb4f009eff3fd948dc098146ff2fb70482ff84bb08c2d4e934f6 WatchSource:0}: Error finding container 9f3c5e59ea16bb4f009eff3fd948dc098146ff2fb70482ff84bb08c2d4e934f6: Status 404 returned error can't find the container with id 9f3c5e59ea16bb4f009eff3fd948dc098146ff2fb70482ff84bb08c2d4e934f6
Jul 10 23:19:07.446182 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.446143    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9" event={"ID":"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d","Type":"ContainerStarted","Data":"bb2314bc0995e92e8630c75ae1f089889cde6563dee9b6d73bf90e1ca8728f3b"}
Jul 10 23:19:07.446182 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.446191    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9" event={"ID":"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d","Type":"ContainerStarted","Data":"9f3c5e59ea16bb4f009eff3fd948dc098146ff2fb70482ff84bb08c2d4e934f6"}
Jul 10 23:19:07.465235 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:07.465175    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9" podStartSLOduration=1.465158183 podStartE2EDuration="1.465158183s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:19:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:19:07.46361729 +0000 UTC m=+2167.156975583" watchObservedRunningTime="2026-07-10 23:19:07.465158183 +0000 UTC m=+2167.158516515"
Jul 10 23:19:11.767417 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:11.767372    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs" podUID="75ce018b-b943-47b7-be86-e96828fca2de" containerName="main" containerID="cri-o://edb9392e8f8b79b6ce435dfc5618e4dfaaab40ed10293c1eb4d684a4aa667480" gracePeriod=45
Jul 10 23:19:12.032037 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.031966    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:19:12.055363 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.055336    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4jr8\" (UniqueName: \"kubernetes.io/projected/75ce018b-b943-47b7-be86-e96828fca2de-kube-api-access-s4jr8\") pod \"75ce018b-b943-47b7-be86-e96828fca2de\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") "
Jul 10 23:19:12.055538 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.055395    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-model-cache\") pod \"75ce018b-b943-47b7-be86-e96828fca2de\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") "
Jul 10 23:19:12.055538 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.055433    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-tmp-dir\") pod \"75ce018b-b943-47b7-be86-e96828fca2de\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") "
Jul 10 23:19:12.055538 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.055462    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-home\") pod \"75ce018b-b943-47b7-be86-e96828fca2de\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") "
Jul 10 23:19:12.055538 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.055522    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75ce018b-b943-47b7-be86-e96828fca2de-tls-certs\") pod \"75ce018b-b943-47b7-be86-e96828fca2de\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") "
Jul 10 23:19:12.055751 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.055564    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-dshm\") pod \"75ce018b-b943-47b7-be86-e96828fca2de\" (UID: \"75ce018b-b943-47b7-be86-e96828fca2de\") "
Jul 10 23:19:12.055751 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.055679    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-model-cache" (OuterVolumeSpecName: "model-cache") pod "75ce018b-b943-47b7-be86-e96828fca2de" (UID: "75ce018b-b943-47b7-be86-e96828fca2de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:19:12.055877 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.055748    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "75ce018b-b943-47b7-be86-e96828fca2de" (UID: "75ce018b-b943-47b7-be86-e96828fca2de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:19:12.055916 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.055898    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-model-cache\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:19:12.055916 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.055910    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-tmp-dir\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:19:12.056120 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.056095    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-home" (OuterVolumeSpecName: "home") pod "75ce018b-b943-47b7-be86-e96828fca2de" (UID: "75ce018b-b943-47b7-be86-e96828fca2de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:19:12.057749 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.057724    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-dshm" (OuterVolumeSpecName: "dshm") pod "75ce018b-b943-47b7-be86-e96828fca2de" (UID: "75ce018b-b943-47b7-be86-e96828fca2de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:19:12.057868 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.057824    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75ce018b-b943-47b7-be86-e96828fca2de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "75ce018b-b943-47b7-be86-e96828fca2de" (UID: "75ce018b-b943-47b7-be86-e96828fca2de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:19:12.057933 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.057909    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75ce018b-b943-47b7-be86-e96828fca2de-kube-api-access-s4jr8" (OuterVolumeSpecName: "kube-api-access-s4jr8") pod "75ce018b-b943-47b7-be86-e96828fca2de" (UID: "75ce018b-b943-47b7-be86-e96828fca2de"). InnerVolumeSpecName "kube-api-access-s4jr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:19:12.156914 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.156875    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4jr8\" (UniqueName: \"kubernetes.io/projected/75ce018b-b943-47b7-be86-e96828fca2de-kube-api-access-s4jr8\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:19:12.156914 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.156908    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-home\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:19:12.156914 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.156917    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75ce018b-b943-47b7-be86-e96828fca2de-tls-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:19:12.156914 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.156928    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75ce018b-b943-47b7-be86-e96828fca2de-dshm\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:19:12.469927 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.469882    2566 generic.go:356] "Generic (PLEG): container finished" podID="75ce018b-b943-47b7-be86-e96828fca2de" containerID="edb9392e8f8b79b6ce435dfc5618e4dfaaab40ed10293c1eb4d684a4aa667480" exitCode=0
Jul 10 23:19:12.470109 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.469934    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"
Jul 10 23:19:12.470109 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.469974    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs" event={"ID":"75ce018b-b943-47b7-be86-e96828fca2de","Type":"ContainerDied","Data":"edb9392e8f8b79b6ce435dfc5618e4dfaaab40ed10293c1eb4d684a4aa667480"}
Jul 10 23:19:12.470109 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.470019    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs" event={"ID":"75ce018b-b943-47b7-be86-e96828fca2de","Type":"ContainerDied","Data":"80c881ab0641a4e8d690bfb8df1074f3f813326174710df71f6058a6360b4db2"}
Jul 10 23:19:12.470109 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.470039    2566 scope.go:117] "RemoveContainer" containerID="edb9392e8f8b79b6ce435dfc5618e4dfaaab40ed10293c1eb4d684a4aa667480"
Jul 10 23:19:12.480803 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.480781    2566 scope.go:117] "RemoveContainer" containerID="edb9392e8f8b79b6ce435dfc5618e4dfaaab40ed10293c1eb4d684a4aa667480"
Jul 10 23:19:12.481315 ip-10-0-130-215 kubenswrapper[2566]: E0710 23:19:12.481290    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edb9392e8f8b79b6ce435dfc5618e4dfaaab40ed10293c1eb4d684a4aa667480\": container with ID starting with edb9392e8f8b79b6ce435dfc5618e4dfaaab40ed10293c1eb4d684a4aa667480 not found: ID does not exist" containerID="edb9392e8f8b79b6ce435dfc5618e4dfaaab40ed10293c1eb4d684a4aa667480"
Jul 10 23:19:12.481410 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.481324    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edb9392e8f8b79b6ce435dfc5618e4dfaaab40ed10293c1eb4d684a4aa667480"} err="failed to get container status \"edb9392e8f8b79b6ce435dfc5618e4dfaaab40ed10293c1eb4d684a4aa667480\": rpc error: code = NotFound desc = could not find container \"edb9392e8f8b79b6ce435dfc5618e4dfaaab40ed10293c1eb4d684a4aa667480\": container with ID starting with edb9392e8f8b79b6ce435dfc5618e4dfaaab40ed10293c1eb4d684a4aa667480 not found: ID does not exist"
Jul 10 23:19:12.494202 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.494173    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"]
Jul 10 23:19:12.498421 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.498392    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6d6384/auth-test-model-6d6384-kserve-6745f87787-nkncs"]
Jul 10 23:19:12.741629 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.741542    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj" podUID="21c602b9-bda7-4e38-8caf-b8c9440c8976" containerName="main" containerID="cri-o://f7470792854caf356e7dac9eb78f4e4a30b7eb23da808a38b088c3baaaee622c" gracePeriod=45
Jul 10 23:19:12.803690 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:12.803657    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75ce018b-b943-47b7-be86-e96828fca2de" path="/var/lib/kubelet/pods/75ce018b-b943-47b7-be86-e96828fca2de/volumes"
Jul 10 23:19:13.000161 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.000088    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:19:13.064563 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.064530    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-tmp-dir\") pod \"21c602b9-bda7-4e38-8caf-b8c9440c8976\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") "
Jul 10 23:19:13.064563 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.064570    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-dshm\") pod \"21c602b9-bda7-4e38-8caf-b8c9440c8976\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") "
Jul 10 23:19:13.064848 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.064591    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqcmh\" (UniqueName: \"kubernetes.io/projected/21c602b9-bda7-4e38-8caf-b8c9440c8976-kube-api-access-vqcmh\") pod \"21c602b9-bda7-4e38-8caf-b8c9440c8976\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") "
Jul 10 23:19:13.064848 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.064640    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-model-cache\") pod \"21c602b9-bda7-4e38-8caf-b8c9440c8976\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") "
Jul 10 23:19:13.064848 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.064670    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21c602b9-bda7-4e38-8caf-b8c9440c8976-tls-certs\") pod \"21c602b9-bda7-4e38-8caf-b8c9440c8976\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") "
Jul 10 23:19:13.064848 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.064711    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-home\") pod \"21c602b9-bda7-4e38-8caf-b8c9440c8976\" (UID: \"21c602b9-bda7-4e38-8caf-b8c9440c8976\") "
Jul 10 23:19:13.065048 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.064911    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "21c602b9-bda7-4e38-8caf-b8c9440c8976" (UID: "21c602b9-bda7-4e38-8caf-b8c9440c8976"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:19:13.065048 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.065013    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-model-cache" (OuterVolumeSpecName: "model-cache") pod "21c602b9-bda7-4e38-8caf-b8c9440c8976" (UID: "21c602b9-bda7-4e38-8caf-b8c9440c8976"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:19:13.065048 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.065032    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-home" (OuterVolumeSpecName: "home") pod "21c602b9-bda7-4e38-8caf-b8c9440c8976" (UID: "21c602b9-bda7-4e38-8caf-b8c9440c8976"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:19:13.065173 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.065039    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-tmp-dir\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:19:13.067064 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.067037    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-dshm" (OuterVolumeSpecName: "dshm") pod "21c602b9-bda7-4e38-8caf-b8c9440c8976" (UID: "21c602b9-bda7-4e38-8caf-b8c9440c8976"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:19:13.067064 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.067046    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21c602b9-bda7-4e38-8caf-b8c9440c8976-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "21c602b9-bda7-4e38-8caf-b8c9440c8976" (UID: "21c602b9-bda7-4e38-8caf-b8c9440c8976"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:19:13.067257 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.067123    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c602b9-bda7-4e38-8caf-b8c9440c8976-kube-api-access-vqcmh" (OuterVolumeSpecName: "kube-api-access-vqcmh") pod "21c602b9-bda7-4e38-8caf-b8c9440c8976" (UID: "21c602b9-bda7-4e38-8caf-b8c9440c8976"). InnerVolumeSpecName "kube-api-access-vqcmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:19:13.165912 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.165874    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21c602b9-bda7-4e38-8caf-b8c9440c8976-tls-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:19:13.165912 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.165905    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-home\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:19:13.165912 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.165914    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-dshm\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:19:13.165912 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.165923    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqcmh\" (UniqueName: \"kubernetes.io/projected/21c602b9-bda7-4e38-8caf-b8c9440c8976-kube-api-access-vqcmh\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:19:13.166181 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.165933    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21c602b9-bda7-4e38-8caf-b8c9440c8976-model-cache\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:19:13.476055 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.476018    2566 generic.go:356] "Generic (PLEG): container finished" podID="21c602b9-bda7-4e38-8caf-b8c9440c8976" containerID="f7470792854caf356e7dac9eb78f4e4a30b7eb23da808a38b088c3baaaee622c" exitCode=0
Jul 10 23:19:13.476262 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.476066    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"
Jul 10 23:19:13.476262 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.476110    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj" event={"ID":"21c602b9-bda7-4e38-8caf-b8c9440c8976","Type":"ContainerDied","Data":"f7470792854caf356e7dac9eb78f4e4a30b7eb23da808a38b088c3baaaee622c"}
Jul 10 23:19:13.476262 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.476157    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj" event={"ID":"21c602b9-bda7-4e38-8caf-b8c9440c8976","Type":"ContainerDied","Data":"e350729a9d38e1e9469e46628a35505a042fe5ba0ebc024ec9aa789004ec9711"}
Jul 10 23:19:13.476262 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.476180    2566 scope.go:117] "RemoveContainer" containerID="f7470792854caf356e7dac9eb78f4e4a30b7eb23da808a38b088c3baaaee622c"
Jul 10 23:19:13.485482 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.485465    2566 scope.go:117] "RemoveContainer" containerID="f7470792854caf356e7dac9eb78f4e4a30b7eb23da808a38b088c3baaaee622c"
Jul 10 23:19:13.485812 ip-10-0-130-215 kubenswrapper[2566]: E0710 23:19:13.485782    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7470792854caf356e7dac9eb78f4e4a30b7eb23da808a38b088c3baaaee622c\": container with ID starting with f7470792854caf356e7dac9eb78f4e4a30b7eb23da808a38b088c3baaaee622c not found: ID does not exist" containerID="f7470792854caf356e7dac9eb78f4e4a30b7eb23da808a38b088c3baaaee622c"
Jul 10 23:19:13.485867 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.485822    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7470792854caf356e7dac9eb78f4e4a30b7eb23da808a38b088c3baaaee622c"} err="failed to get container status \"f7470792854caf356e7dac9eb78f4e4a30b7eb23da808a38b088c3baaaee622c\": rpc error: code = NotFound desc = could not find container \"f7470792854caf356e7dac9eb78f4e4a30b7eb23da808a38b088c3baaaee622c\": container with ID starting with f7470792854caf356e7dac9eb78f4e4a30b7eb23da808a38b088c3baaaee622c not found: ID does not exist"
Jul 10 23:19:13.497495 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.497459    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"]
Jul 10 23:19:13.503468 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:13.503441    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/auth-test-model-02c498-kserve-7cf4bbc955-cnzxj"]
Jul 10 23:19:14.802959 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:14.802913    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21c602b9-bda7-4e38-8caf-b8c9440c8976" path="/var/lib/kubelet/pods/21c602b9-bda7-4e38-8caf-b8c9440c8976/volumes"
Jul 10 23:19:17.142233 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:17.142192    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:17.142651 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:17.142271    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:17.155011 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:17.154979    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:17.508999 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:17.508906    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:19:28.029214 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.029176    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"]
Jul 10 23:19:28.029732 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.029566    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75ce018b-b943-47b7-be86-e96828fca2de" containerName="main"
Jul 10 23:19:28.029732 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.029583    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="75ce018b-b943-47b7-be86-e96828fca2de" containerName="main"
Jul 10 23:19:28.029732 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.029594    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c602b9-bda7-4e38-8caf-b8c9440c8976" containerName="main"
Jul 10 23:19:28.029732 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.029602    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c602b9-bda7-4e38-8caf-b8c9440c8976" containerName="main"
Jul 10 23:19:28.029732 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.029659    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="21c602b9-bda7-4e38-8caf-b8c9440c8976" containerName="main"
Jul 10 23:19:28.029732 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.029670    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="75ce018b-b943-47b7-be86-e96828fca2de" containerName="main"
Jul 10 23:19:28.033942 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.033921    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.036591 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.036564    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-02c498\"/\"openshift-service-ca.crt\""
Jul 10 23:19:28.037958 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.037726    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-02c498\"/\"default-dockercfg-cdn8s\""
Jul 10 23:19:28.037958 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.037752    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-02c498\"/\"kube-root-ca.crt\""
Jul 10 23:19:28.037958 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.037828    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-02c498\"/\"sub-test-model-02c498-kserve-self-signed-certs\""
Jul 10 23:19:28.041030 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.041006    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"]
Jul 10 23:19:28.089965 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.089929    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-model-cache\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.090193 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.089984    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-dshm\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.090193 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.090018    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-tmp-dir\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.090193 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.090070    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1389b835-c4e8-4c59-bfa1-7044ce05d062-tls-certs\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.090193 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.090098    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-home\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.090193 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.090144    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z5ft\" (UniqueName: \"kubernetes.io/projected/1389b835-c4e8-4c59-bfa1-7044ce05d062-kube-api-access-4z5ft\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.191113 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.191069    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-dshm\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.191305 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.191125    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-tmp-dir\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.191305 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.191162    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1389b835-c4e8-4c59-bfa1-7044ce05d062-tls-certs\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.191305 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.191189    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-home\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.191305 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.191248    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z5ft\" (UniqueName: \"kubernetes.io/projected/1389b835-c4e8-4c59-bfa1-7044ce05d062-kube-api-access-4z5ft\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.191509 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.191312    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-model-cache\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.191654 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.191626    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-tmp-dir\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.191719 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.191676    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-home\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.191719 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.191684    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-model-cache\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.193521 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.193492    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-dshm\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.193821 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.193797    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1389b835-c4e8-4c59-bfa1-7044ce05d062-tls-certs\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.199375 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.199351    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z5ft\" (UniqueName: \"kubernetes.io/projected/1389b835-c4e8-4c59-bfa1-7044ce05d062-kube-api-access-4z5ft\") pod \"sub-test-model-02c498-kserve-76858878bc-4g8sn\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") " pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.344876 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.344845    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:28.486168 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.486132    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"]
Jul 10 23:19:28.489168 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:19:28.489132    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1389b835_c4e8_4c59_bfa1_7044ce05d062.slice/crio-3e18e905c72fe4925986350757b9c2510e4fcba2a867575284793b96d2668283 WatchSource:0}: Error finding container 3e18e905c72fe4925986350757b9c2510e4fcba2a867575284793b96d2668283: Status 404 returned error can't find the container with id 3e18e905c72fe4925986350757b9c2510e4fcba2a867575284793b96d2668283
Jul 10 23:19:28.551459 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.551428    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn" event={"ID":"1389b835-c4e8-4c59-bfa1-7044ce05d062","Type":"ContainerStarted","Data":"1be499a67a4476b0e1325124407afa9a2377f1c94fce436dbba10d4dc8d948a9"}
Jul 10 23:19:28.551597 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:28.551472    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn" event={"ID":"1389b835-c4e8-4c59-bfa1-7044ce05d062","Type":"ContainerStarted","Data":"3e18e905c72fe4925986350757b9c2510e4fcba2a867575284793b96d2668283"}
Jul 10 23:19:29.574188 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:29.574134    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn" podStartSLOduration=1.574118556 podStartE2EDuration="1.574118556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:19:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:19:29.57324049 +0000 UTC m=+2189.266598758" watchObservedRunningTime="2026-07-10 23:19:29.574118556 +0000 UTC m=+2189.267476830"
Jul 10 23:19:38.345274 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:38.345232    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:38.345705 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:38.345314    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:38.357603 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:38.357571    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:19:38.615281 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:19:38.615199    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:20:04.760984 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:04.760945    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"]
Jul 10 23:20:05.714139 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:05.714105    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"]
Jul 10 23:20:19.780706 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:19.780660    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9" podUID="9cc535c8-0ddb-43f3-89d9-be47b3a8c58d" containerName="main" containerID="cri-o://bb2314bc0995e92e8630c75ae1f089889cde6563dee9b6d73bf90e1ca8728f3b" gracePeriod=45
Jul 10 23:20:20.037179 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.037109    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:20:20.174593 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.174549    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zlp4\" (UniqueName: \"kubernetes.io/projected/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-kube-api-access-6zlp4\") pod \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") "
Jul 10 23:20:20.174822 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.174605    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-model-cache\") pod \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") "
Jul 10 23:20:20.174822 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.174637    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-tmp-dir\") pod \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") "
Jul 10 23:20:20.174822 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.174676    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-dshm\") pod \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") "
Jul 10 23:20:20.174822 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.174724    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-home\") pod \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") "
Jul 10 23:20:20.174822 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.174789    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-tls-certs\") pod \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\" (UID: \"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d\") "
Jul 10 23:20:20.175088 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.174977    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-model-cache" (OuterVolumeSpecName: "model-cache") pod "9cc535c8-0ddb-43f3-89d9-be47b3a8c58d" (UID: "9cc535c8-0ddb-43f3-89d9-be47b3a8c58d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:20:20.175088 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.175012    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9cc535c8-0ddb-43f3-89d9-be47b3a8c58d" (UID: "9cc535c8-0ddb-43f3-89d9-be47b3a8c58d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:20:20.175088 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.175052    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-home" (OuterVolumeSpecName: "home") pod "9cc535c8-0ddb-43f3-89d9-be47b3a8c58d" (UID: "9cc535c8-0ddb-43f3-89d9-be47b3a8c58d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:20:20.175210 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.175096    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-model-cache\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:20:20.175210 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.175114    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-tmp-dir\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:20:20.176961 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.176932    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-dshm" (OuterVolumeSpecName: "dshm") pod "9cc535c8-0ddb-43f3-89d9-be47b3a8c58d" (UID: "9cc535c8-0ddb-43f3-89d9-be47b3a8c58d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:20:20.177072 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.176933    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9cc535c8-0ddb-43f3-89d9-be47b3a8c58d" (UID: "9cc535c8-0ddb-43f3-89d9-be47b3a8c58d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:20:20.177072 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.177016    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-kube-api-access-6zlp4" (OuterVolumeSpecName: "kube-api-access-6zlp4") pod "9cc535c8-0ddb-43f3-89d9-be47b3a8c58d" (UID: "9cc535c8-0ddb-43f3-89d9-be47b3a8c58d"). InnerVolumeSpecName "kube-api-access-6zlp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:20:20.275987 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.275949    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-dshm\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:20:20.275987 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.275981    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-home\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:20:20.275987 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.275990    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-tls-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:20:20.275987 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.275999    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zlp4\" (UniqueName: \"kubernetes.io/projected/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d-kube-api-access-6zlp4\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:20:20.735812 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.735752    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn" podUID="1389b835-c4e8-4c59-bfa1-7044ce05d062" containerName="main" containerID="cri-o://1be499a67a4476b0e1325124407afa9a2377f1c94fce436dbba10d4dc8d948a9" gracePeriod=45
Jul 10 23:20:20.794823 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.794789    2566 generic.go:356] "Generic (PLEG): container finished" podID="9cc535c8-0ddb-43f3-89d9-be47b3a8c58d" containerID="bb2314bc0995e92e8630c75ae1f089889cde6563dee9b6d73bf90e1ca8728f3b" exitCode=0
Jul 10 23:20:20.795123 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.794845    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"
Jul 10 23:20:20.795123 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.794875    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9" event={"ID":"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d","Type":"ContainerDied","Data":"bb2314bc0995e92e8630c75ae1f089889cde6563dee9b6d73bf90e1ca8728f3b"}
Jul 10 23:20:20.795123 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.794923    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9" event={"ID":"9cc535c8-0ddb-43f3-89d9-be47b3a8c58d","Type":"ContainerDied","Data":"9f3c5e59ea16bb4f009eff3fd948dc098146ff2fb70482ff84bb08c2d4e934f6"}
Jul 10 23:20:20.795123 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.794945    2566 scope.go:117] "RemoveContainer" containerID="bb2314bc0995e92e8630c75ae1f089889cde6563dee9b6d73bf90e1ca8728f3b"
Jul 10 23:20:20.815445 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.815406    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"]
Jul 10 23:20:20.819094 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.819063    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6d6384/sub-test-model-6d6384-kserve-bd68944fc-fmgj9"]
Jul 10 23:20:20.846722 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.846700    2566 scope.go:117] "RemoveContainer" containerID="bb2314bc0995e92e8630c75ae1f089889cde6563dee9b6d73bf90e1ca8728f3b"
Jul 10 23:20:20.847088 ip-10-0-130-215 kubenswrapper[2566]: E0710 23:20:20.847068    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb2314bc0995e92e8630c75ae1f089889cde6563dee9b6d73bf90e1ca8728f3b\": container with ID starting with bb2314bc0995e92e8630c75ae1f089889cde6563dee9b6d73bf90e1ca8728f3b not found: ID does not exist" containerID="bb2314bc0995e92e8630c75ae1f089889cde6563dee9b6d73bf90e1ca8728f3b"
Jul 10 23:20:20.847147 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.847099    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb2314bc0995e92e8630c75ae1f089889cde6563dee9b6d73bf90e1ca8728f3b"} err="failed to get container status \"bb2314bc0995e92e8630c75ae1f089889cde6563dee9b6d73bf90e1ca8728f3b\": rpc error: code = NotFound desc = could not find container \"bb2314bc0995e92e8630c75ae1f089889cde6563dee9b6d73bf90e1ca8728f3b\": container with ID starting with bb2314bc0995e92e8630c75ae1f089889cde6563dee9b6d73bf90e1ca8728f3b not found: ID does not exist"
Jul 10 23:20:20.988409 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:20.988345    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:20:21.082793 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.082741    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1389b835-c4e8-4c59-bfa1-7044ce05d062-tls-certs\") pod \"1389b835-c4e8-4c59-bfa1-7044ce05d062\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") "
Jul 10 23:20:21.082960 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.082819    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-model-cache\") pod \"1389b835-c4e8-4c59-bfa1-7044ce05d062\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") "
Jul 10 23:20:21.082960 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.082871    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-dshm\") pod \"1389b835-c4e8-4c59-bfa1-7044ce05d062\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") "
Jul 10 23:20:21.082960 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.082891    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-home\") pod \"1389b835-c4e8-4c59-bfa1-7044ce05d062\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") "
Jul 10 23:20:21.082960 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.082920    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z5ft\" (UniqueName: \"kubernetes.io/projected/1389b835-c4e8-4c59-bfa1-7044ce05d062-kube-api-access-4z5ft\") pod \"1389b835-c4e8-4c59-bfa1-7044ce05d062\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") "
Jul 10 23:20:21.083127 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.082979    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-tmp-dir\") pod \"1389b835-c4e8-4c59-bfa1-7044ce05d062\" (UID: \"1389b835-c4e8-4c59-bfa1-7044ce05d062\") "
Jul 10 23:20:21.083127 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.083108    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-model-cache" (OuterVolumeSpecName: "model-cache") pod "1389b835-c4e8-4c59-bfa1-7044ce05d062" (UID: "1389b835-c4e8-4c59-bfa1-7044ce05d062"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:20:21.083239 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.083152    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-home" (OuterVolumeSpecName: "home") pod "1389b835-c4e8-4c59-bfa1-7044ce05d062" (UID: "1389b835-c4e8-4c59-bfa1-7044ce05d062"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:20:21.083336 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.083312    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1389b835-c4e8-4c59-bfa1-7044ce05d062" (UID: "1389b835-c4e8-4c59-bfa1-7044ce05d062"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:20:21.083397 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.083318    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-model-cache\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:20:21.083397 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.083368    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-home\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:20:21.084962 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.084938    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-dshm" (OuterVolumeSpecName: "dshm") pod "1389b835-c4e8-4c59-bfa1-7044ce05d062" (UID: "1389b835-c4e8-4c59-bfa1-7044ce05d062"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:20:21.085070 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.084974    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1389b835-c4e8-4c59-bfa1-7044ce05d062-kube-api-access-4z5ft" (OuterVolumeSpecName: "kube-api-access-4z5ft") pod "1389b835-c4e8-4c59-bfa1-7044ce05d062" (UID: "1389b835-c4e8-4c59-bfa1-7044ce05d062"). InnerVolumeSpecName "kube-api-access-4z5ft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:20:21.085070 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.085048    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1389b835-c4e8-4c59-bfa1-7044ce05d062-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1389b835-c4e8-4c59-bfa1-7044ce05d062" (UID: "1389b835-c4e8-4c59-bfa1-7044ce05d062"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:20:21.184107 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.184073    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-dshm\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:20:21.184107 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.184100    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z5ft\" (UniqueName: \"kubernetes.io/projected/1389b835-c4e8-4c59-bfa1-7044ce05d062-kube-api-access-4z5ft\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:20:21.184107 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.184110    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1389b835-c4e8-4c59-bfa1-7044ce05d062-tmp-dir\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:20:21.184337 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.184120    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1389b835-c4e8-4c59-bfa1-7044ce05d062-tls-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:20:21.801090 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.801052    2566 generic.go:356] "Generic (PLEG): container finished" podID="1389b835-c4e8-4c59-bfa1-7044ce05d062" containerID="1be499a67a4476b0e1325124407afa9a2377f1c94fce436dbba10d4dc8d948a9" exitCode=0
Jul 10 23:20:21.801494 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.801097    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"
Jul 10 23:20:21.801494 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.801137    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn" event={"ID":"1389b835-c4e8-4c59-bfa1-7044ce05d062","Type":"ContainerDied","Data":"1be499a67a4476b0e1325124407afa9a2377f1c94fce436dbba10d4dc8d948a9"}
Jul 10 23:20:21.801494 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.801173    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn" event={"ID":"1389b835-c4e8-4c59-bfa1-7044ce05d062","Type":"ContainerDied","Data":"3e18e905c72fe4925986350757b9c2510e4fcba2a867575284793b96d2668283"}
Jul 10 23:20:21.801494 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.801190    2566 scope.go:117] "RemoveContainer" containerID="1be499a67a4476b0e1325124407afa9a2377f1c94fce436dbba10d4dc8d948a9"
Jul 10 23:20:21.810299 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.810281    2566 scope.go:117] "RemoveContainer" containerID="1be499a67a4476b0e1325124407afa9a2377f1c94fce436dbba10d4dc8d948a9"
Jul 10 23:20:21.810579 ip-10-0-130-215 kubenswrapper[2566]: E0710 23:20:21.810558    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1be499a67a4476b0e1325124407afa9a2377f1c94fce436dbba10d4dc8d948a9\": container with ID starting with 1be499a67a4476b0e1325124407afa9a2377f1c94fce436dbba10d4dc8d948a9 not found: ID does not exist" containerID="1be499a67a4476b0e1325124407afa9a2377f1c94fce436dbba10d4dc8d948a9"
Jul 10 23:20:21.810638 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.810587    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1be499a67a4476b0e1325124407afa9a2377f1c94fce436dbba10d4dc8d948a9"} err="failed to get container status \"1be499a67a4476b0e1325124407afa9a2377f1c94fce436dbba10d4dc8d948a9\": rpc error: code = NotFound desc = could not find container \"1be499a67a4476b0e1325124407afa9a2377f1c94fce436dbba10d4dc8d948a9\": container with ID starting with 1be499a67a4476b0e1325124407afa9a2377f1c94fce436dbba10d4dc8d948a9 not found: ID does not exist"
Jul 10 23:20:21.821813 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.821744    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"]
Jul 10 23:20:21.825259 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:21.825234    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/sub-test-model-02c498-kserve-76858878bc-4g8sn"]
Jul 10 23:20:22.804414 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:22.804325    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1389b835-c4e8-4c59-bfa1-7044ce05d062" path="/var/lib/kubelet/pods/1389b835-c4e8-4c59-bfa1-7044ce05d062/volumes"
Jul 10 23:20:22.804920 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:22.804900    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cc535c8-0ddb-43f3-89d9-be47b3a8c58d" path="/var/lib/kubelet/pods/9cc535c8-0ddb-43f3-89d9-be47b3a8c58d/volumes"
Jul 10 23:20:39.937705 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:39.937670    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"]
Jul 10 23:20:39.938236 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:39.938039    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1389b835-c4e8-4c59-bfa1-7044ce05d062" containerName="main"
Jul 10 23:20:39.938236 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:39.938052    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1389b835-c4e8-4c59-bfa1-7044ce05d062" containerName="main"
Jul 10 23:20:39.938236 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:39.938066    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc535c8-0ddb-43f3-89d9-be47b3a8c58d" containerName="main"
Jul 10 23:20:39.938236 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:39.938072    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc535c8-0ddb-43f3-89d9-be47b3a8c58d" containerName="main"
Jul 10 23:20:39.938236 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:39.938128    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc535c8-0ddb-43f3-89d9-be47b3a8c58d" containerName="main"
Jul 10 23:20:39.938236 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:39.938136    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1389b835-c4e8-4c59-bfa1-7044ce05d062" containerName="main"
Jul 10 23:20:39.940932 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:39.940915    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:39.943425 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:39.943403    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-02c498\"/\"openshift-service-ca.crt\""
Jul 10 23:20:39.944304 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:39.944283    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-02c498\"/\"default-dockercfg-cdn8s\""
Jul 10 23:20:39.944371 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:39.944333    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-02c498\"/\"kube-root-ca.crt\""
Jul 10 23:20:39.944371 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:39.944344    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-02c498\"/\"rate-test-model-02c498-kserve-self-signed-certs\""
Jul 10 23:20:39.949127 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:39.949096    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"]
Jul 10 23:20:40.055515 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.055473    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjjtz\" (UniqueName: \"kubernetes.io/projected/a78f6223-24ea-4a57-a4af-3bbe0e780905-kube-api-access-cjjtz\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.055515 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.055521    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a78f6223-24ea-4a57-a4af-3bbe0e780905-tls-certs\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.055814 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.055546    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-home\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.055814 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.055561    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-tmp-dir\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.055814 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.055671    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-model-cache\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.055814 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.055793    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-dshm\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.156781 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.156734    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-model-cache\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.156967 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.156849    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-dshm\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.156967 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.156880    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjjtz\" (UniqueName: \"kubernetes.io/projected/a78f6223-24ea-4a57-a4af-3bbe0e780905-kube-api-access-cjjtz\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.156967 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.156903    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a78f6223-24ea-4a57-a4af-3bbe0e780905-tls-certs\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.156967 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.156926    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-home\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.156967 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.156941    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-tmp-dir\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.157247 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.157224    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-model-cache\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.157350 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.157279    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-tmp-dir\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.157350 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.157309    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-home\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.159191 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.159172    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-dshm\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.159433 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.159416    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a78f6223-24ea-4a57-a4af-3bbe0e780905-tls-certs\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.165224 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.165192    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjjtz\" (UniqueName: \"kubernetes.io/projected/a78f6223-24ea-4a57-a4af-3bbe0e780905-kube-api-access-cjjtz\") pod \"rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") " pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.251270 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.251163    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:40.388885 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.388858    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"]
Jul 10 23:20:40.391604 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:20:40.391576    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda78f6223_24ea_4a57_a4af_3bbe0e780905.slice/crio-5c934570446781ab6c4159e190353876b0686e7cd498693e4ddde90a5aa616b0 WatchSource:0}: Error finding container 5c934570446781ab6c4159e190353876b0686e7cd498693e4ddde90a5aa616b0: Status 404 returned error can't find the container with id 5c934570446781ab6c4159e190353876b0686e7cd498693e4ddde90a5aa616b0
Jul 10 23:20:40.885240 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.885196    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl" event={"ID":"a78f6223-24ea-4a57-a4af-3bbe0e780905","Type":"ContainerStarted","Data":"8f07d3903cdbb01722623ba61e358965fa223aadd7b4c6532d5226a18dc59564"}
Jul 10 23:20:40.885424 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.885249    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl" event={"ID":"a78f6223-24ea-4a57-a4af-3bbe0e780905","Type":"ContainerStarted","Data":"5c934570446781ab6c4159e190353876b0686e7cd498693e4ddde90a5aa616b0"}
Jul 10 23:20:40.903063 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:40.903007    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl" podStartSLOduration=1.902987789 podStartE2EDuration="1.902987789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:20:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:20:40.901796462 +0000 UTC m=+2260.595154714" watchObservedRunningTime="2026-07-10 23:20:40.902987789 +0000 UTC m=+2260.596346065"
Jul 10 23:20:50.251389 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:50.251345    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:50.251886 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:50.251409    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:50.269613 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:50.269586    2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:20:50.940280 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:20:50.940251    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:21:24.806890 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:24.806854    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"]
Jul 10 23:21:25.739967 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:25.739936    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7481-140151784508080"]
Jul 10 23:21:25.743393 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:25.743374    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151784508080"
Jul 10 23:21:25.745890 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:25.745873    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-9xhqs\""
Jul 10 23:21:25.749562 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:25.749540    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7481-140151784508080"]
Jul 10 23:21:25.872831 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:25.872788    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sgr4\" (UniqueName: \"kubernetes.io/projected/e0d789ec-98c4-4466-ad46-3074861d205f-kube-api-access-5sgr4\") pod \"test-curl-7481-140151784508080\" (UID: \"e0d789ec-98c4-4466-ad46-3074861d205f\") " pod="openshift-ingress/test-curl-7481-140151784508080"
Jul 10 23:21:25.973782 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:25.973730    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sgr4\" (UniqueName: \"kubernetes.io/projected/e0d789ec-98c4-4466-ad46-3074861d205f-kube-api-access-5sgr4\") pod \"test-curl-7481-140151784508080\" (UID: \"e0d789ec-98c4-4466-ad46-3074861d205f\") " pod="openshift-ingress/test-curl-7481-140151784508080"
Jul 10 23:21:25.982081 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:25.982048    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sgr4\" (UniqueName: \"kubernetes.io/projected/e0d789ec-98c4-4466-ad46-3074861d205f-kube-api-access-5sgr4\") pod \"test-curl-7481-140151784508080\" (UID: \"e0d789ec-98c4-4466-ad46-3074861d205f\") " pod="openshift-ingress/test-curl-7481-140151784508080"
Jul 10 23:21:26.052530 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:26.052437    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151784508080"
Jul 10 23:21:26.182991 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:26.182964    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7481-140151784508080"]
Jul 10 23:21:26.186317 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:21:26.186288    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0d789ec_98c4_4466_ad46_3074861d205f.slice/crio-cbcb93f4188083eb4b63a70ae006c146b99e22c100de09c92c68369b7ec9a45b WatchSource:0}: Error finding container cbcb93f4188083eb4b63a70ae006c146b99e22c100de09c92c68369b7ec9a45b: Status 404 returned error can't find the container with id cbcb93f4188083eb4b63a70ae006c146b99e22c100de09c92c68369b7ec9a45b
Jul 10 23:21:26.187550 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:26.187535    2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 23:21:27.098505 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:27.098464    2566 generic.go:356] "Generic (PLEG): container finished" podID="e0d789ec-98c4-4466-ad46-3074861d205f" containerID="ba3a0a8f36c4179cba64721b4da24e3f6b3ef681e1bf91ce8e758cd37eb83841" exitCode=0
Jul 10 23:21:27.098915 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:27.098523    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7481-140151784508080" event={"ID":"e0d789ec-98c4-4466-ad46-3074861d205f","Type":"ContainerDied","Data":"ba3a0a8f36c4179cba64721b4da24e3f6b3ef681e1bf91ce8e758cd37eb83841"}
Jul 10 23:21:27.098915 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:27.098567    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7481-140151784508080" event={"ID":"e0d789ec-98c4-4466-ad46-3074861d205f","Type":"ContainerStarted","Data":"cbcb93f4188083eb4b63a70ae006c146b99e22c100de09c92c68369b7ec9a45b"}
Jul 10 23:21:28.241883 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.241860    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151784508080"
Jul 10 23:21:28.280873 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.280844    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7481-140151784508080_e0d789ec-98c4-4466-ad46-3074861d205f/test-curl-7481-140151784508080/0.log"
Jul 10 23:21:28.295077 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.295037    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sgr4\" (UniqueName: \"kubernetes.io/projected/e0d789ec-98c4-4466-ad46-3074861d205f-kube-api-access-5sgr4\") pod \"e0d789ec-98c4-4466-ad46-3074861d205f\" (UID: \"e0d789ec-98c4-4466-ad46-3074861d205f\") "
Jul 10 23:21:28.297241 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.297214    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d789ec-98c4-4466-ad46-3074861d205f-kube-api-access-5sgr4" (OuterVolumeSpecName: "kube-api-access-5sgr4") pod "e0d789ec-98c4-4466-ad46-3074861d205f" (UID: "e0d789ec-98c4-4466-ad46-3074861d205f"). InnerVolumeSpecName "kube-api-access-5sgr4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:21:28.302904 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.302883    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7481-140151784508080"]
Jul 10 23:21:28.305661 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.305636    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7481-140151784508080"]
Jul 10 23:21:28.396051 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.395963    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sgr4\" (UniqueName: \"kubernetes.io/projected/e0d789ec-98c4-4466-ad46-3074861d205f-kube-api-access-5sgr4\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:21:28.420374 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.420334    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7481-140151784507184"]
Jul 10 23:21:28.420749 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.420731    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d789ec-98c4-4466-ad46-3074861d205f" containerName="test-curl-7481-140151784508080"
Jul 10 23:21:28.420875 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.420751    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d789ec-98c4-4466-ad46-3074861d205f" containerName="test-curl-7481-140151784508080"
Jul 10 23:21:28.420937 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.420884    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d789ec-98c4-4466-ad46-3074861d205f" containerName="test-curl-7481-140151784508080"
Jul 10 23:21:28.423831 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.423810    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151784507184"
Jul 10 23:21:28.430897 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.430867    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7481-140151784507184"]
Jul 10 23:21:28.496424 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.496386    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8966\" (UniqueName: \"kubernetes.io/projected/4d8ecc56-7eff-4218-9908-b3685408ce5c-kube-api-access-z8966\") pod \"test-curl-7481-140151784507184\" (UID: \"4d8ecc56-7eff-4218-9908-b3685408ce5c\") " pod="openshift-ingress/test-curl-7481-140151784507184"
Jul 10 23:21:28.596976 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.596932    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8966\" (UniqueName: \"kubernetes.io/projected/4d8ecc56-7eff-4218-9908-b3685408ce5c-kube-api-access-z8966\") pod \"test-curl-7481-140151784507184\" (UID: \"4d8ecc56-7eff-4218-9908-b3685408ce5c\") " pod="openshift-ingress/test-curl-7481-140151784507184"
Jul 10 23:21:28.605052 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.605019    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8966\" (UniqueName: \"kubernetes.io/projected/4d8ecc56-7eff-4218-9908-b3685408ce5c-kube-api-access-z8966\") pod \"test-curl-7481-140151784507184\" (UID: \"4d8ecc56-7eff-4218-9908-b3685408ce5c\") " pod="openshift-ingress/test-curl-7481-140151784507184"
Jul 10 23:21:28.734615 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.734517    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151784507184"
Jul 10 23:21:28.805131 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.805099    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0d789ec-98c4-4466-ad46-3074861d205f" path="/var/lib/kubelet/pods/e0d789ec-98c4-4466-ad46-3074861d205f/volumes"
Jul 10 23:21:28.840387 ip-10-0-130-215 kubenswrapper[2566]: E0710 23:21:28.840350    2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0d789ec_98c4_4466_ad46_3074861d205f.slice\": RecentStats: unable to find data in memory cache]"
Jul 10 23:21:28.867099 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:28.867073    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7481-140151784507184"]
Jul 10 23:21:28.869641 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:21:28.869615    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d8ecc56_7eff_4218_9908_b3685408ce5c.slice/crio-86353c639c7f842a9c429cb9fde6f5366951d75bff296d32b3f83992a95e4f2e WatchSource:0}: Error finding container 86353c639c7f842a9c429cb9fde6f5366951d75bff296d32b3f83992a95e4f2e: Status 404 returned error can't find the container with id 86353c639c7f842a9c429cb9fde6f5366951d75bff296d32b3f83992a95e4f2e
Jul 10 23:21:29.108531 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:29.108507    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151784508080"
Jul 10 23:21:29.108531 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:29.108524    2566 scope.go:117] "RemoveContainer" containerID="ba3a0a8f36c4179cba64721b4da24e3f6b3ef681e1bf91ce8e758cd37eb83841"
Jul 10 23:21:29.109778 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:29.109720    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7481-140151784507184" event={"ID":"4d8ecc56-7eff-4218-9908-b3685408ce5c","Type":"ContainerStarted","Data":"86353c639c7f842a9c429cb9fde6f5366951d75bff296d32b3f83992a95e4f2e"}
Jul 10 23:21:30.117006 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:30.116977    2566 generic.go:356] "Generic (PLEG): container finished" podID="4d8ecc56-7eff-4218-9908-b3685408ce5c" containerID="d3d930065f1241bbe11e1abd981d985a016b7096a970ff9124c666a3c98aa04d" exitCode=0
Jul 10 23:21:30.117418 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:30.117029    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7481-140151784507184" event={"ID":"4d8ecc56-7eff-4218-9908-b3685408ce5c","Type":"ContainerDied","Data":"d3d930065f1241bbe11e1abd981d985a016b7096a970ff9124c666a3c98aa04d"}
Jul 10 23:21:31.260999 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.260971    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151784507184"
Jul 10 23:21:31.280900 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.280870    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7481-140151784507184_4d8ecc56-7eff-4218-9908-b3685408ce5c/test-curl-7481-140151784507184/0.log"
Jul 10 23:21:31.305093 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.305055    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7481-140151784507184"]
Jul 10 23:21:31.308245 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.308220    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7481-140151784507184"]
Jul 10 23:21:31.316677 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.316655    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8966\" (UniqueName: \"kubernetes.io/projected/4d8ecc56-7eff-4218-9908-b3685408ce5c-kube-api-access-z8966\") pod \"4d8ecc56-7eff-4218-9908-b3685408ce5c\" (UID: \"4d8ecc56-7eff-4218-9908-b3685408ce5c\") "
Jul 10 23:21:31.318757 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.318728    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d8ecc56-7eff-4218-9908-b3685408ce5c-kube-api-access-z8966" (OuterVolumeSpecName: "kube-api-access-z8966") pod "4d8ecc56-7eff-4218-9908-b3685408ce5c" (UID: "4d8ecc56-7eff-4218-9908-b3685408ce5c"). InnerVolumeSpecName "kube-api-access-z8966". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:21:31.417540 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.417452    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8966\" (UniqueName: \"kubernetes.io/projected/4d8ecc56-7eff-4218-9908-b3685408ce5c-kube-api-access-z8966\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:21:31.460000 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.459969    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7481-140151780595584"]
Jul 10 23:21:31.460331 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.460318    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d8ecc56-7eff-4218-9908-b3685408ce5c" containerName="test-curl-7481-140151784507184"
Jul 10 23:21:31.460390 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.460332    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d8ecc56-7eff-4218-9908-b3685408ce5c" containerName="test-curl-7481-140151784507184"
Jul 10 23:21:31.460428 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.460393    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d8ecc56-7eff-4218-9908-b3685408ce5c" containerName="test-curl-7481-140151784507184"
Jul 10 23:21:31.463210 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.463194    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:31.470831 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.470806    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7481-140151780595584"]
Jul 10 23:21:31.518665 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.518625    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n88z7\" (UniqueName: \"kubernetes.io/projected/8c293569-e054-422a-9ae9-c788ab07cd28-kube-api-access-n88z7\") pod \"test-curl-7481-140151780595584\" (UID: \"8c293569-e054-422a-9ae9-c788ab07cd28\") " pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:31.619262 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.619227    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n88z7\" (UniqueName: \"kubernetes.io/projected/8c293569-e054-422a-9ae9-c788ab07cd28-kube-api-access-n88z7\") pod \"test-curl-7481-140151780595584\" (UID: \"8c293569-e054-422a-9ae9-c788ab07cd28\") " pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:31.627449 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.627427    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n88z7\" (UniqueName: \"kubernetes.io/projected/8c293569-e054-422a-9ae9-c788ab07cd28-kube-api-access-n88z7\") pod \"test-curl-7481-140151780595584\" (UID: \"8c293569-e054-422a-9ae9-c788ab07cd28\") " pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:31.773025 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.772926    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:31.907452 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:31.907387    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7481-140151780595584"]
Jul 10 23:21:31.910094 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:21:31.910070    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c293569_e054_422a_9ae9_c788ab07cd28.slice/crio-c1b3c314fb12810c90f0d7d969cf200a5785a0b77160848440e283758944165f WatchSource:0}: Error finding container c1b3c314fb12810c90f0d7d969cf200a5785a0b77160848440e283758944165f: Status 404 returned error can't find the container with id c1b3c314fb12810c90f0d7d969cf200a5785a0b77160848440e283758944165f
Jul 10 23:21:32.126227 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:32.126199    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151784507184"
Jul 10 23:21:32.126476 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:32.126245    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86353c639c7f842a9c429cb9fde6f5366951d75bff296d32b3f83992a95e4f2e"
Jul 10 23:21:32.127312 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:32.127286    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7481-140151780595584" event={"ID":"8c293569-e054-422a-9ae9-c788ab07cd28","Type":"ContainerStarted","Data":"c1b3c314fb12810c90f0d7d969cf200a5785a0b77160848440e283758944165f"}
Jul 10 23:21:32.136464 ip-10-0-130-215 kubenswrapper[2566]: E0710 23:21:32.136430    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7481-140151784507184\" is forbidden: User \"system:node:ip-10-0-130-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-215.ec2.internal' and this object" podUID="4d8ecc56-7eff-4218-9908-b3685408ce5c" pod="openshift-ingress/test-curl-7481-140151784507184"
Jul 10 23:21:32.803465 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:32.803422    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d8ecc56-7eff-4218-9908-b3685408ce5c" path="/var/lib/kubelet/pods/4d8ecc56-7eff-4218-9908-b3685408ce5c/volumes"
Jul 10 23:21:33.132809 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:33.132757    2566 generic.go:356] "Generic (PLEG): container finished" podID="8c293569-e054-422a-9ae9-c788ab07cd28" containerID="d016a3b21421ab9f62e2db04f890668462b1ce263ac43cf346b5e082f8aeb26a" exitCode=0
Jul 10 23:21:33.133016 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:33.132855    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7481-140151780595584" event={"ID":"8c293569-e054-422a-9ae9-c788ab07cd28","Type":"ContainerDied","Data":"d016a3b21421ab9f62e2db04f890668462b1ce263ac43cf346b5e082f8aeb26a"}
Jul 10 23:21:34.280950 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.280922    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:34.301658 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.301628    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7481-140151780595584_8c293569-e054-422a-9ae9-c788ab07cd28/test-curl-7481-140151780595584/0.log"
Jul 10 23:21:34.325999 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.325966    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7481-140151780595584"]
Jul 10 23:21:34.331898 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.331871    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7481-140151780595584"]
Jul 10 23:21:34.347430 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.347392    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n88z7\" (UniqueName: \"kubernetes.io/projected/8c293569-e054-422a-9ae9-c788ab07cd28-kube-api-access-n88z7\") pod \"8c293569-e054-422a-9ae9-c788ab07cd28\" (UID: \"8c293569-e054-422a-9ae9-c788ab07cd28\") "
Jul 10 23:21:34.349463 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.349441    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c293569-e054-422a-9ae9-c788ab07cd28-kube-api-access-n88z7" (OuterVolumeSpecName: "kube-api-access-n88z7") pod "8c293569-e054-422a-9ae9-c788ab07cd28" (UID: "8c293569-e054-422a-9ae9-c788ab07cd28"). InnerVolumeSpecName "kube-api-access-n88z7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:21:34.447092 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.447004    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7481-140151780595584"]
Jul 10 23:21:34.447362 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.447349    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c293569-e054-422a-9ae9-c788ab07cd28" containerName="test-curl-7481-140151780595584"
Jul 10 23:21:34.447404 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.447364    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c293569-e054-422a-9ae9-c788ab07cd28" containerName="test-curl-7481-140151780595584"
Jul 10 23:21:34.447443 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.447423    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c293569-e054-422a-9ae9-c788ab07cd28" containerName="test-curl-7481-140151780595584"
Jul 10 23:21:34.448689 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.448670    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n88z7\" (UniqueName: \"kubernetes.io/projected/8c293569-e054-422a-9ae9-c788ab07cd28-kube-api-access-n88z7\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:21:34.450254 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.450239    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:34.457495 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.457462    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7481-140151780595584"]
Jul 10 23:21:34.549547 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.549508    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbklf\" (UniqueName: \"kubernetes.io/projected/46dff4af-e0b8-4828-a285-12b7cf7dd730-kube-api-access-qbklf\") pod \"test-curl-7481-140151780595584\" (UID: \"46dff4af-e0b8-4828-a285-12b7cf7dd730\") " pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:34.650715 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.650676    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbklf\" (UniqueName: \"kubernetes.io/projected/46dff4af-e0b8-4828-a285-12b7cf7dd730-kube-api-access-qbklf\") pod \"test-curl-7481-140151780595584\" (UID: \"46dff4af-e0b8-4828-a285-12b7cf7dd730\") " pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:34.658854 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.658823    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbklf\" (UniqueName: \"kubernetes.io/projected/46dff4af-e0b8-4828-a285-12b7cf7dd730-kube-api-access-qbklf\") pod \"test-curl-7481-140151780595584\" (UID: \"46dff4af-e0b8-4828-a285-12b7cf7dd730\") " pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:34.759565 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.759472    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:34.804788 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.804731    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c293569-e054-422a-9ae9-c788ab07cd28" path="/var/lib/kubelet/pods/8c293569-e054-422a-9ae9-c788ab07cd28/volumes"
Jul 10 23:21:34.891742 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:34.891716    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7481-140151780595584"]
Jul 10 23:21:34.893860 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:21:34.893830    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46dff4af_e0b8_4828_a285_12b7cf7dd730.slice/crio-e21ef39ca165415d77662903243f11c28c9c28c43c4a0c3b75292960ca69527f WatchSource:0}: Error finding container e21ef39ca165415d77662903243f11c28c9c28c43c4a0c3b75292960ca69527f: Status 404 returned error can't find the container with id e21ef39ca165415d77662903243f11c28c9c28c43c4a0c3b75292960ca69527f
Jul 10 23:21:35.143433 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:35.143399    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:35.143642 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:35.143450    2566 scope.go:117] "RemoveContainer" containerID="d016a3b21421ab9f62e2db04f890668462b1ce263ac43cf346b5e082f8aeb26a"
Jul 10 23:21:35.144734 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:35.144654    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7481-140151780595584" event={"ID":"46dff4af-e0b8-4828-a285-12b7cf7dd730","Type":"ContainerStarted","Data":"e21ef39ca165415d77662903243f11c28c9c28c43c4a0c3b75292960ca69527f"}
Jul 10 23:21:36.151566 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:36.151534    2566 generic.go:356] "Generic (PLEG): container finished" podID="46dff4af-e0b8-4828-a285-12b7cf7dd730" containerID="42d588e572f8c1442ca250002d3f64c4cf1728661a171a53380dd5c919d97819" exitCode=0
Jul 10 23:21:36.151987 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:36.151584    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7481-140151780595584" event={"ID":"46dff4af-e0b8-4828-a285-12b7cf7dd730","Type":"ContainerDied","Data":"42d588e572f8c1442ca250002d3f64c4cf1728661a171a53380dd5c919d97819"}
Jul 10 23:21:37.287380 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.287349    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:37.305952 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.305926    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7481-140151780595584_46dff4af-e0b8-4828-a285-12b7cf7dd730/test-curl-7481-140151780595584/0.log"
Jul 10 23:21:37.331115 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.331078    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7481-140151780595584"]
Jul 10 23:21:37.335074 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.335040    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7481-140151780595584"]
Jul 10 23:21:37.371571 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.371534    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbklf\" (UniqueName: \"kubernetes.io/projected/46dff4af-e0b8-4828-a285-12b7cf7dd730-kube-api-access-qbklf\") pod \"46dff4af-e0b8-4828-a285-12b7cf7dd730\" (UID: \"46dff4af-e0b8-4828-a285-12b7cf7dd730\") "
Jul 10 23:21:37.373614 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.373583    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46dff4af-e0b8-4828-a285-12b7cf7dd730-kube-api-access-qbklf" (OuterVolumeSpecName: "kube-api-access-qbklf") pod "46dff4af-e0b8-4828-a285-12b7cf7dd730" (UID: "46dff4af-e0b8-4828-a285-12b7cf7dd730"). InnerVolumeSpecName "kube-api-access-qbklf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:21:37.449084 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.449003    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7481-140151780596592"]
Jul 10 23:21:37.449366 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.449354    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46dff4af-e0b8-4828-a285-12b7cf7dd730" containerName="test-curl-7481-140151780595584"
Jul 10 23:21:37.449404 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.449367    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="46dff4af-e0b8-4828-a285-12b7cf7dd730" containerName="test-curl-7481-140151780595584"
Jul 10 23:21:37.449436 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.449416    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="46dff4af-e0b8-4828-a285-12b7cf7dd730" containerName="test-curl-7481-140151780595584"
Jul 10 23:21:37.452185 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.452168    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:21:37.456543 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.456516    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7481-140151780596592"]
Jul 10 23:21:37.472617 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.472588    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkb2g\" (UniqueName: \"kubernetes.io/projected/7bbf3802-3fe5-43ab-8eb1-f4258e4c798a-kube-api-access-tkb2g\") pod \"test-curl-7481-140151780596592\" (UID: \"7bbf3802-3fe5-43ab-8eb1-f4258e4c798a\") " pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:21:37.472796 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.472697    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbklf\" (UniqueName: \"kubernetes.io/projected/46dff4af-e0b8-4828-a285-12b7cf7dd730-kube-api-access-qbklf\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:21:37.574022 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.573981    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkb2g\" (UniqueName: \"kubernetes.io/projected/7bbf3802-3fe5-43ab-8eb1-f4258e4c798a-kube-api-access-tkb2g\") pod \"test-curl-7481-140151780596592\" (UID: \"7bbf3802-3fe5-43ab-8eb1-f4258e4c798a\") " pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:21:37.582285 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.582250    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkb2g\" (UniqueName: \"kubernetes.io/projected/7bbf3802-3fe5-43ab-8eb1-f4258e4c798a-kube-api-access-tkb2g\") pod \"test-curl-7481-140151780596592\" (UID: \"7bbf3802-3fe5-43ab-8eb1-f4258e4c798a\") " pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:21:37.762260 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.762167    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:21:37.894423 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:37.894389    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7481-140151780596592"]
Jul 10 23:21:37.897314 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:21:37.897286    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7bbf3802_3fe5_43ab_8eb1_f4258e4c798a.slice/crio-53e955f55c52da308ea029a3e0ff7cfc6e9f4be7598e31e61e40711b3bb0e50e WatchSource:0}: Error finding container 53e955f55c52da308ea029a3e0ff7cfc6e9f4be7598e31e61e40711b3bb0e50e: Status 404 returned error can't find the container with id 53e955f55c52da308ea029a3e0ff7cfc6e9f4be7598e31e61e40711b3bb0e50e
Jul 10 23:21:38.162705 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:38.162680    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:38.162931 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:38.162677    2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e21ef39ca165415d77662903243f11c28c9c28c43c4a0c3b75292960ca69527f"
Jul 10 23:21:38.163856 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:38.163830    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7481-140151780596592" event={"ID":"7bbf3802-3fe5-43ab-8eb1-f4258e4c798a","Type":"ContainerStarted","Data":"53e955f55c52da308ea029a3e0ff7cfc6e9f4be7598e31e61e40711b3bb0e50e"}
Jul 10 23:21:38.173388 ip-10-0-130-215 kubenswrapper[2566]: E0710 23:21:38.173356    2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7481-140151780595584\" is forbidden: User \"system:node:ip-10-0-130-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-130-215.ec2.internal' and this object" podUID="46dff4af-e0b8-4828-a285-12b7cf7dd730" pod="openshift-ingress/test-curl-7481-140151780595584"
Jul 10 23:21:38.802943 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:38.802910    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46dff4af-e0b8-4828-a285-12b7cf7dd730" path="/var/lib/kubelet/pods/46dff4af-e0b8-4828-a285-12b7cf7dd730/volumes"
Jul 10 23:21:39.170076 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:39.170039    2566 generic.go:356] "Generic (PLEG): container finished" podID="7bbf3802-3fe5-43ab-8eb1-f4258e4c798a" containerID="ebc750797f75a09f2dacf1941c11acdd7b7aa97f9de295dca22ef4f8c74566db" exitCode=0
Jul 10 23:21:39.170256 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:39.170123    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7481-140151780596592" event={"ID":"7bbf3802-3fe5-43ab-8eb1-f4258e4c798a","Type":"ContainerDied","Data":"ebc750797f75a09f2dacf1941c11acdd7b7aa97f9de295dca22ef4f8c74566db"}
Jul 10 23:21:39.826839 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:39.826795    2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl" podUID="a78f6223-24ea-4a57-a4af-3bbe0e780905" containerName="main" containerID="cri-o://8f07d3903cdbb01722623ba61e358965fa223aadd7b4c6532d5226a18dc59564" gracePeriod=45
Jul 10 23:21:40.085995 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.085932    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:21:40.176265 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.176227    2566 generic.go:356] "Generic (PLEG): container finished" podID="a78f6223-24ea-4a57-a4af-3bbe0e780905" containerID="8f07d3903cdbb01722623ba61e358965fa223aadd7b4c6532d5226a18dc59564" exitCode=0
Jul 10 23:21:40.176469 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.176276    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"
Jul 10 23:21:40.176469 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.176313    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl" event={"ID":"a78f6223-24ea-4a57-a4af-3bbe0e780905","Type":"ContainerDied","Data":"8f07d3903cdbb01722623ba61e358965fa223aadd7b4c6532d5226a18dc59564"}
Jul 10 23:21:40.176469 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.176354    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl" event={"ID":"a78f6223-24ea-4a57-a4af-3bbe0e780905","Type":"ContainerDied","Data":"5c934570446781ab6c4159e190353876b0686e7cd498693e4ddde90a5aa616b0"}
Jul 10 23:21:40.176469 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.176375    2566 scope.go:117] "RemoveContainer" containerID="8f07d3903cdbb01722623ba61e358965fa223aadd7b4c6532d5226a18dc59564"
Jul 10 23:21:40.184845 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.184826    2566 scope.go:117] "RemoveContainer" containerID="8f07d3903cdbb01722623ba61e358965fa223aadd7b4c6532d5226a18dc59564"
Jul 10 23:21:40.185183 ip-10-0-130-215 kubenswrapper[2566]: E0710 23:21:40.185164    2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f07d3903cdbb01722623ba61e358965fa223aadd7b4c6532d5226a18dc59564\": container with ID starting with 8f07d3903cdbb01722623ba61e358965fa223aadd7b4c6532d5226a18dc59564 not found: ID does not exist" containerID="8f07d3903cdbb01722623ba61e358965fa223aadd7b4c6532d5226a18dc59564"
Jul 10 23:21:40.185242 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.185197    2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f07d3903cdbb01722623ba61e358965fa223aadd7b4c6532d5226a18dc59564"} err="failed to get container status \"8f07d3903cdbb01722623ba61e358965fa223aadd7b4c6532d5226a18dc59564\": rpc error: code = NotFound desc = could not find container \"8f07d3903cdbb01722623ba61e358965fa223aadd7b4c6532d5226a18dc59564\": container with ID starting with 8f07d3903cdbb01722623ba61e358965fa223aadd7b4c6532d5226a18dc59564 not found: ID does not exist"
Jul 10 23:21:40.200847 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.199117    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-home\") pod \"a78f6223-24ea-4a57-a4af-3bbe0e780905\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") "
Jul 10 23:21:40.200847 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.199188    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-tmp-dir\") pod \"a78f6223-24ea-4a57-a4af-3bbe0e780905\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") "
Jul 10 23:21:40.200847 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.199307    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjjtz\" (UniqueName: \"kubernetes.io/projected/a78f6223-24ea-4a57-a4af-3bbe0e780905-kube-api-access-cjjtz\") pod \"a78f6223-24ea-4a57-a4af-3bbe0e780905\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") "
Jul 10 23:21:40.200847 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.199340    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a78f6223-24ea-4a57-a4af-3bbe0e780905-tls-certs\") pod \"a78f6223-24ea-4a57-a4af-3bbe0e780905\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") "
Jul 10 23:21:40.200847 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.199405    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-model-cache\") pod \"a78f6223-24ea-4a57-a4af-3bbe0e780905\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") "
Jul 10 23:21:40.200847 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.199467    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-dshm\") pod \"a78f6223-24ea-4a57-a4af-3bbe0e780905\" (UID: \"a78f6223-24ea-4a57-a4af-3bbe0e780905\") "
Jul 10 23:21:40.200847 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.200256    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-home" (OuterVolumeSpecName: "home") pod "a78f6223-24ea-4a57-a4af-3bbe0e780905" (UID: "a78f6223-24ea-4a57-a4af-3bbe0e780905"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:21:40.200847 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.200434    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a78f6223-24ea-4a57-a4af-3bbe0e780905" (UID: "a78f6223-24ea-4a57-a4af-3bbe0e780905"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:21:40.201374 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.201290    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-model-cache" (OuterVolumeSpecName: "model-cache") pod "a78f6223-24ea-4a57-a4af-3bbe0e780905" (UID: "a78f6223-24ea-4a57-a4af-3bbe0e780905"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:21:40.207005 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.204161    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a78f6223-24ea-4a57-a4af-3bbe0e780905-kube-api-access-cjjtz" (OuterVolumeSpecName: "kube-api-access-cjjtz") pod "a78f6223-24ea-4a57-a4af-3bbe0e780905" (UID: "a78f6223-24ea-4a57-a4af-3bbe0e780905"). InnerVolumeSpecName "kube-api-access-cjjtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:21:40.207005 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.204408    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a78f6223-24ea-4a57-a4af-3bbe0e780905-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a78f6223-24ea-4a57-a4af-3bbe0e780905" (UID: "a78f6223-24ea-4a57-a4af-3bbe0e780905"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 23:21:40.207637 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.207614    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-dshm" (OuterVolumeSpecName: "dshm") pod "a78f6223-24ea-4a57-a4af-3bbe0e780905" (UID: "a78f6223-24ea-4a57-a4af-3bbe0e780905"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 23:21:40.300339 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.300310    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjjtz\" (UniqueName: \"kubernetes.io/projected/a78f6223-24ea-4a57-a4af-3bbe0e780905-kube-api-access-cjjtz\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:21:40.300339 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.300339    2566 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a78f6223-24ea-4a57-a4af-3bbe0e780905-tls-certs\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:21:40.300549 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.300356    2566 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-model-cache\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:21:40.300549 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.300367    2566 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-dshm\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:21:40.300549 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.300377    2566 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-home\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:21:40.300549 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.300386    2566 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a78f6223-24ea-4a57-a4af-3bbe0e780905-tmp-dir\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:21:40.304145 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.304123    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:21:40.334334 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.334309    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7481-140151780596592_7bbf3802-3fe5-43ab-8eb1-f4258e4c798a/test-curl-7481-140151780596592/0.log"
Jul 10 23:21:40.359200 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.359162    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7481-140151780596592"]
Jul 10 23:21:40.365392 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.365365    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7481-140151780596592"]
Jul 10 23:21:40.401023 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.400992    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkb2g\" (UniqueName: \"kubernetes.io/projected/7bbf3802-3fe5-43ab-8eb1-f4258e4c798a-kube-api-access-tkb2g\") pod \"7bbf3802-3fe5-43ab-8eb1-f4258e4c798a\" (UID: \"7bbf3802-3fe5-43ab-8eb1-f4258e4c798a\") "
Jul 10 23:21:40.403077 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.403054    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bbf3802-3fe5-43ab-8eb1-f4258e4c798a-kube-api-access-tkb2g" (OuterVolumeSpecName: "kube-api-access-tkb2g") pod "7bbf3802-3fe5-43ab-8eb1-f4258e4c798a" (UID: "7bbf3802-3fe5-43ab-8eb1-f4258e4c798a"). InnerVolumeSpecName "kube-api-access-tkb2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:21:40.497083 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.497044    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"]
Jul 10 23:21:40.501338 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.501312    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-02c498/rate-test-model-02c498-kserve-6d59c4cfcf-pw6tl"]
Jul 10 23:21:40.501689 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.501666    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkb2g\" (UniqueName: \"kubernetes.io/projected/7bbf3802-3fe5-43ab-8eb1-f4258e4c798a-kube-api-access-tkb2g\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:21:40.802876 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.802791    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bbf3802-3fe5-43ab-8eb1-f4258e4c798a" path="/var/lib/kubelet/pods/7bbf3802-3fe5-43ab-8eb1-f4258e4c798a/volumes"
Jul 10 23:21:40.803190 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:40.803177    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a78f6223-24ea-4a57-a4af-3bbe0e780905" path="/var/lib/kubelet/pods/a78f6223-24ea-4a57-a4af-3bbe0e780905/volumes"
Jul 10 23:21:41.182966 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.182940    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:21:41.183383 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.182940    2566 scope.go:117] "RemoveContainer" containerID="ebc750797f75a09f2dacf1941c11acdd7b7aa97f9de295dca22ef4f8c74566db"
Jul 10 23:21:41.519800 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.519700    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7481-140151780596592"]
Jul 10 23:21:41.520054 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.520041    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a78f6223-24ea-4a57-a4af-3bbe0e780905" containerName="main"
Jul 10 23:21:41.520105 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.520055    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a78f6223-24ea-4a57-a4af-3bbe0e780905" containerName="main"
Jul 10 23:21:41.520105 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.520071    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbf3802-3fe5-43ab-8eb1-f4258e4c798a" containerName="test-curl-7481-140151780596592"
Jul 10 23:21:41.520105 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.520077    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbf3802-3fe5-43ab-8eb1-f4258e4c798a" containerName="test-curl-7481-140151780596592"
Jul 10 23:21:41.520197 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.520133    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a78f6223-24ea-4a57-a4af-3bbe0e780905" containerName="main"
Jul 10 23:21:41.520197 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.520142    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bbf3802-3fe5-43ab-8eb1-f4258e4c798a" containerName="test-curl-7481-140151780596592"
Jul 10 23:21:41.524489 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.524469    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:21:41.526989 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.526967    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-9xhqs\""
Jul 10 23:21:41.530095 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.530072    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7481-140151780596592"]
Jul 10 23:21:41.610729 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.610684    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr949\" (UniqueName: \"kubernetes.io/projected/b0bd3e10-cd60-4f99-804f-20cf417c4d45-kube-api-access-kr949\") pod \"test-curl-7481-140151780596592\" (UID: \"b0bd3e10-cd60-4f99-804f-20cf417c4d45\") " pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:21:41.711339 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.711302    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr949\" (UniqueName: \"kubernetes.io/projected/b0bd3e10-cd60-4f99-804f-20cf417c4d45-kube-api-access-kr949\") pod \"test-curl-7481-140151780596592\" (UID: \"b0bd3e10-cd60-4f99-804f-20cf417c4d45\") " pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:21:41.720004 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.719977    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr949\" (UniqueName: \"kubernetes.io/projected/b0bd3e10-cd60-4f99-804f-20cf417c4d45-kube-api-access-kr949\") pod \"test-curl-7481-140151780596592\" (UID: \"b0bd3e10-cd60-4f99-804f-20cf417c4d45\") " pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:21:41.835175 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.835076    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:21:41.963428 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:41.963391    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7481-140151780596592"]
Jul 10 23:21:41.966724 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:21:41.966697    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0bd3e10_cd60_4f99_804f_20cf417c4d45.slice/crio-ede00b16c4b74c8ffd2730b9bd1335c93d94947eb8865b2540a5bfd86addcfe9 WatchSource:0}: Error finding container ede00b16c4b74c8ffd2730b9bd1335c93d94947eb8865b2540a5bfd86addcfe9: Status 404 returned error can't find the container with id ede00b16c4b74c8ffd2730b9bd1335c93d94947eb8865b2540a5bfd86addcfe9
Jul 10 23:21:42.191058 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:42.191024    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7481-140151780596592" event={"ID":"b0bd3e10-cd60-4f99-804f-20cf417c4d45","Type":"ContainerStarted","Data":"ede00b16c4b74c8ffd2730b9bd1335c93d94947eb8865b2540a5bfd86addcfe9"}
Jul 10 23:21:43.198348 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:43.198314    2566 generic.go:356] "Generic (PLEG): container finished" podID="b0bd3e10-cd60-4f99-804f-20cf417c4d45" containerID="a7d180a9be09bb230baf6a319f72c3c8f3fe82b75d360ecfcde3c9120607952c" exitCode=0
Jul 10 23:21:43.198735 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:43.198404    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7481-140151780596592" event={"ID":"b0bd3e10-cd60-4f99-804f-20cf417c4d45","Type":"ContainerDied","Data":"a7d180a9be09bb230baf6a319f72c3c8f3fe82b75d360ecfcde3c9120607952c"}
Jul 10 23:21:44.343946 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:44.343918    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:21:44.362599 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:44.362577    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7481-140151780596592_b0bd3e10-cd60-4f99-804f-20cf417c4d45/test-curl-7481-140151780596592/0.log"
Jul 10 23:21:44.383796 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:44.383739    2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7481-140151780596592"]
Jul 10 23:21:44.385983 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:44.385951    2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7481-140151780596592"]
Jul 10 23:21:44.436022 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:44.435991    2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr949\" (UniqueName: \"kubernetes.io/projected/b0bd3e10-cd60-4f99-804f-20cf417c4d45-kube-api-access-kr949\") pod \"b0bd3e10-cd60-4f99-804f-20cf417c4d45\" (UID: \"b0bd3e10-cd60-4f99-804f-20cf417c4d45\") "
Jul 10 23:21:44.438238 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:44.438206    2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0bd3e10-cd60-4f99-804f-20cf417c4d45-kube-api-access-kr949" (OuterVolumeSpecName: "kube-api-access-kr949") pod "b0bd3e10-cd60-4f99-804f-20cf417c4d45" (UID: "b0bd3e10-cd60-4f99-804f-20cf417c4d45"). InnerVolumeSpecName "kube-api-access-kr949". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 23:21:44.536723 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:44.536638    2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr949\" (UniqueName: \"kubernetes.io/projected/b0bd3e10-cd60-4f99-804f-20cf417c4d45-kube-api-access-kr949\") on node \"ip-10-0-130-215.ec2.internal\" DevicePath \"\""
Jul 10 23:21:44.802803 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:44.802711    2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0bd3e10-cd60-4f99-804f-20cf417c4d45" path="/var/lib/kubelet/pods/b0bd3e10-cd60-4f99-804f-20cf417c4d45/volumes"
Jul 10 23:21:45.210427 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:45.210392    2566 scope.go:117] "RemoveContainer" containerID="a7d180a9be09bb230baf6a319f72c3c8f3fe82b75d360ecfcde3c9120607952c"
Jul 10 23:21:45.210630 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:21:45.210396    2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7481-140151780596592"
Jul 10 23:22:04.678285 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:04.678252    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845b6c684-tzkjm_6f9555bb-21ad-457b-96dd-224f4d8ea451/copy-manifests/0.log"
Jul 10 23:22:04.685162 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:04.685136    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845b6c684-tzkjm_6f9555bb-21ad-457b-96dd-224f4d8ea451/manager/0.log"
Jul 10 23:22:06.823509 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:06.823481    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-h98nf_8a05699b-8af3-4fa5-bd80-11aefb327663/kuadrant-console-plugin/0.log"
Jul 10 23:22:07.281574 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:07.281538    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-hvllk_bc0bef61-faae-45c4-b2a1-e2ee83eaa84b/manager/0.log"
Jul 10 23:22:07.859511 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:07.859482    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7454dcb6b8-9xxxc_204f4523-39c4-45e9-865b-160c758c0c4f/kube-auth-proxy/0.log"
Jul 10 23:22:08.962580 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:08.962545    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-h59cj_eaf1cf42-094b-4a07-b97a-b24816c769a5/main/0.log"
Jul 10 23:22:09.180178 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:09.180146    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-9kbds_8195d1d5-7c01-489b-ba0e-3222d5754133/main/0.log"
Jul 10 23:22:09.292078 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:09.292001    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-gh7nb_8cc0b91a-1df4-4a12-94f3-1823da6847df/main/0.log"
Jul 10 23:22:12.821946 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:12.821910    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xz2px/must-gather-hc8rv"]
Jul 10 23:22:12.822313 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:12.822269    2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0bd3e10-cd60-4f99-804f-20cf417c4d45" containerName="test-curl-7481-140151780596592"
Jul 10 23:22:12.822313 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:12.822283    2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0bd3e10-cd60-4f99-804f-20cf417c4d45" containerName="test-curl-7481-140151780596592"
Jul 10 23:22:12.822389 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:12.822336    2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0bd3e10-cd60-4f99-804f-20cf417c4d45" containerName="test-curl-7481-140151780596592"
Jul 10 23:22:12.825383 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:12.825361    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xz2px/must-gather-hc8rv"
Jul 10 23:22:12.828077 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:12.828054    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xz2px\"/\"openshift-service-ca.crt\""
Jul 10 23:22:12.828780 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:12.828754    2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xz2px\"/\"kube-root-ca.crt\""
Jul 10 23:22:12.828849 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:12.828804    2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xz2px\"/\"default-dockercfg-shbnr\""
Jul 10 23:22:12.833915 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:12.833886    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xz2px/must-gather-hc8rv"]
Jul 10 23:22:12.998371 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:12.998331    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb-must-gather-output\") pod \"must-gather-hc8rv\" (UID: \"2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb\") " pod="openshift-must-gather-xz2px/must-gather-hc8rv"
Jul 10 23:22:12.998562 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:12.998462    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrjsk\" (UniqueName: \"kubernetes.io/projected/2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb-kube-api-access-hrjsk\") pod \"must-gather-hc8rv\" (UID: \"2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb\") " pod="openshift-must-gather-xz2px/must-gather-hc8rv"
Jul 10 23:22:13.099479 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:13.099445    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb-must-gather-output\") pod \"must-gather-hc8rv\" (UID: \"2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb\") " pod="openshift-must-gather-xz2px/must-gather-hc8rv"
Jul 10 23:22:13.099631 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:13.099525    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrjsk\" (UniqueName: \"kubernetes.io/projected/2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb-kube-api-access-hrjsk\") pod \"must-gather-hc8rv\" (UID: \"2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb\") " pod="openshift-must-gather-xz2px/must-gather-hc8rv"
Jul 10 23:22:13.099826 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:13.099807    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb-must-gather-output\") pod \"must-gather-hc8rv\" (UID: \"2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb\") " pod="openshift-must-gather-xz2px/must-gather-hc8rv"
Jul 10 23:22:13.107503 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:13.107481    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrjsk\" (UniqueName: \"kubernetes.io/projected/2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb-kube-api-access-hrjsk\") pod \"must-gather-hc8rv\" (UID: \"2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb\") " pod="openshift-must-gather-xz2px/must-gather-hc8rv"
Jul 10 23:22:13.135680 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:13.135645    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xz2px/must-gather-hc8rv"
Jul 10 23:22:13.269435 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:13.269409    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xz2px/must-gather-hc8rv"]
Jul 10 23:22:13.272060 ip-10-0-130-215 kubenswrapper[2566]: W0710 23:22:13.272028    2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dc5764b_b3bf_4836_a3d7_b8cebbdc80cb.slice/crio-c65dc8ec4d0c1d2eb90e3512b8c582833e392f041d545efc77913f8158d5410c WatchSource:0}: Error finding container c65dc8ec4d0c1d2eb90e3512b8c582833e392f041d545efc77913f8158d5410c: Status 404 returned error can't find the container with id c65dc8ec4d0c1d2eb90e3512b8c582833e392f041d545efc77913f8158d5410c
Jul 10 23:22:13.336956 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:13.336924    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xz2px/must-gather-hc8rv" event={"ID":"2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb","Type":"ContainerStarted","Data":"c65dc8ec4d0c1d2eb90e3512b8c582833e392f041d545efc77913f8158d5410c"}
Jul 10 23:22:14.344589 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:14.344552    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xz2px/must-gather-hc8rv" event={"ID":"2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb","Type":"ContainerStarted","Data":"d6fe1cdd7b36aebf3ee3323535df6d3afb69d4b2495edda0cababe1ccf6b4cf1"}
Jul 10 23:22:14.345083 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:14.344603    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xz2px/must-gather-hc8rv" event={"ID":"2dc5764b-b3bf-4836-a3d7-b8cebbdc80cb","Type":"ContainerStarted","Data":"76e85b915613c7ae02a1f2cf53e275aaf161c1b6cb7a56eb4bfddc543cb2d33c"}
Jul 10 23:22:14.362723 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:14.362655    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xz2px/must-gather-hc8rv" podStartSLOduration=1.5946417510000002 podStartE2EDuration="2.362630545s" totalImagesPullingTime="767.988794ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 23:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:22:14.361838748 +0000 UTC m=+2354.055197028" watchObservedRunningTime="2026-07-10 23:22:14.362630545 +0000 UTC m=+2354.055988821"
Jul 10 23:22:15.626499 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:15.626465    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j56vp_010f1cce-27b5-4536-b7b9-9be0187fb5d6/global-pull-secret-syncer/0.log"
Jul 10 23:22:15.838404 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:15.838349    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vhjz5_851d6aef-2780-4f25-867c-14ba6fdace8c/konnectivity-agent/0.log"
Jul 10 23:22:15.864531 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:15.864499    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-215.ec2.internal_41b0fee650dcf69fea5e4dfcbe8f4eea/haproxy/0.log"
Jul 10 23:22:20.701724 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:20.701699    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-h98nf_8a05699b-8af3-4fa5-bd80-11aefb327663/kuadrant-console-plugin/0.log"
Jul 10 23:22:21.078649 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:21.078080    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-hvllk_bc0bef61-faae-45c4-b2a1-e2ee83eaa84b/manager/0.log"
Jul 10 23:22:22.607793 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:22.607751    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fa655c0-b60b-44c1-8286-2ff003035306/alertmanager/0.log"
Jul 10 23:22:22.628644 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:22.628606    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fa655c0-b60b-44c1-8286-2ff003035306/config-reloader/0.log"
Jul 10 23:22:22.655470 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:22.654631    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fa655c0-b60b-44c1-8286-2ff003035306/kube-rbac-proxy-web/0.log"
Jul 10 23:22:22.678477 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:22.678422    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fa655c0-b60b-44c1-8286-2ff003035306/kube-rbac-proxy/0.log"
Jul 10 23:22:22.702663 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:22.702638    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fa655c0-b60b-44c1-8286-2ff003035306/kube-rbac-proxy-metric/0.log"
Jul 10 23:22:22.727331 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:22.727245    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fa655c0-b60b-44c1-8286-2ff003035306/prom-label-proxy/0.log"
Jul 10 23:22:22.749526 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:22.749455    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8fa655c0-b60b-44c1-8286-2ff003035306/init-config-reloader/0.log"
Jul 10 23:22:22.841786 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:22.841076    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-qxhv2_c780dbf8-77f6-43b0-b0fd-5b682c281fda/kube-state-metrics/0.log"
Jul 10 23:22:22.870789 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:22.870645    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-qxhv2_c780dbf8-77f6-43b0-b0fd-5b682c281fda/kube-rbac-proxy-main/0.log"
Jul 10 23:22:22.896272 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:22.896194    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-qxhv2_c780dbf8-77f6-43b0-b0fd-5b682c281fda/kube-rbac-proxy-self/0.log"
Jul 10 23:22:23.098293 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:23.098266    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rdqpv_d5bb25c3-c5e8-486a-8e50-577262e99b9a/node-exporter/0.log"
Jul 10 23:22:23.128647 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:23.128556    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rdqpv_d5bb25c3-c5e8-486a-8e50-577262e99b9a/kube-rbac-proxy/0.log"
Jul 10 23:22:23.154170 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:23.154139    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rdqpv_d5bb25c3-c5e8-486a-8e50-577262e99b9a/init-textfile/0.log"
Jul 10 23:22:23.398652 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:23.398561    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_49a1e075-949b-4212-aef4-73b68865aa24/prometheus/0.log"
Jul 10 23:22:23.421641 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:23.421603    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_49a1e075-949b-4212-aef4-73b68865aa24/config-reloader/0.log"
Jul 10 23:22:23.448224 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:23.448176    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_49a1e075-949b-4212-aef4-73b68865aa24/thanos-sidecar/0.log"
Jul 10 23:22:23.470802 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:23.470714    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_49a1e075-949b-4212-aef4-73b68865aa24/kube-rbac-proxy-web/0.log"
Jul 10 23:22:23.498813 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:23.498758    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_49a1e075-949b-4212-aef4-73b68865aa24/kube-rbac-proxy/0.log"
Jul 10 23:22:23.525713 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:23.525686    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_49a1e075-949b-4212-aef4-73b68865aa24/kube-rbac-proxy-thanos/0.log"
Jul 10 23:22:23.557689 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:23.557292    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_49a1e075-949b-4212-aef4-73b68865aa24/init-config-reloader/0.log"
Jul 10 23:22:23.645603 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:23.645578    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-9f485_f46f123f-a9ca-4a39-ae80-0a2e4852c906/prometheus-operator-admission-webhook/0.log"
Jul 10 23:22:26.428860 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.428825    2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"]
Jul 10 23:22:26.436660 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.436624    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.443694 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.443664    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"]
Jul 10 23:22:26.467611 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.467570    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-h8mzp_566f3458-5854-4902-a388-4b7ca1f953d2/download-server/0.log"
Jul 10 23:22:26.533991 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.533953    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-lib-modules\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.534338 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.534315    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cb86\" (UniqueName: \"kubernetes.io/projected/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-kube-api-access-6cb86\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.534495 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.534480    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-podres\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.534688 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.534676    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-proc\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.534872 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.534842    2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-sys\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.636535 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.636487    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-proc\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.636730 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.636575    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-sys\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.636730 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.636628    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-lib-modules\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.636730 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.636680    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cb86\" (UniqueName: \"kubernetes.io/projected/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-kube-api-access-6cb86\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.636730 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.636711    2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-podres\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.636968 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.636923    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-podres\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.637024 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.636993    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-proc\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.637081 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.637041    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-sys\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.637152 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.637131    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-lib-modules\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.645912 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.645874    2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cb86\" (UniqueName: \"kubernetes.io/projected/2b5f585e-1ac5-422b-ac16-6a1f5abbb5db-kube-api-access-6cb86\") pod \"perf-node-gather-daemonset-77qjn\" (UID: \"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db\") " pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.771063 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.770960    2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:26.968115 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:26.967457    2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"]
Jul 10 23:22:27.428321 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:27.428278    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn" event={"ID":"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db","Type":"ContainerStarted","Data":"54352841d07ecdaec6fb5d446b6a3a28683fab9a184cf61058af6a7ca7b4be40"}
Jul 10 23:22:27.428512 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:27.428356    2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn" event={"ID":"2b5f585e-1ac5-422b-ac16-6a1f5abbb5db","Type":"ContainerStarted","Data":"d9ee2bf0dc3010168f3a494535fd5e9a90c92538d0675a305857f013e0da74c3"}
Jul 10 23:22:27.428512 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:27.428415    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:27.444621 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:27.444559    2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn" podStartSLOduration=1.444537644 podStartE2EDuration="1.444537644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 23:22:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 23:22:27.443101989 +0000 UTC m=+2367.136460277" watchObservedRunningTime="2026-07-10 23:22:27.444537644 +0000 UTC m=+2367.137895919"
Jul 10 23:22:28.327026 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:28.326995    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9cmwm_4532fa7b-76be-4b64-93f8-b35e2f436878/dns/0.log"
Jul 10 23:22:28.349418 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:28.349388    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9cmwm_4532fa7b-76be-4b64-93f8-b35e2f436878/kube-rbac-proxy/0.log"
Jul 10 23:22:28.445743 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:28.445711    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fqm8t_d52abbd9-88c8-4d3b-9a5a-a7d8ed23f6cf/dns-node-resolver/0.log"
Jul 10 23:22:29.030372 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:29.030341    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-59f78bd545-p6q49_34ed569e-239a-4853-8031-a3358e2d1c15/registry/0.log"
Jul 10 23:22:29.076541 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:29.076515    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-85mnt_1c0c20c4-4027-4cc1-9f85-a078ac9fe0c2/node-ca/0.log"
Jul 10 23:22:30.246687 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:30.246650    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7454dcb6b8-9xxxc_204f4523-39c4-45e9-865b-160c758c0c4f/kube-auth-proxy/0.log"
Jul 10 23:22:31.188463 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:31.188435    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sq52g_60050627-b76e-41d3-bc89-328d6c4c12bd/serve-healthcheck-canary/0.log"
Jul 10 23:22:31.778909 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:31.778877    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2lsjh_c99b28af-3d79-4e40-9921-fb05ce03d720/kube-rbac-proxy/0.log"
Jul 10 23:22:31.812421 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:31.812392    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2lsjh_c99b28af-3d79-4e40-9921-fb05ce03d720/exporter/0.log"
Jul 10 23:22:31.842554 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:31.842524    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2lsjh_c99b28af-3d79-4e40-9921-fb05ce03d720/extractor/0.log"
Jul 10 23:22:33.446730 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:33.446699    2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xz2px/perf-node-gather-daemonset-77qjn"
Jul 10 23:22:34.659902 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:34.659873    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845b6c684-tzkjm_6f9555bb-21ad-457b-96dd-224f4d8ea451/manager/0.log"
Jul 10 23:22:34.681223 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:34.681192    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845b6c684-tzkjm_6f9555bb-21ad-457b-96dd-224f4d8ea451/copy-manifests/0.log"
Jul 10 23:22:36.106495 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:36.106417    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c7f744b8d-prl2n_cffe6ee2-912c-4468-aad4-3a340c8533a9/manager/0.log"
Jul 10 23:22:37.117095 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:37.117058    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7454dcb6b8-9xxxc_204f4523-39c4-45e9-865b-160c758c0c4f/kube-auth-proxy/0.log"
Jul 10 23:22:38.670384 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:38.670353    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7454dcb6b8-9xxxc_204f4523-39c4-45e9-865b-160c758c0c4f/kube-auth-proxy/0.log"
Jul 10 23:22:42.685881 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:42.685851    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gl9bt_bd433807-db54-456a-adf3-70a6912f8833/kube-multus-additional-cni-plugins/0.log"
Jul 10 23:22:42.716541 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:42.716517    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gl9bt_bd433807-db54-456a-adf3-70a6912f8833/egress-router-binary-copy/0.log"
Jul 10 23:22:42.745491 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:42.745466    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gl9bt_bd433807-db54-456a-adf3-70a6912f8833/cni-plugins/0.log"
Jul 10 23:22:42.779063 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:42.779030    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gl9bt_bd433807-db54-456a-adf3-70a6912f8833/bond-cni-plugin/0.log"
Jul 10 23:22:42.805202 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:42.805177    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gl9bt_bd433807-db54-456a-adf3-70a6912f8833/routeoverride-cni/0.log"
Jul 10 23:22:42.832433 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:42.832404    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gl9bt_bd433807-db54-456a-adf3-70a6912f8833/whereabouts-cni-bincopy/0.log"
Jul 10 23:22:42.865150 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:42.865118    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gl9bt_bd433807-db54-456a-adf3-70a6912f8833/whereabouts-cni/0.log"
Jul 10 23:22:43.350975 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:43.350940    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-btksg_351fb14f-02ad-484c-aef1-e6a426502261/kube-multus/0.log"
Jul 10 23:22:43.502067 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:43.502037    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6rq2s_3efa918d-27f0-4c41-912b-519868eaf758/network-metrics-daemon/0.log"
Jul 10 23:22:43.526594 ip-10-0-130-215 kubenswrapper[2566]: I0710 23:22:43.526565    2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6rq2s_3efa918d-27f0-4c41-912b-519868eaf758/kube-rbac-proxy/0.log"