Jul 22 03:05:22.297136 ip-10-0-142-230 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 03:05:22.297147 ip-10-0-142-230 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 03:05:22.297155 ip-10-0-142-230 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 03:05:22.297396 ip-10-0-142-230 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 03:05:31.892871 ip-10-0-142-230 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 22 03:05:31.892884 ip-10-0-142-230 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 98bb70c3f4ae4d6eb8b866f6d1975228 --
Jul 22 03:07:03.532073 ip-10-0-142-230 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 03:07:03.883936 ip-10-0-142-230 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 03:07:03.883936 ip-10-0-142-230 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 03:07:03.883936 ip-10-0-142-230 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 03:07:03.883936 ip-10-0-142-230 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 03:07:03.883936 ip-10-0-142-230 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 03:07:03.885016 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.884931    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 03:07:03.892927 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892900    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:07:03.892927 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892923    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:07:03.892927 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892927    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:07:03.892927 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892930    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:07:03.892927 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892933    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:07:03.892927 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892937    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892940    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892943    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892946    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892948    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892951    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892954    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892956    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892959    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892962    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892964    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892967    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892969    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892972    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892974    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892977    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892979    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892981    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892984    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:07:03.893169 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892986    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892989    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892991    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892993    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892996    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.892999    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893001    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893004    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893007    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893010    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893013    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893016    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893018    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893021    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893023    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893026    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893029    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893031    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893034    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:07:03.893623 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893036    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893038    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893043    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893047    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893050    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893053    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893056    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893059    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893062    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893064    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893067    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893069    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893071    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893074    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893076    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893079    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893089    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893093    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893095    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893098    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:07:03.894202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893101    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893104    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893106    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893109    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893111    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893114    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893116    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893121    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893125    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893128    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893130    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893148    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893152    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893155    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893158    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893163    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893166    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893169    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893171    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893174    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:07:03.894682 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893178    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893181    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893184    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893187    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893191    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893193    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893196    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893199    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893202    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893205    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893208    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893210    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893214    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893217    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893220    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893223    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893973    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893980    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893985    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893988    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:07:03.895217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893990    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893993    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893996    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.893998    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894001    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894004    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894006    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894009    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894011    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894013    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894016    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894019    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894021    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894025    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894028    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894030    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894033    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894036    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894038    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894041    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:07:03.895696 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894043    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894046    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894048    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894051    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894054    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894056    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894059    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894061    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894064    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894067    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894069    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894072    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894075    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894077    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894080    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894082    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894085    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894087    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894090    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894092    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:07:03.896206 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894095    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894097    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894099    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894102    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894104    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894107    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894109    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894112    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894115    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894118    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894120    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894122    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894125    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894127    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894129    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894132    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894135    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894137    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894140    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894142    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:07:03.896683 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894144    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894147    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894149    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894152    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894154    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894157    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894159    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894161    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894166    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894170    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894172    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894175    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894177    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894179    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894182    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894184    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894187    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894190    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894192    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894196    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:07:03.897202 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894199    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894203    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894220    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894224    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894227    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894230    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894233    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894237    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894240    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894243    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894246    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894250    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894253    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894256    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894258    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894642    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894646    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894649    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894652    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:07:03.897697 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894654    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894657    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894660    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894663    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894665    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894668    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894670    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894673    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894675    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894678    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894680    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894683    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894686    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894689    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894692    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894695    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894697    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894701    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894705    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:07:03.898176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894710    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894713    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894717    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894720    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894722    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894725    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894727    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894730    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894732    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894734    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894737    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894739    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894742    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894744    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894746    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894750    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894753    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894756    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894759    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894761    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:07:03.898617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894763    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894766    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894785    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894788    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894792    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894794    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894798    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894800    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894803    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894806    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894808    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894811    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894816    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894818    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894821    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894824    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894826    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894829    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894832    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:07:03.899105 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894834    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894836    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894839    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894841    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894844    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894848    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894850    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894853    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894855    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894858    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894860    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894862    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894865    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894867    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894870    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894873    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894875    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894878    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894880    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894883    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:07:03.899554 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894886    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894888    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894891    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894893    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894896    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894899    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894902    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894904    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894907    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894909    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894912    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894914    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894917    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894919    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894921    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894924    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.894926    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895004    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895011    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895020    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895028    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 03:07:03.900084 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895037    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895042    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895049    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895054    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895057    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895061    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895064    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895067    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895070    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895073    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895076    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895079    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895084    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895087    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895091    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895094    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895098    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895101    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895104    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895108    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895111    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895114    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895117    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895120    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 03:07:03.900573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895123    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895126    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895129    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895132    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895136    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895139    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895141    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895144    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895147    2571 flags.go:64] FLAG: --enable-server="true"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895150    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895154    2571 flags.go:64] FLAG: --event-burst="100"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895157    2571 flags.go:64] FLAG: --event-qps="50"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895160    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895164    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895167    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895171    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895174    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895177    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895180    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895183    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895185    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895189    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895192    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895195    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895199    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 03:07:03.901179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895202    2571 flags.go:64] FLAG: --feature-gates=""
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895206    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895209    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895212    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895215    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895218    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895221    2571 flags.go:64] FLAG: --help="false"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895224    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-142-230.ec2.internal"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895228    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895231    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895233    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895237    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895240    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895243    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895245    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895248    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895251    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895254    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895257    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895260    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895263    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895266    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895269    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895272    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 03:07:03.901819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895274    2571 flags.go:64] FLAG: --lock-file=""
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895277    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895280    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895283    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895293    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895296    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895299    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895302    2571 flags.go:64] FLAG: --logging-format="text"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895305    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895308    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895311    2571 flags.go:64] FLAG: --manifest-url=""
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895314    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895318    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895321    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895324    2571 flags.go:64] FLAG: --max-pods="110"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895328    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895330    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895333    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895336    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895339    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895341    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895344    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895352    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895355    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895358    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 03:07:03.902408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895360    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895363    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895368    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895371    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895375    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895378    2571 flags.go:64] FLAG: --port="10250"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895381    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895384    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09065251cf39c97ac"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895387    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895390    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895393    2571 flags.go:64] FLAG: --register-node="true"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895395    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895398    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895402    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895405    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895408    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895411    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895414    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895417    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895419    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895422    2571 flags.go:64] FLAG: --runonce="false"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895425    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895427    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895430    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895433    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 03:07:03.903029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895436    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895438    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895441    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895444    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895447    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895449    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895452    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895455    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895458    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895460    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895463    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895470    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895473    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895475    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895481    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895483    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895486    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895489    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895492    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895494    2571 flags.go:64] FLAG: --v="2"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895499    2571 flags.go:64] FLAG: --version="false"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895503    2571 flags.go:64] FLAG: --vmodule=""
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895507    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.895510    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895634    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:07:03.903669 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895638    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895641    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895643    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895646    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895648    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895652    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895654    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895657    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895659    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895662    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895665    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895668    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895672    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895675    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895677    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895680    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895683    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895685    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895691    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:07:03.904324 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895694    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895697    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895700    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895703    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895705    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895708    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895711    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895713    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895716    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895719    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895721    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895724    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895726    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895729    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895731    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895734    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895736    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895739    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895741    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895744    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:07:03.904794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895746    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895749    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895751    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895754    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895756    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895759    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895761    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895764    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895766    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895782    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895785    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895788    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895791    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895793    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895796    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895798    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895801    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895804    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895807    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895810    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:07:03.905289 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895813    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895815    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895818    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895821    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895823    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895826    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895828    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895831    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895833    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895837    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895840    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895842    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895845    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895847    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895850    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895852    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895854    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895857    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895859    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:07:03.905787 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895862    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895865    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895867    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895869    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895873    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895876    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895878    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895881    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895883    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895885    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895888    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895891    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895895    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895897    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895899    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895902    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895905    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895908    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895910    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:07:03.906244 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.895913    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.896607    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.904141    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.904167    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.905080    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.905096    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905160    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905165    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905168    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905172    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905174    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905178    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905182    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905186    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:07:03.906695 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905189    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905191    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905194    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905197    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905199    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905202    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905204    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905207    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905209    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905212    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905214    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905216    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905219    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905221    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905224    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905226    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905229    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905232    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905234    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905237    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:07:03.907073 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905239    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905249    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905252    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905254    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905257    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905259    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905262    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905264    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905267    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905269    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905271    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905274    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905276    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905280    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905284    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905287    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905289    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905292    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905296    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905298    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:07:03.907559 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905301    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905304    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905307    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905309    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905312    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905314    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905316    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905319    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905321    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905324    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905326    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905328    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905331    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905334    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905342    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905345    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905347    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905350    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905352    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905355    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:07:03.908136 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905357    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905360    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905362    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905364    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905367    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905369    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905372    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905374    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905377    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905379    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905382    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905385    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905389    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905392    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905395    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905397    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905400    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905402    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905404    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:07:03.908606 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905407    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905409    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905411    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905414    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905416    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905418    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905422    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905424    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905432    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905435    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905437    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905440    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.905445    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905604    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905609    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:07:03.909070 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905612    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905615    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905617    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905620    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905622    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905624    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905627    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905629    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905632    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905634    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905637    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905639    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905642    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905644    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905646    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905649    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905652    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905654    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905657    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905659    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905661    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:07:03.909442 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905664    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905666    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905668    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905671    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905675    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905684    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905687    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905690    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905692    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905695    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905698    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905701    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905703    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905706    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905708    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905711    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905713    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905716    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905718    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:07:03.909967 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905721    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905723    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905725    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905728    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905730    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905732    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905735    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905737    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905740    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905742    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905744    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905747    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905749    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905752    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905754    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905757    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905759    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905761    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905765    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905790    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:07:03.910420 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905794    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905797    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905799    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905802    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905805    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905807    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905809    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905812    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905814    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905817    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905819    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905822    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905824    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905827    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905829    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905831    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905834    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905836    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905839    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:07:03.910969 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905841    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905843    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905846    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905848    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905850    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905852    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905855    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905858    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905860    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905862    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905866    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905869    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905873    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905881    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905884    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905890    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905892    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:07:03.911418 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:03.905895    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:07:03.911832 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.905900    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 03:07:03.911832 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.906043    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 03:07:03.911832 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.908496    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 03:07:03.911832 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.910276    2571 server.go:1019] "Starting client certificate rotation"
Jul 22 03:07:03.911832 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.910379    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 03:07:03.911832 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.910441    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 03:07:03.913197 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.913182    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 03:07:03.922895 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.922865    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 03:07:03.931204 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.931183    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 22 03:07:03.933664 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.933644    2571 log.go:25] "Validated CRI v1 image API"
Jul 22 03:07:03.935440 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.935420    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 03:07:03.941213 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.941185    2571 fs.go:135] Filesystem UUIDs: map[46ad7e52-1c5e-4c6e-bdb4-c662c51d8740:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dbf0cd7f-d575-41f9-a3c6-b1678a56b37d:/dev/nvme0n1p4]
Jul 22 03:07:03.941213 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.941198    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 03:07:03.941213 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.941206    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 03:07:03.947404 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.947284    2571 manager.go:216] Machine: {Timestamp:2026-07-22 03:07:03.945800456 +0000 UTC m=+0.312436255 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088137 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a6d27f26b8861ebe4a8642b72628f SystemUUID:ec2a6d27-f26b-8861-ebe4-a8642b72628f BootID:98bb70c3-f4ae-4d6e-b8b8-66f6d1975228 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:85:4f:59:92:29 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:85:4f:59:92:29 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:e0:1b:30:c9:d4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 03:07:03.947404 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.947391    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 03:07:03.947568 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.947517    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 03:07:03.951062 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.951030    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 03:07:03.951214 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.951066    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-230.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 03:07:03.952628 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.952616    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 03:07:03.952665 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.952631    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 03:07:03.952665 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.952639    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 03:07:03.953472 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.953458    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 03:07:03.955339 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.955328    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 03:07:03.960213 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.960196    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 03:07:03.960538 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.960527    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 03:07:03.960571 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.960563    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 03:07:03.960601 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.960573    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 03:07:03.960601 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.960584    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 03:07:03.960601 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.960594    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 22 03:07:03.960701 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.960604    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 03:07:03.961095 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.961063    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 03:07:03.961159 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.961100    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 03:07:03.963553 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.963536    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 03:07:03.965868 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.965853    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 03:07:03.965943 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.965884    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 03:07:03.967339 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.967327    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 03:07:03.967373 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.967344    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 03:07:03.967373 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.967350    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 03:07:03.967373 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.967355    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 03:07:03.967373 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.967364    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 03:07:03.967373 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.967369    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 03:07:03.967505 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.967378    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 03:07:03.967505 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.967383    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 03:07:03.967505 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.967390    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 03:07:03.967505 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.967400    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 03:07:03.967505 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.967416    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 03:07:03.967505 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.967421    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 03:07:03.968346 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.968332    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 03:07:03.968378 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.968347    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 03:07:03.971882 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.971851    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-230.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 03:07:03.971882 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:03.971868    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 03:07:03.972014 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:03.971902    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-230.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 03:07:03.972466 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.972445    2571 server.go:1268] "Started kubelet"
Jul 22 03:07:03.972580 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.972515    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 03:07:03.972640 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.972542    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 03:07:03.972640 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.972634    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 03:07:03.973610 ip-10-0-142-230 systemd[1]: Started Kubernetes Kubelet.
Jul 22 03:07:03.975175 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.975157    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 03:07:03.978704 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.978685    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 03:07:03.979229 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:03.979202    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 03:07:03.984460 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:03.983389    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-230.ec2.internal.18c47dc1df337b15  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-230.ec2.internal,UID:ip-10-0-142-230.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-230.ec2.internal,},FirstTimestamp:2026-07-22 03:07:03.972412181 +0000 UTC m=+0.339047979,LastTimestamp:2026-07-22 03:07:03.972412181 +0000 UTC m=+0.339047979,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-230.ec2.internal,}"
Jul 22 03:07:03.986272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.986258    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 03:07:03.986342 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.986272    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 03:07:03.986455 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:03.986431    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:03.987069 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.987050    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 03:07:03.987069 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.987055    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 03:07:03.987195 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.987070    2571 factory.go:55] Registering systemd factory
Jul 22 03:07:03.987195 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.987082    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 03:07:03.987195 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.987089    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 22 03:07:03.987329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.987226    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 03:07:03.987329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.987234    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 03:07:03.987329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.987328    2571 factory.go:153] Registering CRI-O factory
Jul 22 03:07:03.987441 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.987341    2571 factory.go:223] Registration of the crio container factory successfully
Jul 22 03:07:03.987441 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.987425    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 03:07:03.987526 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.987452    2571 factory.go:103] Registering Raw factory
Jul 22 03:07:03.987526 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.987468    2571 manager.go:1196] Started watching for new ooms in manager
Jul 22 03:07:03.987947 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.987923    2571 manager.go:349] Starting recovery of all containers
Jul 22 03:07:03.996696 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.996510    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7dkls"
Jul 22 03:07:03.997953 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:03.997795    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-230.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 03:07:03.997953 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:03.997842    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 03:07:03.997953 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:03.997870    2571 manager.go:354] Recovery completed
Jul 22 03:07:03.999338 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:03.999307    2571 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 22 03:07:04.002281 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.002269    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:04.004180 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.004161    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:04.004272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.004192    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:04.004272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.004205    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:04.004272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.004249    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7dkls"
Jul 22 03:07:04.004758 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.004742    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 03:07:04.004840 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.004760    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 03:07:04.004840 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.004751    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:04.004895 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.004798    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 03:07:04.007645 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.007633    2571 policy_none.go:49] "None policy: Start"
Jul 22 03:07:04.007704 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.007649    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 03:07:04.007704 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.007659    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 03:07:04.008945 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.008925    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:04.009049 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.008968    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:04.009049 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.008984    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:04.010141 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.010120    2571 policy_none.go:47] "Start"
Jul 22 03:07:04.074460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.057357    2571 manager.go:337] "Starting Device Plugin manager"
Jul 22 03:07:04.074460 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.057389    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 03:07:04.074460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.057402    2571 server.go:87] "Starting device plugin registration server"
Jul 22 03:07:04.074460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.057659    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 03:07:04.074460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.057671    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 03:07:04.074460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.057756    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 03:07:04.074460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.057847    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 03:07:04.074460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.057855    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 03:07:04.074460 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.058423    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 03:07:04.074460 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.058470    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:04.096386 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.096350    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 03:07:04.097672 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.097652    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 03:07:04.097794 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.097684    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 03:07:04.097794 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.097704    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 03:07:04.097794 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.097732    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 03:07:04.100345 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.100324    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:07:04.158472 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.158403    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:04.159535 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.159509    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:04.159666 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.159545    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:04.159666 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.159562    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:04.159666 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.159592    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.171822 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.171802    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.171918 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.171827    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-230.ec2.internal\": node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:04.198087 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.198059    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"]
Jul 22 03:07:04.198220 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.198163    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:04.199654 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.199636    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:04.199758 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.199671    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:04.199758 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.199688    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:04.201994 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.201978    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:04.202120 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.202102    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.202168 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.202137    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:04.202719 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.202701    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:04.202820 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.202726    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:04.202820 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.202738    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:04.202820 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.202799    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:04.202940 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.202823    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:04.202940 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.202837    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:04.205120 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.205105    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.205173 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.205130    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:07:04.205758 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.205738    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:07:04.205865 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.205788    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:07:04.205865 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.205804    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:07:04.208590 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.208571    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:04.238506 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.238477    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-230.ec2.internal\" not found" node="ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.242896 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.242879    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-230.ec2.internal\" not found" node="ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.289261 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.289231    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db9deb56d95fa00b38123d69f9218188-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal\" (UID: \"db9deb56d95fa00b38123d69f9218188\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.289261 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.289261    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db9deb56d95fa00b38123d69f9218188-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal\" (UID: \"db9deb56d95fa00b38123d69f9218188\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.289430 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.289281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c889aaddab9faf6ffb9b70fddbe250d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-230.ec2.internal\" (UID: \"5c889aaddab9faf6ffb9b70fddbe250d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.309680 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.309648    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:04.390369 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.390329    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db9deb56d95fa00b38123d69f9218188-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal\" (UID: \"db9deb56d95fa00b38123d69f9218188\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.390369 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.390283    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db9deb56d95fa00b38123d69f9218188-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal\" (UID: \"db9deb56d95fa00b38123d69f9218188\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.390551 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.390397    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db9deb56d95fa00b38123d69f9218188-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal\" (UID: \"db9deb56d95fa00b38123d69f9218188\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.390551 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.390416    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c889aaddab9faf6ffb9b70fddbe250d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-230.ec2.internal\" (UID: \"5c889aaddab9faf6ffb9b70fddbe250d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.390551 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.390465    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c889aaddab9faf6ffb9b70fddbe250d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-230.ec2.internal\" (UID: \"5c889aaddab9faf6ffb9b70fddbe250d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.390551 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.390489    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db9deb56d95fa00b38123d69f9218188-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal\" (UID: \"db9deb56d95fa00b38123d69f9218188\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.410432 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.410378    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:04.511317 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.511278    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:04.541495 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.541458    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.545451 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.545427    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:04.612295 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.612261    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:04.712823 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.712738    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:04.813331 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.813301    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:04.909072 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.909034    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 03:07:04.909655 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:04.909195    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 03:07:04.914202 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:04.914181    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:05.010012 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.009922    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 03:02:04 +0000 UTC" deadline="2028-02-28 23:20:13.555322194 +0000 UTC"
Jul 22 03:07:05.010012 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.009953    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14084h13m8.54537201s"
Jul 22 03:07:05.015082 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:05.015063    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:05.100054 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.100025    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:07:05.115991 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:05.115968    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:05.143733 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.143708    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:07:05.216618 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:05.216583    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-230.ec2.internal\" not found"
Jul 22 03:07:05.255806 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.255757    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:07:05.286952 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.286882    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:05.307176 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:05.307146    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c889aaddab9faf6ffb9b70fddbe250d.slice/crio-da6941e8d04cb14818b4df8a97156fa52b21e38159c7c70bca4d280478c4a669 WatchSource:0}: Error finding container da6941e8d04cb14818b4df8a97156fa52b21e38159c7c70bca4d280478c4a669: Status 404 returned error can't find the container with id da6941e8d04cb14818b4df8a97156fa52b21e38159c7c70bca4d280478c4a669
Jul 22 03:07:05.307691 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:05.307668    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9deb56d95fa00b38123d69f9218188.slice/crio-cc1305b260c169b2d0a3ac2fee57e1d35ec1541e35243b714c6cd983ae8f0569 WatchSource:0}: Error finding container cc1305b260c169b2d0a3ac2fee57e1d35ec1541e35243b714c6cd983ae8f0569: Status 404 returned error can't find the container with id cc1305b260c169b2d0a3ac2fee57e1d35ec1541e35243b714c6cd983ae8f0569
Jul 22 03:07:05.315318 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.315301    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:07:05.320354 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.320338    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 03:07:05.321420 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.321407    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal"
Jul 22 03:07:05.344124 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.344105    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 03:07:05.786811 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.786767    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:07:05.962287 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.962205    2571 apiserver.go:52] "Watching apiserver"
Jul 22 03:07:05.971684 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.971655    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 03:07:05.972071 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.972046    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-64nk5","kube-system/konnectivity-agent-fzscs","kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal","openshift-cluster-node-tuning-operator/tuned-gmk89","openshift-dns/node-resolver-nkwt5","openshift-image-registry/node-ca-nnsvz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal","openshift-multus/multus-bfsfs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7","openshift-multus/multus-additional-cni-plugins-ppgrm","openshift-multus/network-metrics-daemon-ggt8f","openshift-network-diagnostics/network-check-target-8hkl6","openshift-network-operator/iptables-alerter-g6lcg","openshift-ovn-kubernetes/ovnkube-node-q7ns8"]
Jul 22 03:07:05.976171 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.976154    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:05.978442 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.978423    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g6lcg"
Jul 22 03:07:05.979455 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.979428    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 03:07:05.979455 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.979447    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 03:07:05.979455 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.979439    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qc4g7\""
Jul 22 03:07:05.979694 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.979465    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 03:07:05.979694 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.979480    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 03:07:05.979694 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.979455    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 03:07:05.981285 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.981244    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:07:05.981285 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.981275    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n27g6\""
Jul 22 03:07:05.981485 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.981316    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 03:07:05.981485 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.981336    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:05.981594 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.981548    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 03:07:05.983720 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.983703    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:05.986179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.986160    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nkwt5"
Jul 22 03:07:05.986593 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.986572    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 03:07:05.988036 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.988015    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 03:07:05.988227 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.988205    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 03:07:05.988304 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.988275    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 03:07:05.988363 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.988314    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 03:07:05.989016 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.988948    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nnsvz"
Jul 22 03:07:05.991612 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.990996    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 03:07:05.991612 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.991070    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ft5h7\""
Jul 22 03:07:05.991612 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.991184    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 03:07:05.991612 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.991193    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:07:05.991612 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.991253    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 03:07:05.991612 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.991275    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 03:07:05.991612 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.991522    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n49s5\""
Jul 22 03:07:05.991612 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.991578    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l6phf\""
Jul 22 03:07:05.992103 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.992001    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 03:07:05.992103 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.992062    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:05.994923 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.994904    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 03:07:05.995029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.995004    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:05.995708 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.995690    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 03:07:05.997387 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.997369    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fzscs"
Jul 22 03:07:05.998460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.998442    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 03:07:05.998790 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.998771    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-864pd\""
Jul 22 03:07:05.998959 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.998939    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 03:07:05.999048 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.998818    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 03:07:05.999048 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.998828    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v2wvj\""
Jul 22 03:07:05.999048 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.998857    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 03:07:05.999205 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.998848    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 03:07:05.999205 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.999115    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gwx5k\""
Jul 22 03:07:05.999797 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:05.999758    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:05.999885 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:05.999849    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:06.000040 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000022    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 03:07:06.000112 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000038    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f2gv4\""
Jul 22 03:07:06.000364 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000347    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 03:07:06.000475 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000456    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d09ef900-140e-47ef-91a0-5e325001248c-tmp-dir\") pod \"node-resolver-nkwt5\" (UID: \"d09ef900-140e-47ef-91a0-5e325001248c\") " pod="openshift-dns/node-resolver-nkwt5"
Jul 22 03:07:06.000524 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000486    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1a6d5075-10f2-4d3b-9462-0d22b9c76bae-serviceca\") pod \"node-ca-nnsvz\" (UID: \"1a6d5075-10f2-4d3b-9462-0d22b9c76bae\") " pod="openshift-image-registry/node-ca-nnsvz"
Jul 22 03:07:06.000524 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000505    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc28r\" (UniqueName: \"kubernetes.io/projected/1a6d5075-10f2-4d3b-9462-0d22b9c76bae-kube-api-access-kc28r\") pod \"node-ca-nnsvz\" (UID: \"1a6d5075-10f2-4d3b-9462-0d22b9c76bae\") " pod="openshift-image-registry/node-ca-nnsvz"
Jul 22 03:07:06.000619 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000530    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b85ee724-9b31-4152-92e9-17bf4f22e994-cnibin\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.000619 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000573    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04a330b1-fc40-4454-aebd-8a4c51ce553c-host-slash\") pod \"iptables-alerter-g6lcg\" (UID: \"04a330b1-fc40-4454-aebd-8a4c51ce553c\") " pod="openshift-network-operator/iptables-alerter-g6lcg"
Jul 22 03:07:06.000619 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000601    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-var-lib-openvswitch\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.000782 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000665    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-cni-bin\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.000782 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000706    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-sysctl-d\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.000782 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000732    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/401a5450-7329-4c03-a753-e51f1e02fb3d-tmp\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.000782 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000760    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsr8c\" (UniqueName: \"kubernetes.io/projected/d09ef900-140e-47ef-91a0-5e325001248c-kube-api-access-zsr8c\") pod \"node-resolver-nkwt5\" (UID: \"d09ef900-140e-47ef-91a0-5e325001248c\") " pod="openshift-dns/node-resolver-nkwt5"
Jul 22 03:07:06.001004 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000851    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-systemd-units\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001004 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000880    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-slash\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001004 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000906    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-run-systemd\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001004 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.000952    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11a8a2c5-aadd-489a-be61-667345f173aa-env-overrides\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001188 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001002    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11a8a2c5-aadd-489a-be61-667345f173aa-ovnkube-script-lib\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001188 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001039    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b85ee724-9b31-4152-92e9-17bf4f22e994-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.001188 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001072    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqkpb\" (UniqueName: \"kubernetes.io/projected/b85ee724-9b31-4152-92e9-17bf4f22e994-kube-api-access-cqkpb\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.001188 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001101    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04a330b1-fc40-4454-aebd-8a4c51ce553c-iptables-alerter-script\") pod \"iptables-alerter-g6lcg\" (UID: \"04a330b1-fc40-4454-aebd-8a4c51ce553c\") " pod="openshift-network-operator/iptables-alerter-g6lcg"
Jul 22 03:07:06.001188 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001128    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-run-ovn\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001188 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001155    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11a8a2c5-aadd-489a-be61-667345f173aa-ovn-node-metrics-cert\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001188 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001180    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d09ef900-140e-47ef-91a0-5e325001248c-hosts-file\") pod \"node-resolver-nkwt5\" (UID: \"d09ef900-140e-47ef-91a0-5e325001248c\") " pod="openshift-dns/node-resolver-nkwt5"
Jul 22 03:07:06.001498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001199    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a6d5075-10f2-4d3b-9462-0d22b9c76bae-host\") pod \"node-ca-nnsvz\" (UID: \"1a6d5075-10f2-4d3b-9462-0d22b9c76bae\") " pod="openshift-image-registry/node-ca-nnsvz"
Jul 22 03:07:06.001498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001227    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b85ee724-9b31-4152-92e9-17bf4f22e994-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.001498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001248    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-etc-openvswitch\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001303    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-node-log\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001321    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-modprobe-d\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.001498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001336    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-run\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.001498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001354    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njhvb\" (UniqueName: \"kubernetes.io/projected/401a5450-7329-4c03-a753-e51f1e02fb3d-kube-api-access-njhvb\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.001498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001390    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b85ee724-9b31-4152-92e9-17bf4f22e994-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.001498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001422    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-log-socket\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001447    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-cni-netd\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001462    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11a8a2c5-aadd-489a-be61-667345f173aa-ovnkube-config\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001476    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-systemd\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.001498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001491    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-lib-modules\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001514    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-var-lib-kubelet\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001541    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b85ee724-9b31-4152-92e9-17bf4f22e994-system-cni-dir\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001564    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b85ee724-9b31-4152-92e9-17bf4f22e994-os-release\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w86n\" (UniqueName: \"kubernetes.io/projected/04a330b1-fc40-4454-aebd-8a4c51ce553c-kube-api-access-4w86n\") pod \"iptables-alerter-g6lcg\" (UID: \"04a330b1-fc40-4454-aebd-8a4c51ce553c\") " pod="openshift-network-operator/iptables-alerter-g6lcg"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001648    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr8vv\" (UniqueName: \"kubernetes.io/projected/11a8a2c5-aadd-489a-be61-667345f173aa-kube-api-access-lr8vv\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001675    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-run-netns\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001702    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-run-openvswitch\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001718    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-sysconfig\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001737    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-kubernetes\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001760    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-sysctl-conf\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001777    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-sys\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001814    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-host\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001829    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-tuned\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001849    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b85ee724-9b31-4152-92e9-17bf4f22e994-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.001939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001868    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-kubelet\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.002707 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.001910    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.002707 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.002292    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:06.002707 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.002373    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:06.003191 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.003171    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 03:07:06.004769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.004751    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:06.004868 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.004845    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:06.031745 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.031717    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6w5n6"
Jul 22 03:07:06.041318 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.041299    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6w5n6"
Jul 22 03:07:06.089079 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.089051    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 03:07:06.102149 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102105    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b85ee724-9b31-4152-92e9-17bf4f22e994-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.102149 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-run-ovn\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102178    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d09ef900-140e-47ef-91a0-5e325001248c-hosts-file\") pod \"node-resolver-nkwt5\" (UID: \"d09ef900-140e-47ef-91a0-5e325001248c\") " pod="openshift-dns/node-resolver-nkwt5"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102198    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102216    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102232    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-hostroot\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102250    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b85ee724-9b31-4152-92e9-17bf4f22e994-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102265    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-run\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102283    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njhvb\" (UniqueName: \"kubernetes.io/projected/401a5450-7329-4c03-a753-e51f1e02fb3d-kube-api-access-njhvb\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102298    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-var-lib-cni-bin\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102313    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-log-socket\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102330    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11a8a2c5-aadd-489a-be61-667345f173aa-ovnkube-config\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102345    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-var-lib-kubelet\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102361    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-run-multus-certs\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102377    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-var-lib-kubelet\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.102388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-sysconfig\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.103194 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-sysctl-conf\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.103194 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102709    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-sys\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.103194 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102746    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-host\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.103194 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102786    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1a6d5075-10f2-4d3b-9462-0d22b9c76bae-serviceca\") pod \"node-ca-nnsvz\" (UID: \"1a6d5075-10f2-4d3b-9462-0d22b9c76bae\") " pod="openshift-image-registry/node-ca-nnsvz"
Jul 22 03:07:06.103194 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102828    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc28r\" (UniqueName: \"kubernetes.io/projected/1a6d5075-10f2-4d3b-9462-0d22b9c76bae-kube-api-access-kc28r\") pod \"node-ca-nnsvz\" (UID: \"1a6d5075-10f2-4d3b-9462-0d22b9c76bae\") " pod="openshift-image-registry/node-ca-nnsvz"
Jul 22 03:07:06.103194 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102850    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-run-netns\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.103194 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102879    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b85ee724-9b31-4152-92e9-17bf4f22e994-cnibin\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.103194 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102901    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-var-lib-openvswitch\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.103194 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102919    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsr8c\" (UniqueName: \"kubernetes.io/projected/d09ef900-140e-47ef-91a0-5e325001248c-kube-api-access-zsr8c\") pod \"node-resolver-nkwt5\" (UID: \"d09ef900-140e-47ef-91a0-5e325001248c\") " pod="openshift-dns/node-resolver-nkwt5"
Jul 22 03:07:06.103194 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.102949    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-device-dir\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.103194 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103121    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-sys-fs\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.103194 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103144    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a2003ad5-56cf-4f9d-ba75-6942465b7515-agent-certs\") pod \"konnectivity-agent-fzscs\" (UID: \"a2003ad5-56cf-4f9d-ba75-6942465b7515\") " pod="kube-system/konnectivity-agent-fzscs"
Jul 22 03:07:06.103194 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103170    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-run-systemd\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.103770 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103205    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11a8a2c5-aadd-489a-be61-667345f173aa-env-overrides\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.103770 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11a8a2c5-aadd-489a-be61-667345f173aa-ovnkube-script-lib\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.103770 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103272    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.103770 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103306    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ccea7c5f-cfab-49de-9384-e977f53364b1-cni-binary-copy\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.103770 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103489    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqkpb\" (UniqueName: \"kubernetes.io/projected/b85ee724-9b31-4152-92e9-17bf4f22e994-kube-api-access-cqkpb\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.103770 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103537    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04a330b1-fc40-4454-aebd-8a4c51ce553c-iptables-alerter-script\") pod \"iptables-alerter-g6lcg\" (UID: \"04a330b1-fc40-4454-aebd-8a4c51ce553c\") " pod="openshift-network-operator/iptables-alerter-g6lcg"
Jul 22 03:07:06.103770 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103568    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11a8a2c5-aadd-489a-be61-667345f173aa-ovn-node-metrics-cert\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.103770 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103603    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a6d5075-10f2-4d3b-9462-0d22b9c76bae-host\") pod \"node-ca-nnsvz\" (UID: \"1a6d5075-10f2-4d3b-9462-0d22b9c76bae\") " pod="openshift-image-registry/node-ca-nnsvz"
Jul 22 03:07:06.103770 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103634    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-etc-openvswitch\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.104234 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103842    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-node-log\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.104234 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103901    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-modprobe-d\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.104234 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103931    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-socket-dir\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.104234 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103966    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-registration-dir\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.104234 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.103999    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca554050-1a54-4d4a-86ac-fe03455e9bef-kubelet-config\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:06.104234 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104039    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:06.104234 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104069    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-cnibin\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.104575 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104299    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b85ee724-9b31-4152-92e9-17bf4f22e994-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.104575 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104336    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-cni-netd\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.104575 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104369    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-systemd\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.104575 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104404    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-lib-modules\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.104575 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104428    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8hlq\" (UniqueName: \"kubernetes.io/projected/7067f007-63eb-4ec1-93b0-2d8393994233-kube-api-access-c8hlq\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:06.104575 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104448    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b58r\" (UniqueName: \"kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r\") pod \"network-check-target-8hkl6\" (UID: \"caa42fdc-cc77-4d75-9fb0-082c328be3bc\") " pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:06.104575 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104472    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-multus-cni-dir\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.104957 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104579    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-run-k8s-cni-cncf-io\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.104957 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b85ee724-9b31-4152-92e9-17bf4f22e994-system-cni-dir\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.104957 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104654    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b85ee724-9b31-4152-92e9-17bf4f22e994-os-release\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.104957 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104690    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w86n\" (UniqueName: \"kubernetes.io/projected/04a330b1-fc40-4454-aebd-8a4c51ce553c-kube-api-access-4w86n\") pod \"iptables-alerter-g6lcg\" (UID: \"04a330b1-fc40-4454-aebd-8a4c51ce553c\") " pod="openshift-network-operator/iptables-alerter-g6lcg"
Jul 22 03:07:06.104957 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104724    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.104957 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104747    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr8vv\" (UniqueName: \"kubernetes.io/projected/11a8a2c5-aadd-489a-be61-667345f173aa-kube-api-access-lr8vv\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.104957 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104767    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ccea7c5f-cfab-49de-9384-e977f53364b1-multus-daemon-config\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.104957 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104785    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc4fx\" (UniqueName: \"kubernetes.io/projected/ccea7c5f-cfab-49de-9384-e977f53364b1-kube-api-access-rc4fx\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.105317 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.104818    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-run-netns\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.105448 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.105298    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-run-openvswitch\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.105540 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.105473    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-kubernetes\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.105540 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.105503    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-tuned\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.105632 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.105544    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-var-lib-cni-multus\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.105632 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.105580    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-multus-conf-dir\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.105632 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.105616    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b85ee724-9b31-4152-92e9-17bf4f22e994-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.105769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.105651    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-kubelet\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.105882 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.105864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.105953 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.105906    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d09ef900-140e-47ef-91a0-5e325001248c-tmp-dir\") pod \"node-resolver-nkwt5\" (UID: \"d09ef900-140e-47ef-91a0-5e325001248c\") " pod="openshift-dns/node-resolver-nkwt5"
Jul 22 03:07:06.105953 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.105942    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04a330b1-fc40-4454-aebd-8a4c51ce553c-host-slash\") pod \"iptables-alerter-g6lcg\" (UID: \"04a330b1-fc40-4454-aebd-8a4c51ce553c\") " pod="openshift-network-operator/iptables-alerter-g6lcg"
Jul 22 03:07:06.106051 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.105979    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-cni-bin\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.106051 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.106011    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-sysctl-d\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.106051 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.106045    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/401a5450-7329-4c03-a753-e51f1e02fb3d-tmp\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.106189 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.106081    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dnd7\" (UniqueName: \"kubernetes.io/projected/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-kube-api-access-6dnd7\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.106189 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.106115    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca554050-1a54-4d4a-86ac-fe03455e9bef-dbus\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:06.106189 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.106143    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-system-cni-dir\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.106189 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.106180    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-systemd-units\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.106375 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.106215    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-slash\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.106375 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.106252    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a2003ad5-56cf-4f9d-ba75-6942465b7515-konnectivity-ca\") pod \"konnectivity-agent-fzscs\" (UID: \"a2003ad5-56cf-4f9d-ba75-6942465b7515\") " pod="kube-system/konnectivity-agent-fzscs"
Jul 22 03:07:06.106375 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.106286    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-os-release\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.107269 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.107040    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b85ee724-9b31-4152-92e9-17bf4f22e994-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.107269 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.107167    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-run-ovn\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.107269 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.107236    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d09ef900-140e-47ef-91a0-5e325001248c-hosts-file\") pod \"node-resolver-nkwt5\" (UID: \"d09ef900-140e-47ef-91a0-5e325001248c\") " pod="openshift-dns/node-resolver-nkwt5"
Jul 22 03:07:06.109944 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.109916    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b85ee724-9b31-4152-92e9-17bf4f22e994-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.110069 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.110019    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-run\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.110422 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.110402    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-log-socket\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.110912 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.110886    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-var-lib-kubelet\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.111016 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.110996    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-sysconfig\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.111074 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.111016    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11a8a2c5-aadd-489a-be61-667345f173aa-ovnkube-config\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.111130 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.111113    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-sys\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.111185 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.111147    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-sysctl-conf\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.111185 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.111171    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-host\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.111692 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.111540    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b85ee724-9b31-4152-92e9-17bf4f22e994-cnibin\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.111692 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.111581    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1a6d5075-10f2-4d3b-9462-0d22b9c76bae-serviceca\") pod \"node-ca-nnsvz\" (UID: \"1a6d5075-10f2-4d3b-9462-0d22b9c76bae\") " pod="openshift-image-registry/node-ca-nnsvz"
Jul 22 03:07:06.111692 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.111601    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-var-lib-openvswitch\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.112059 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.112033    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-run-systemd\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.112555 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.112531    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11a8a2c5-aadd-489a-be61-667345f173aa-env-overrides\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.112705 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.112680    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a6d5075-10f2-4d3b-9462-0d22b9c76bae-host\") pod \"node-ca-nnsvz\" (UID: \"1a6d5075-10f2-4d3b-9462-0d22b9c76bae\") " pod="openshift-image-registry/node-ca-nnsvz"
Jul 22 03:07:06.112801 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.112750    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-etc-openvswitch\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.112867 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.112815    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-node-log\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.112867 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.112847    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11a8a2c5-aadd-489a-be61-667345f173aa-ovnkube-script-lib\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.112973 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.112940    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-modprobe-d\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.113032 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.112997    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 03:07:06.113098 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.113075    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-cni-netd\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.113176 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.113158    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-systemd\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.113230 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.113199    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04a330b1-fc40-4454-aebd-8a4c51ce553c-iptables-alerter-script\") pod \"iptables-alerter-g6lcg\" (UID: \"04a330b1-fc40-4454-aebd-8a4c51ce553c\") " pod="openshift-network-operator/iptables-alerter-g6lcg"
Jul 22 03:07:06.113313 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.113295    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-lib-modules\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.113386 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.113364    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-kubelet\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.115697 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.115664    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b85ee724-9b31-4152-92e9-17bf4f22e994-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.115801 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.115723    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.115896 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.115841    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04a330b1-fc40-4454-aebd-8a4c51ce553c-host-slash\") pod \"iptables-alerter-g6lcg\" (UID: \"04a330b1-fc40-4454-aebd-8a4c51ce553c\") " pod="openshift-network-operator/iptables-alerter-g6lcg"
Jul 22 03:07:06.115896 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.115888    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b85ee724-9b31-4152-92e9-17bf4f22e994-system-cni-dir\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.116018 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.115931    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-cni-bin\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.116018 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.115956    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b85ee724-9b31-4152-92e9-17bf4f22e994-cni-binary-copy\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.116018 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.115991    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b85ee724-9b31-4152-92e9-17bf4f22e994-os-release\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.116152 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.116035    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d09ef900-140e-47ef-91a0-5e325001248c-tmp-dir\") pod \"node-resolver-nkwt5\" (UID: \"d09ef900-140e-47ef-91a0-5e325001248c\") " pod="openshift-dns/node-resolver-nkwt5"
Jul 22 03:07:06.116152 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.116107    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-sysctl-d\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.116315 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.116267    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal" event={"ID":"5c889aaddab9faf6ffb9b70fddbe250d","Type":"ContainerStarted","Data":"da6941e8d04cb14818b4df8a97156fa52b21e38159c7c70bca4d280478c4a669"}
Jul 22 03:07:06.116370 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.116311    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.116582 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.116564    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-run-netns\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.116643 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.116614    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-run-openvswitch\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.116700 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.116653    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-systemd-units\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.116760 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.116706    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-kubernetes\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.116970 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.116952    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11a8a2c5-aadd-489a-be61-667345f173aa-host-slash\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.117039 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.116999    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-multus-socket-dir-parent\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.117039 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.117030    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-etc-kubernetes\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.120578 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.120552    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/401a5450-7329-4c03-a753-e51f1e02fb3d-etc-tuned\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.121615 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.121588    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal" event={"ID":"db9deb56d95fa00b38123d69f9218188","Type":"ContainerStarted","Data":"cc1305b260c169b2d0a3ac2fee57e1d35ec1541e35243b714c6cd983ae8f0569"}
Jul 22 03:07:06.123128 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.123067    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njhvb\" (UniqueName: \"kubernetes.io/projected/401a5450-7329-4c03-a753-e51f1e02fb3d-kube-api-access-njhvb\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.124660 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.124635    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/401a5450-7329-4c03-a753-e51f1e02fb3d-tmp\") pod \"tuned-gmk89\" (UID: \"401a5450-7329-4c03-a753-e51f1e02fb3d\") " pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.126198 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.126155    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc28r\" (UniqueName: \"kubernetes.io/projected/1a6d5075-10f2-4d3b-9462-0d22b9c76bae-kube-api-access-kc28r\") pod \"node-ca-nnsvz\" (UID: \"1a6d5075-10f2-4d3b-9462-0d22b9c76bae\") " pod="openshift-image-registry/node-ca-nnsvz"
Jul 22 03:07:06.127142 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.127098    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqkpb\" (UniqueName: \"kubernetes.io/projected/b85ee724-9b31-4152-92e9-17bf4f22e994-kube-api-access-cqkpb\") pod \"multus-additional-cni-plugins-ppgrm\" (UID: \"b85ee724-9b31-4152-92e9-17bf4f22e994\") " pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.127794 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.127769    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr8vv\" (UniqueName: \"kubernetes.io/projected/11a8a2c5-aadd-489a-be61-667345f173aa-kube-api-access-lr8vv\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.128084 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.128061    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11a8a2c5-aadd-489a-be61-667345f173aa-ovn-node-metrics-cert\") pod \"ovnkube-node-q7ns8\" (UID: \"11a8a2c5-aadd-489a-be61-667345f173aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.128171 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.128125    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsr8c\" (UniqueName: \"kubernetes.io/projected/d09ef900-140e-47ef-91a0-5e325001248c-kube-api-access-zsr8c\") pod \"node-resolver-nkwt5\" (UID: \"d09ef900-140e-47ef-91a0-5e325001248c\") " pod="openshift-dns/node-resolver-nkwt5"
Jul 22 03:07:06.129677 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.129654    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w86n\" (UniqueName: \"kubernetes.io/projected/04a330b1-fc40-4454-aebd-8a4c51ce553c-kube-api-access-4w86n\") pod \"iptables-alerter-g6lcg\" (UID: \"04a330b1-fc40-4454-aebd-8a4c51ce553c\") " pod="openshift-network-operator/iptables-alerter-g6lcg"
Jul 22 03:07:06.218245 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.218245 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218219    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ccea7c5f-cfab-49de-9384-e977f53364b1-cni-binary-copy\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.218480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218253    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-socket-dir\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.218480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218279    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-registration-dir\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.218480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218307    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca554050-1a54-4d4a-86ac-fe03455e9bef-kubelet-config\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:06.218480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:06.218480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218358    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-cnibin\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.218480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218397    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8hlq\" (UniqueName: \"kubernetes.io/projected/7067f007-63eb-4ec1-93b0-2d8393994233-kube-api-access-c8hlq\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:06.218480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218423    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b58r\" (UniqueName: \"kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r\") pod \"network-check-target-8hkl6\" (UID: \"caa42fdc-cc77-4d75-9fb0-082c328be3bc\") " pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:06.218480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218445    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-multus-cni-dir\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.218480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218469    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-run-k8s-cni-cncf-io\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.218769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218499    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ccea7c5f-cfab-49de-9384-e977f53364b1-multus-daemon-config\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.218769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218500    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-registration-dir\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.218769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218524    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc4fx\" (UniqueName: \"kubernetes.io/projected/ccea7c5f-cfab-49de-9384-e977f53364b1-kube-api-access-rc4fx\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.218769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218547    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.218769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-var-lib-cni-multus\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.218769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218591    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-multus-conf-dir\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.218769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218636    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca554050-1a54-4d4a-86ac-fe03455e9bef-kubelet-config\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:06.218769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218651    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dnd7\" (UniqueName: \"kubernetes.io/projected/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-kube-api-access-6dnd7\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.218769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218679    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca554050-1a54-4d4a-86ac-fe03455e9bef-dbus\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:06.218769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-cnibin\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.218769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218706    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-system-cni-dir\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.218769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218735    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a2003ad5-56cf-4f9d-ba75-6942465b7515-konnectivity-ca\") pod \"konnectivity-agent-fzscs\" (UID: \"a2003ad5-56cf-4f9d-ba75-6942465b7515\") " pod="kube-system/konnectivity-agent-fzscs"
Jul 22 03:07:06.218769 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218769    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-os-release\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218814    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-multus-socket-dir-parent\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218838    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-etc-kubernetes\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218868    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.219329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218891    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:06.219329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218901    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-run-k8s-cni-cncf-io\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218916    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-hostroot\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218969    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-var-lib-cni-bin\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218990    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-run-multus-certs\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219008    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-var-lib-kubelet\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219031    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-run-netns\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219050    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-device-dir\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.219329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-sys-fs\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.219329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219087    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a2003ad5-56cf-4f9d-ba75-6942465b7515-agent-certs\") pod \"konnectivity-agent-fzscs\" (UID: \"a2003ad5-56cf-4f9d-ba75-6942465b7515\") " pod="kube-system/konnectivity-agent-fzscs"
Jul 22 03:07:06.219914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219518    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ccea7c5f-cfab-49de-9384-e977f53364b1-cni-binary-copy\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219518    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ccea7c5f-cfab-49de-9384-e977f53364b1-multus-daemon-config\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219635    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-socket-dir\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.219914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219679    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-multus-conf-dir\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.218593    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-var-lib-cni-multus\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219777    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-var-lib-kubelet\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219764    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-multus-cni-dir\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219823    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-var-lib-cni-bin\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219850    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-run-netns\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219890    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-host-run-multus-certs\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.219914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219906    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-device-dir\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.220459 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.219950    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:06.220459 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219960    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-multus-socket-dir-parent\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.220459 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219990    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-system-cni-dir\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.220459 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.220036    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs podName:7067f007-63eb-4ec1-93b0-2d8393994233 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:06.719994982 +0000 UTC m=+3.086630797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs") pod "network-metrics-daemon-ggt8f" (UID: "7067f007-63eb-4ec1-93b0-2d8393994233") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:06.220459 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.220055    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-os-release\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.220459 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.220072    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-etc-kubernetes\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.220459 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.220119    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca554050-1a54-4d4a-86ac-fe03455e9bef-dbus\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:06.220459 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.220165    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.220459 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.219949    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-sys-fs\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.220459 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.220362    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:06.220459 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.220401    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ccea7c5f-cfab-49de-9384-e977f53364b1-hostroot\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.220459 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.220412    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret podName:ca554050-1a54-4d4a-86ac-fe03455e9bef nodeName:}" failed. No retries permitted until 2026-07-22 03:07:06.720396034 +0000 UTC m=+3.087031822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret") pod "global-pull-secret-syncer-64nk5" (UID: "ca554050-1a54-4d4a-86ac-fe03455e9bef") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:06.221105 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.220572    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a2003ad5-56cf-4f9d-ba75-6942465b7515-konnectivity-ca\") pod \"konnectivity-agent-fzscs\" (UID: \"a2003ad5-56cf-4f9d-ba75-6942465b7515\") " pod="kube-system/konnectivity-agent-fzscs"
Jul 22 03:07:06.226184 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.222556    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a2003ad5-56cf-4f9d-ba75-6942465b7515-agent-certs\") pod \"konnectivity-agent-fzscs\" (UID: \"a2003ad5-56cf-4f9d-ba75-6942465b7515\") " pod="kube-system/konnectivity-agent-fzscs"
Jul 22 03:07:06.230113 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.230082    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:07:06.230113 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.230109    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:07:06.230353 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.230123    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5b58r for pod openshift-network-diagnostics/network-check-target-8hkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:06.230353 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.230186    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r podName:caa42fdc-cc77-4d75-9fb0-082c328be3bc nodeName:}" failed. No retries permitted until 2026-07-22 03:07:06.7301677 +0000 UTC m=+3.096803489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5b58r" (UniqueName: "kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r") pod "network-check-target-8hkl6" (UID: "caa42fdc-cc77-4d75-9fb0-082c328be3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:06.233689 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.233657    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8hlq\" (UniqueName: \"kubernetes.io/projected/7067f007-63eb-4ec1-93b0-2d8393994233-kube-api-access-c8hlq\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:06.237910 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.237719    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dnd7\" (UniqueName: \"kubernetes.io/projected/d5e1f25e-6f77-46ac-9e41-a984a059e3cf-kube-api-access-6dnd7\") pod \"aws-ebs-csi-driver-node-5lpz7\" (UID: \"d5e1f25e-6f77-46ac-9e41-a984a059e3cf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.238562 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.238536    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc4fx\" (UniqueName: \"kubernetes.io/projected/ccea7c5f-cfab-49de-9384-e977f53364b1-kube-api-access-rc4fx\") pod \"multus-bfsfs\" (UID: \"ccea7c5f-cfab-49de-9384-e977f53364b1\") " pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.287059 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.287016    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ppgrm"
Jul 22 03:07:06.295408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.295383    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g6lcg"
Jul 22 03:07:06.303874 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:06.303841    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb85ee724_9b31_4152_92e9_17bf4f22e994.slice/crio-b819e5267fe6e5322a9d01924d85290c8f6616482c4c32832548810cd3a32d8e WatchSource:0}: Error finding container b819e5267fe6e5322a9d01924d85290c8f6616482c4c32832548810cd3a32d8e: Status 404 returned error can't find the container with id b819e5267fe6e5322a9d01924d85290c8f6616482c4c32832548810cd3a32d8e
Jul 22 03:07:06.304709 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.304663    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:06.307734 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.307715    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gmk89"
Jul 22 03:07:06.309004 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:06.308973    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a330b1_fc40_4454_aebd_8a4c51ce553c.slice/crio-a4344eaab37871d0bd9d9369d4a57de01f63e19e31588884793ff8ede20870fd WatchSource:0}: Error finding container a4344eaab37871d0bd9d9369d4a57de01f63e19e31588884793ff8ede20870fd: Status 404 returned error can't find the container with id a4344eaab37871d0bd9d9369d4a57de01f63e19e31588884793ff8ede20870fd
Jul 22 03:07:06.313652 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.313629    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nkwt5"
Jul 22 03:07:06.320515 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.320288    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nnsvz"
Jul 22 03:07:06.323118 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:06.323079    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a8a2c5_aadd_489a_be61_667345f173aa.slice/crio-926584d1b73e9cdb35c6fb52b222f125d28bd6596a973cf9aa58696ccf59d128 WatchSource:0}: Error finding container 926584d1b73e9cdb35c6fb52b222f125d28bd6596a973cf9aa58696ccf59d128: Status 404 returned error can't find the container with id 926584d1b73e9cdb35c6fb52b222f125d28bd6596a973cf9aa58696ccf59d128
Jul 22 03:07:06.326685 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.326507    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7"
Jul 22 03:07:06.332193 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.331766    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bfsfs"
Jul 22 03:07:06.339114 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.339095    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fzscs"
Jul 22 03:07:06.342348 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:06.342324    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd09ef900_140e_47ef_91a0_5e325001248c.slice/crio-b2a0eca6c7676faec984209102bb5b3de3a1eb17d53b655c5b27773ba469fd85 WatchSource:0}: Error finding container b2a0eca6c7676faec984209102bb5b3de3a1eb17d53b655c5b27773ba469fd85: Status 404 returned error can't find the container with id b2a0eca6c7676faec984209102bb5b3de3a1eb17d53b655c5b27773ba469fd85
Jul 22 03:07:06.346421 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:06.346395    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a6d5075_10f2_4d3b_9462_0d22b9c76bae.slice/crio-b0dd55f17b89f145aa5a78bf0f797467d1533e66d6decb8191d3b7031a4b4a1f WatchSource:0}: Error finding container b0dd55f17b89f145aa5a78bf0f797467d1533e66d6decb8191d3b7031a4b4a1f: Status 404 returned error can't find the container with id b0dd55f17b89f145aa5a78bf0f797467d1533e66d6decb8191d3b7031a4b4a1f
Jul 22 03:07:06.354222 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:06.354194    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e1f25e_6f77_46ac_9e41_a984a059e3cf.slice/crio-14d4bcd47ee8fcbb91fd68ea7f55bfc50fca47469b3494764fc60d14bcfba425 WatchSource:0}: Error finding container 14d4bcd47ee8fcbb91fd68ea7f55bfc50fca47469b3494764fc60d14bcfba425: Status 404 returned error can't find the container with id 14d4bcd47ee8fcbb91fd68ea7f55bfc50fca47469b3494764fc60d14bcfba425
Jul 22 03:07:06.356788 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:06.356766    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2003ad5_56cf_4f9d_ba75_6942465b7515.slice/crio-7a4985344ac38a56b234adbf979e334435052ad93adf9a3227ec242a1a7475bb WatchSource:0}: Error finding container 7a4985344ac38a56b234adbf979e334435052ad93adf9a3227ec242a1a7475bb: Status 404 returned error can't find the container with id 7a4985344ac38a56b234adbf979e334435052ad93adf9a3227ec242a1a7475bb
Jul 22 03:07:06.359404 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:06.359380    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccea7c5f_cfab_49de_9384_e977f53364b1.slice/crio-06aabc523069aedf1350190d4863df97d58e400da5bea5d914ebc26fdc0899bc WatchSource:0}: Error finding container 06aabc523069aedf1350190d4863df97d58e400da5bea5d914ebc26fdc0899bc: Status 404 returned error can't find the container with id 06aabc523069aedf1350190d4863df97d58e400da5bea5d914ebc26fdc0899bc
Jul 22 03:07:06.724573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.724533    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:06.724770 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.724611    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:06.724770 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.724673    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:06.724770 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.724723    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:06.724770 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.724755    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs podName:7067f007-63eb-4ec1-93b0-2d8393994233 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:07.724733789 +0000 UTC m=+4.091369601 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs") pod "network-metrics-daemon-ggt8f" (UID: "7067f007-63eb-4ec1-93b0-2d8393994233") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:06.724958 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.724805    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret podName:ca554050-1a54-4d4a-86ac-fe03455e9bef nodeName:}" failed. No retries permitted until 2026-07-22 03:07:07.724770146 +0000 UTC m=+4.091405935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret") pod "global-pull-secret-syncer-64nk5" (UID: "ca554050-1a54-4d4a-86ac-fe03455e9bef") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:06.825783 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:06.825738    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b58r\" (UniqueName: \"kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r\") pod \"network-check-target-8hkl6\" (UID: \"caa42fdc-cc77-4d75-9fb0-082c328be3bc\") " pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:06.825984 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.825940    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:07:06.825984 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.825967    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:07:06.825984 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.825979    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5b58r for pod openshift-network-diagnostics/network-check-target-8hkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:06.826120 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:06.826040    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r podName:caa42fdc-cc77-4d75-9fb0-082c328be3bc nodeName:}" failed. No retries permitted until 2026-07-22 03:07:07.826024698 +0000 UTC m=+4.192660506 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5b58r" (UniqueName: "kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r") pod "network-check-target-8hkl6" (UID: "caa42fdc-cc77-4d75-9fb0-082c328be3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:07.044656 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.044532    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 03:02:06 +0000 UTC" deadline="2028-01-15 10:09:08.048786057 +0000 UTC"
Jul 22 03:07:07.044656 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.044598    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13015h2m1.004192034s"
Jul 22 03:07:07.098528 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.098493    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:07.098707 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.098545    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:07.098707 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:07.098681    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:07.098877 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:07.098853    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:07.125067 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.125028    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fzscs" event={"ID":"a2003ad5-56cf-4f9d-ba75-6942465b7515","Type":"ContainerStarted","Data":"7a4985344ac38a56b234adbf979e334435052ad93adf9a3227ec242a1a7475bb"}
Jul 22 03:07:07.126635 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.126603    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7" event={"ID":"d5e1f25e-6f77-46ac-9e41-a984a059e3cf","Type":"ContainerStarted","Data":"14d4bcd47ee8fcbb91fd68ea7f55bfc50fca47469b3494764fc60d14bcfba425"}
Jul 22 03:07:07.128166 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.128137    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nnsvz" event={"ID":"1a6d5075-10f2-4d3b-9462-0d22b9c76bae","Type":"ContainerStarted","Data":"b0dd55f17b89f145aa5a78bf0f797467d1533e66d6decb8191d3b7031a4b4a1f"}
Jul 22 03:07:07.129567 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.129478    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8" event={"ID":"11a8a2c5-aadd-489a-be61-667345f173aa","Type":"ContainerStarted","Data":"926584d1b73e9cdb35c6fb52b222f125d28bd6596a973cf9aa58696ccf59d128"}
Jul 22 03:07:07.131175 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.131147    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g6lcg" event={"ID":"04a330b1-fc40-4454-aebd-8a4c51ce553c","Type":"ContainerStarted","Data":"a4344eaab37871d0bd9d9369d4a57de01f63e19e31588884793ff8ede20870fd"}
Jul 22 03:07:07.132479 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.132451    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgrm" event={"ID":"b85ee724-9b31-4152-92e9-17bf4f22e994","Type":"ContainerStarted","Data":"b819e5267fe6e5322a9d01924d85290c8f6616482c4c32832548810cd3a32d8e"}
Jul 22 03:07:07.133899 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.133868    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bfsfs" event={"ID":"ccea7c5f-cfab-49de-9384-e977f53364b1","Type":"ContainerStarted","Data":"06aabc523069aedf1350190d4863df97d58e400da5bea5d914ebc26fdc0899bc"}
Jul 22 03:07:07.135383 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.135359    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nkwt5" event={"ID":"d09ef900-140e-47ef-91a0-5e325001248c","Type":"ContainerStarted","Data":"b2a0eca6c7676faec984209102bb5b3de3a1eb17d53b655c5b27773ba469fd85"}
Jul 22 03:07:07.136620 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.136586    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gmk89" event={"ID":"401a5450-7329-4c03-a753-e51f1e02fb3d","Type":"ContainerStarted","Data":"89ee8d6ab157c26089cd9519f935ad7d3cd8cab8c68b4b0b5b9347df678ae4fb"}
Jul 22 03:07:07.733304 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.732398    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:07.733304 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.732711    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:07.733304 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:07.732618    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:07.733304 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:07.732896    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs podName:7067f007-63eb-4ec1-93b0-2d8393994233 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:09.732874679 +0000 UTC m=+6.099510485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs") pod "network-metrics-daemon-ggt8f" (UID: "7067f007-63eb-4ec1-93b0-2d8393994233") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:07.733304 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:07.732831    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:07.733304 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:07.733272    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret podName:ca554050-1a54-4d4a-86ac-fe03455e9bef nodeName:}" failed. No retries permitted until 2026-07-22 03:07:09.733253978 +0000 UTC m=+6.099889769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret") pod "global-pull-secret-syncer-64nk5" (UID: "ca554050-1a54-4d4a-86ac-fe03455e9bef") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:07.834460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:07.833849    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b58r\" (UniqueName: \"kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r\") pod \"network-check-target-8hkl6\" (UID: \"caa42fdc-cc77-4d75-9fb0-082c328be3bc\") " pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:07.834460 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:07.834029    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:07:07.834460 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:07.834050    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:07:07.834460 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:07.834062    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5b58r for pod openshift-network-diagnostics/network-check-target-8hkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:07.834460 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:07.834117    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r podName:caa42fdc-cc77-4d75-9fb0-082c328be3bc nodeName:}" failed. No retries permitted until 2026-07-22 03:07:09.834100538 +0000 UTC m=+6.200736435 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5b58r" (UniqueName: "kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r") pod "network-check-target-8hkl6" (UID: "caa42fdc-cc77-4d75-9fb0-082c328be3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:08.045151 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:08.045120    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 03:02:06 +0000 UTC" deadline="2028-03-14 08:14:39.987417385 +0000 UTC"
Jul 22 03:07:08.045151 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:08.045149    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14429h7m31.942272262s"
Jul 22 03:07:08.098800 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:08.098756    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:08.098944 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:08.098905    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:08.151279 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:08.151243    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal" event={"ID":"5c889aaddab9faf6ffb9b70fddbe250d","Type":"ContainerStarted","Data":"3ea04e4fd99df330eae2fb21b916db3deffede8d3b49a82ad51aa76b68f58080"}
Jul 22 03:07:09.098977 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:09.098261    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:09.098977 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:09.098431    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:09.098977 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:09.098830    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:09.098977 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:09.098924    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:09.169640 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:09.169603    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal" event={"ID":"db9deb56d95fa00b38123d69f9218188","Type":"ContainerStarted","Data":"c95622b0c4848cc150c3d1d3e9c3bf12f44d7c989ad0647d043edfa424015191"}
Jul 22 03:07:09.186110 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:09.185215    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-230.ec2.internal" podStartSLOduration=4.185181016 podStartE2EDuration="4.185181016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:08.168397467 +0000 UTC m=+4.535033274" watchObservedRunningTime="2026-07-22 03:07:09.185181016 +0000 UTC m=+5.551816823"
Jul 22 03:07:09.750832 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:09.749917    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:09.750832 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:09.750026    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:09.750832 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:09.750180    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:09.750832 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:09.750257    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs podName:7067f007-63eb-4ec1-93b0-2d8393994233 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:13.750223416 +0000 UTC m=+10.116859218 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs") pod "network-metrics-daemon-ggt8f" (UID: "7067f007-63eb-4ec1-93b0-2d8393994233") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:09.750832 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:09.750695    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:09.750832 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:09.750751    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret podName:ca554050-1a54-4d4a-86ac-fe03455e9bef nodeName:}" failed. No retries permitted until 2026-07-22 03:07:13.750736018 +0000 UTC m=+10.117371808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret") pod "global-pull-secret-syncer-64nk5" (UID: "ca554050-1a54-4d4a-86ac-fe03455e9bef") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:09.851310 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:09.851269    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b58r\" (UniqueName: \"kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r\") pod \"network-check-target-8hkl6\" (UID: \"caa42fdc-cc77-4d75-9fb0-082c328be3bc\") " pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:09.851563 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:09.851500    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:07:09.851563 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:09.851520    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:07:09.851563 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:09.851534    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5b58r for pod openshift-network-diagnostics/network-check-target-8hkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:09.851796 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:09.851593    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r podName:caa42fdc-cc77-4d75-9fb0-082c328be3bc nodeName:}" failed. No retries permitted until 2026-07-22 03:07:13.851574342 +0000 UTC m=+10.218210132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5b58r" (UniqueName: "kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r") pod "network-check-target-8hkl6" (UID: "caa42fdc-cc77-4d75-9fb0-082c328be3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:10.098850 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:10.098814    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:10.099040 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:10.098947    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:10.174149 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:10.174113    2571 generic.go:356] "Generic (PLEG): container finished" podID="db9deb56d95fa00b38123d69f9218188" containerID="c95622b0c4848cc150c3d1d3e9c3bf12f44d7c989ad0647d043edfa424015191" exitCode=0
Jul 22 03:07:10.174299 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:10.174167    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal" event={"ID":"db9deb56d95fa00b38123d69f9218188","Type":"ContainerDied","Data":"c95622b0c4848cc150c3d1d3e9c3bf12f44d7c989ad0647d043edfa424015191"}
Jul 22 03:07:11.098707 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:11.098155    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:11.098707 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:11.098189    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:11.098707 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:11.098315    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:11.098707 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:11.098433    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:12.100066 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:12.100027    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:12.100486 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:12.100156    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:13.098613 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:13.098532    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:13.098758 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:13.098678    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:13.098758 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:13.098733    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:13.098917 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:13.098852    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:13.784322 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:13.784038    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:13.784322 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:13.784113    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:13.784322 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:13.784164    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:13.784322 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:13.784243    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret podName:ca554050-1a54-4d4a-86ac-fe03455e9bef nodeName:}" failed. No retries permitted until 2026-07-22 03:07:21.784222808 +0000 UTC m=+18.150858604 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret") pod "global-pull-secret-syncer-64nk5" (UID: "ca554050-1a54-4d4a-86ac-fe03455e9bef") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:13.784322 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:13.784243    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:13.784322 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:13.784297    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs podName:7067f007-63eb-4ec1-93b0-2d8393994233 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:21.784280148 +0000 UTC m=+18.150915935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs") pod "network-metrics-daemon-ggt8f" (UID: "7067f007-63eb-4ec1-93b0-2d8393994233") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:13.885336 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:13.885285    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b58r\" (UniqueName: \"kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r\") pod \"network-check-target-8hkl6\" (UID: \"caa42fdc-cc77-4d75-9fb0-082c328be3bc\") " pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:13.885490 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:13.885464    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:07:13.885490 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:13.885489    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:07:13.885601 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:13.885502    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5b58r for pod openshift-network-diagnostics/network-check-target-8hkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:13.885601 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:13.885570    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r podName:caa42fdc-cc77-4d75-9fb0-082c328be3bc nodeName:}" failed. No retries permitted until 2026-07-22 03:07:21.885550685 +0000 UTC m=+18.252186487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5b58r" (UniqueName: "kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r") pod "network-check-target-8hkl6" (UID: "caa42fdc-cc77-4d75-9fb0-082c328be3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:14.100477 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:14.099959    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:14.100477 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:14.100075    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:15.098870 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:15.098794    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:15.099244 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:15.098927    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:15.099345 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:15.099323    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:15.099472 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:15.099421    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:16.098053 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:16.098019    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:16.098217 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:16.098136    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:17.099122 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:17.098599    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:17.099122 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:17.098645    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:17.099122 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:17.098743    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:17.099122 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:17.098878    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:18.098426 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:18.098387    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:18.098593 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:18.098532    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:19.098172 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:19.098136    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:19.098620 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:19.098284    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:19.098620 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:19.098592    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:19.098722 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:19.098690    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:20.098381 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:20.098344    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:20.098832 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:20.098501    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:21.100843 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:21.098580    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:21.100843 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:21.098836    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:21.100843 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:21.098886    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:21.100843 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:21.099104    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:21.850050 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:21.850010    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:21.850228 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:21.850074    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:21.850228 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:21.850184    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:21.850228 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:21.850186    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:21.850344 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:21.850232    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret podName:ca554050-1a54-4d4a-86ac-fe03455e9bef nodeName:}" failed. No retries permitted until 2026-07-22 03:07:37.850217809 +0000 UTC m=+34.216853593 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret") pod "global-pull-secret-syncer-64nk5" (UID: "ca554050-1a54-4d4a-86ac-fe03455e9bef") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:21.850344 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:21.850257    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs podName:7067f007-63eb-4ec1-93b0-2d8393994233 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:37.850239088 +0000 UTC m=+34.216874871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs") pod "network-metrics-daemon-ggt8f" (UID: "7067f007-63eb-4ec1-93b0-2d8393994233") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:21.950577 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:21.950536    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b58r\" (UniqueName: \"kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r\") pod \"network-check-target-8hkl6\" (UID: \"caa42fdc-cc77-4d75-9fb0-082c328be3bc\") " pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:21.950766 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:21.950743    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:07:21.950853 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:21.950792    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:07:21.950853 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:21.950807    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5b58r for pod openshift-network-diagnostics/network-check-target-8hkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:21.950941 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:21.950909    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r podName:caa42fdc-cc77-4d75-9fb0-082c328be3bc nodeName:}" failed. No retries permitted until 2026-07-22 03:07:37.950888533 +0000 UTC m=+34.317524322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5b58r" (UniqueName: "kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r") pod "network-check-target-8hkl6" (UID: "caa42fdc-cc77-4d75-9fb0-082c328be3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:22.098531 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:22.098486    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:22.098691 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:22.098618    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:23.098650 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:23.098614    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:23.099112 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:23.098739    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:23.099112 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:23.098802    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:23.099112 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:23.098925    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:24.099506 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:24.099477    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:24.099974 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:24.099569    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:25.098724 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:25.098686    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:25.098891 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:25.098835    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:25.098964 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:25.098898    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:25.099053 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:25.099032    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:26.099163 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.098986    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:26.099808 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:26.099249    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:26.206848 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.206813    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal" event={"ID":"db9deb56d95fa00b38123d69f9218188","Type":"ContainerStarted","Data":"b9c820cd95cde482e48dd62a560621cc144acec1737aeb2252b8cb2374a81c92"}
Jul 22 03:07:26.208286 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.208264    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fzscs" event={"ID":"a2003ad5-56cf-4f9d-ba75-6942465b7515","Type":"ContainerStarted","Data":"fe123d85533502d8117f2a83d3ae85e8a80b23f52c4ca1cd009464bc1e97767d"}
Jul 22 03:07:26.209742 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.209717    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7" event={"ID":"d5e1f25e-6f77-46ac-9e41-a984a059e3cf","Type":"ContainerStarted","Data":"da6ee1d99d362938971e822b7ff284f87a48516410eb74857ce5152cba22197d"}
Jul 22 03:07:26.211125 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.211098    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nnsvz" event={"ID":"1a6d5075-10f2-4d3b-9462-0d22b9c76bae","Type":"ContainerStarted","Data":"ea7713f6620cd92a2e9d2f5d7a211d1a098929fcd618279c614fb68a75ee07b9"}
Jul 22 03:07:26.212556 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.212540    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:07:26.212903 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.212885    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8" event={"ID":"11a8a2c5-aadd-489a-be61-667345f173aa","Type":"ContainerStarted","Data":"c2130c63f6da57b94947b0f7ef70cbcfd8ef0837cb722d3ed1c3ea196bb93277"}
Jul 22 03:07:26.212988 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.212955    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8" event={"ID":"11a8a2c5-aadd-489a-be61-667345f173aa","Type":"ContainerStarted","Data":"169e8bc214a1d52bc775cb2442f66ae9bb56be6832aea397590b55f763d0493f"}
Jul 22 03:07:26.214603 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.214581    2571 generic.go:356] "Generic (PLEG): container finished" podID="b85ee724-9b31-4152-92e9-17bf4f22e994" containerID="f2e2be65ae11170cfbdf333386854f428fa98beea09e170e467ee926086b0ef7" exitCode=0
Jul 22 03:07:26.214677 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.214643    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgrm" event={"ID":"b85ee724-9b31-4152-92e9-17bf4f22e994","Type":"ContainerDied","Data":"f2e2be65ae11170cfbdf333386854f428fa98beea09e170e467ee926086b0ef7"}
Jul 22 03:07:26.216101 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.216071    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bfsfs" event={"ID":"ccea7c5f-cfab-49de-9384-e977f53364b1","Type":"ContainerStarted","Data":"4f49287f6f51c0b1590c63dc0d97c81fab1d9032c19464b868219c01e910ed67"}
Jul 22 03:07:26.217628 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.217601    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nkwt5" event={"ID":"d09ef900-140e-47ef-91a0-5e325001248c","Type":"ContainerStarted","Data":"4ff7fe4091d8baf80b7fb83bbf0a19bbf4c22c94275c342a98b7f294b63ff132"}
Jul 22 03:07:26.219022 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.218997    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gmk89" event={"ID":"401a5450-7329-4c03-a753-e51f1e02fb3d","Type":"ContainerStarted","Data":"b0e0cbaaccf46f0e315a9d4c159c6c4a54bb9a2b43505bda99919dd0aa23de0d"}
Jul 22 03:07:26.230213 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.230178    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-230.ec2.internal" podStartSLOduration=21.23016672 podStartE2EDuration="21.23016672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:26.229553485 +0000 UTC m=+22.596189290" watchObservedRunningTime="2026-07-22 03:07:26.23016672 +0000 UTC m=+22.596802527"
Jul 22 03:07:26.269843 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.269795    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nnsvz" podStartSLOduration=7.65823654 podStartE2EDuration="22.269763235s" totalImagesPullingTime="14.611526695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:26.269627426 +0000 UTC m=+22.636263233" watchObservedRunningTime="2026-07-22 03:07:26.269763235 +0000 UTC m=+22.636399041"
Jul 22 03:07:26.315577 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.315426    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fzscs" podStartSLOduration=3.115676735 podStartE2EDuration="22.315411995s" totalImagesPullingTime="19.19973526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:26.315268424 +0000 UTC m=+22.681904229" watchObservedRunningTime="2026-07-22 03:07:26.315411995 +0000 UTC m=+22.682047800"
Jul 22 03:07:26.317253 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.315817    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bfsfs" podStartSLOduration=3.064369941 podStartE2EDuration="22.315804322s" totalImagesPullingTime="19.251434381s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:26.295398541 +0000 UTC m=+22.662034365" watchObservedRunningTime="2026-07-22 03:07:26.315804322 +0000 UTC m=+22.682440129"
Jul 22 03:07:26.353143 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.353104    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gmk89" podStartSLOduration=3.122229404 podStartE2EDuration="22.353088208s" totalImagesPullingTime="19.230858804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:26.335542587 +0000 UTC m=+22.702178394" watchObservedRunningTime="2026-07-22 03:07:26.353088208 +0000 UTC m=+22.719724014"
Jul 22 03:07:26.353288 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:26.353193    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nkwt5" podStartSLOduration=3.138487198 podStartE2EDuration="22.353189175s" totalImagesPullingTime="19.214701977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:26.35285201 +0000 UTC m=+22.719487829" watchObservedRunningTime="2026-07-22 03:07:26.353189175 +0000 UTC m=+22.719824981"
Jul 22 03:07:27.098508 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:27.098479    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:27.098687 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:27.098576    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:27.098687 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:27.098632    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:27.098764 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:27.098723    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:27.223563 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:27.223416    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:07:27.223941 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:27.223755    2571 generic.go:356] "Generic (PLEG): container finished" podID="11a8a2c5-aadd-489a-be61-667345f173aa" containerID="c2130c63f6da57b94947b0f7ef70cbcfd8ef0837cb722d3ed1c3ea196bb93277" exitCode=1
Jul 22 03:07:27.223941 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:27.223802    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8" event={"ID":"11a8a2c5-aadd-489a-be61-667345f173aa","Type":"ContainerDied","Data":"c2130c63f6da57b94947b0f7ef70cbcfd8ef0837cb722d3ed1c3ea196bb93277"}
Jul 22 03:07:27.223941 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:27.223869    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8" event={"ID":"11a8a2c5-aadd-489a-be61-667345f173aa","Type":"ContainerStarted","Data":"2f0ed400f78f4ec3b6e6846c03b4fc33ec62123f20c3d19206158d1637690f8e"}
Jul 22 03:07:27.223941 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:27.223905    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8" event={"ID":"11a8a2c5-aadd-489a-be61-667345f173aa","Type":"ContainerStarted","Data":"6c9da6193d4afdac3560751012bd51f4c56b8bf42c6fda8eede218d26dfb190c"}
Jul 22 03:07:27.223941 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:27.223941    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8" event={"ID":"11a8a2c5-aadd-489a-be61-667345f173aa","Type":"ContainerStarted","Data":"5094352b98ef2df6dba409250330ac7a0dfeeb60b03a294967144bdef7ad380a"}
Jul 22 03:07:27.224186 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:27.223984    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8" event={"ID":"11a8a2c5-aadd-489a-be61-667345f173aa","Type":"ContainerStarted","Data":"2ef4eca7a15f68f135670000d356fa6291d7f765ffea720c10d2bcc6150d49ad"}
Jul 22 03:07:27.227174 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:27.227144    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g6lcg" event={"ID":"04a330b1-fc40-4454-aebd-8a4c51ce553c","Type":"ContainerStarted","Data":"2dbabeef860a924c70ee7ff088349fb28197f40460e520001fcea675c3e90897"}
Jul 22 03:07:27.243794 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:27.243705    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g6lcg" podStartSLOduration=3.994895118 podStartE2EDuration="23.243692613s" totalImagesPullingTime="19.248797495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:27.243664817 +0000 UTC m=+23.610300623" watchObservedRunningTime="2026-07-22 03:07:27.243692613 +0000 UTC m=+23.610328419"
Jul 22 03:07:27.340449 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:27.340425    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 03:07:28.069350 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:28.069245    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T03:07:27.340441507Z","UUID":"e6181ff8-757a-484e-bd3d-d0c13c49fc9b","Handler":null,"Name":"","Endpoint":""}
Jul 22 03:07:28.071056 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:28.071020    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 03:07:28.071183 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:28.071068    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 03:07:28.098532 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:28.098502    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:28.098675 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:28.098627    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:28.195041 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:28.195003    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fzscs"
Jul 22 03:07:28.195750 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:28.195722    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fzscs"
Jul 22 03:07:28.231877 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:28.231844    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7" event={"ID":"d5e1f25e-6f77-46ac-9e41-a984a059e3cf","Type":"ContainerStarted","Data":"9b00859857623e0e0784394df92b6547511c10322def4181a9a11a20330c1ba1"}
Jul 22 03:07:28.232314 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:28.232131    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fzscs"
Jul 22 03:07:28.232571 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:28.232544    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fzscs"
Jul 22 03:07:29.098382 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:29.098222    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:29.098578 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:29.098269    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:29.098578 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:29.098496    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:29.098578 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:29.098527    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:29.235899 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:29.235801    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7" event={"ID":"d5e1f25e-6f77-46ac-9e41-a984a059e3cf","Type":"ContainerStarted","Data":"c136156083343dc61ac0b63e5ce751f42fc2291dcd412b5b98c9957025a1ba63"}
Jul 22 03:07:29.238694 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:29.238675    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:07:29.239128 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:29.239104    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8" event={"ID":"11a8a2c5-aadd-489a-be61-667345f173aa","Type":"ContainerStarted","Data":"3cbcbc9ee55426866791c33f937a0e22fe16890b3c33d3e14f62f92682fb5c64"}
Jul 22 03:07:29.272010 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:29.271932    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lpz7" podStartSLOduration=3.257456022 podStartE2EDuration="25.271916954s" totalImagesPullingTime="22.014460932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:29.271469422 +0000 UTC m=+25.638105230" watchObservedRunningTime="2026-07-22 03:07:29.271916954 +0000 UTC m=+25.638552804"
Jul 22 03:07:30.098915 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:30.098883    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:30.099096 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:30.099027    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:31.098946 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:31.098913    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:31.099540 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:31.098958    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:31.099540 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:31.099050    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:31.099540 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:31.099179    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:32.098830 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:32.098634    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:32.098977 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:32.098904    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:32.248937 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:32.248913    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:07:32.249302 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:32.249281    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8" event={"ID":"11a8a2c5-aadd-489a-be61-667345f173aa","Type":"ContainerStarted","Data":"fdcbf2d58d92cc77127badb64ac9e8e5399bcdfc3258c207bb5483cafd718a4f"}
Jul 22 03:07:32.249536 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:32.249510    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:32.249676 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:32.249586    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:32.249742 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:32.249725    2571 scope.go:117] "RemoveContainer" containerID="c2130c63f6da57b94947b0f7ef70cbcfd8ef0837cb722d3ed1c3ea196bb93277"
Jul 22 03:07:32.251353 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:32.251317    2571 generic.go:356] "Generic (PLEG): container finished" podID="b85ee724-9b31-4152-92e9-17bf4f22e994" containerID="bb7596cc66f66f9e965a71cd048ce437f39e286a1f5e93a85aeec09b89aa6192" exitCode=0
Jul 22 03:07:32.251434 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:32.251357    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgrm" event={"ID":"b85ee724-9b31-4152-92e9-17bf4f22e994","Type":"ContainerDied","Data":"bb7596cc66f66f9e965a71cd048ce437f39e286a1f5e93a85aeec09b89aa6192"}
Jul 22 03:07:32.266981 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:32.266963    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:33.097936 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.097911    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:33.098057 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:33.098026    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:33.098101 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.098081    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:33.098200 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:33.098178    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:33.257921 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.257898    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:07:33.258356 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.258331    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8" event={"ID":"11a8a2c5-aadd-489a-be61-667345f173aa","Type":"ContainerStarted","Data":"5340a519a95745cccca690e003ff5d3ba7ccd37362b79bf1f5eb08fdc9fb562b"}
Jul 22 03:07:33.258732 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.258673    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:33.260543 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.260517    2571 generic.go:356] "Generic (PLEG): container finished" podID="b85ee724-9b31-4152-92e9-17bf4f22e994" containerID="7b9e39706a02f8d8b885dec94499969719c4253204780aef4ee5a26fca783854" exitCode=0
Jul 22 03:07:33.260617 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.260563    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgrm" event={"ID":"b85ee724-9b31-4152-92e9-17bf4f22e994","Type":"ContainerDied","Data":"7b9e39706a02f8d8b885dec94499969719c4253204780aef4ee5a26fca783854"}
Jul 22 03:07:33.274456 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.274434    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:07:33.292964 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.292925    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8" podStartSLOduration=9.680874483 podStartE2EDuration="29.292905694s" totalImagesPullingTime="19.612031211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:33.292815774 +0000 UTC m=+29.659451580" watchObservedRunningTime="2026-07-22 03:07:33.292905694 +0000 UTC m=+29.659541500"
Jul 22 03:07:33.463247 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.463214    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ggt8f"]
Jul 22 03:07:33.463392 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.463370    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:33.463478 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:33.463459    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:33.466556 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.466531    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-64nk5"]
Jul 22 03:07:33.466706 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.466636    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:33.466791 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:33.466741    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:33.467206 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.467182    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8hkl6"]
Jul 22 03:07:33.467299 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:33.467286    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:33.467402 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:33.467381    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:34.265637 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:34.265448    2571 generic.go:356] "Generic (PLEG): container finished" podID="b85ee724-9b31-4152-92e9-17bf4f22e994" containerID="6cc9355f57ea7e7fbc4bbbf74e7ccec2c0ef2f5b680c04fd438fc49adb7adf7c" exitCode=0
Jul 22 03:07:34.265637 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:34.265526    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgrm" event={"ID":"b85ee724-9b31-4152-92e9-17bf4f22e994","Type":"ContainerDied","Data":"6cc9355f57ea7e7fbc4bbbf74e7ccec2c0ef2f5b680c04fd438fc49adb7adf7c"}
Jul 22 03:07:35.098200 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:35.098160    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:35.098356 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:35.098294    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:35.098447 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:35.098292    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:35.098539 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:35.098302    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:35.098539 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:35.098454    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:35.098628 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:35.098572    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:37.098445 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:37.098403    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:37.099231 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:37.098528    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:37.099231 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:37.098540    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:37.099231 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:37.098560    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:37.099231 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:37.098640    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:37.099231 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:37.098713    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:37.866484 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:37.866444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:37.866681 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:37.866521    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:37.866681 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:37.866635    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:37.866830 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:37.866691    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret podName:ca554050-1a54-4d4a-86ac-fe03455e9bef nodeName:}" failed. No retries permitted until 2026-07-22 03:08:09.866671612 +0000 UTC m=+66.233307400 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret") pod "global-pull-secret-syncer-64nk5" (UID: "ca554050-1a54-4d4a-86ac-fe03455e9bef") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:07:37.867176 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:37.867147    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:37.867296 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:37.867210    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs podName:7067f007-63eb-4ec1-93b0-2d8393994233 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:09.867194056 +0000 UTC m=+66.233829841 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs") pod "network-metrics-daemon-ggt8f" (UID: "7067f007-63eb-4ec1-93b0-2d8393994233") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:07:37.967682 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:37.967638    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b58r\" (UniqueName: \"kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r\") pod \"network-check-target-8hkl6\" (UID: \"caa42fdc-cc77-4d75-9fb0-082c328be3bc\") " pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:37.967887 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:37.967831    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:07:37.967887 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:37.967857    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:07:37.967887 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:37.967872    2571 projected.go:196] Error preparing data for projected volume kube-api-access-5b58r for pod openshift-network-diagnostics/network-check-target-8hkl6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:37.968028 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:37.967928    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r podName:caa42fdc-cc77-4d75-9fb0-082c328be3bc nodeName:}" failed. No retries permitted until 2026-07-22 03:08:09.96791101 +0000 UTC m=+66.334546801 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5b58r" (UniqueName: "kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r") pod "network-check-target-8hkl6" (UID: "caa42fdc-cc77-4d75-9fb0-082c328be3bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:07:39.098386 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.098353    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:39.098955 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.098451    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:39.098955 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:39.098557    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-64nk5" podUID="ca554050-1a54-4d4a-86ac-fe03455e9bef"
Jul 22 03:07:39.098955 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.098456    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:39.098955 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:39.098452    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8hkl6" podUID="caa42fdc-cc77-4d75-9fb0-082c328be3bc"
Jul 22 03:07:39.098955 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:39.098655    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggt8f" podUID="7067f007-63eb-4ec1-93b0-2d8393994233"
Jul 22 03:07:39.281899 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.281866    2571 generic.go:356] "Generic (PLEG): container finished" podID="b85ee724-9b31-4152-92e9-17bf4f22e994" containerID="c068e8c3805be1e4ad3067e57a4faff1ffb3f1a7235386434db17c23016abae1" exitCode=0
Jul 22 03:07:39.281996 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.281930    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgrm" event={"ID":"b85ee724-9b31-4152-92e9-17bf4f22e994","Type":"ContainerDied","Data":"c068e8c3805be1e4ad3067e57a4faff1ffb3f1a7235386434db17c23016abae1"}
Jul 22 03:07:39.474550 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.474521    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-230.ec2.internal" event="NodeReady"
Jul 22 03:07:39.474687 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.474642    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 03:07:39.513433 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.513405    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-594bdf5ffc-ggqtn"]
Jul 22 03:07:39.515916 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.515902    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.518665 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.518645    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 03:07:39.518794 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.518751    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 03:07:39.518839 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.518797    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 03:07:39.521548 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.521529    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ndl8t\""
Jul 22 03:07:39.525025 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.524996    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 03:07:39.530975 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.530955    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-594bdf5ffc-ggqtn"]
Jul 22 03:07:39.533312 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.533293    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hd9wg"]
Jul 22 03:07:39.536104 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.536088    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:39.537318 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.537303    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4nq2g"]
Jul 22 03:07:39.540070 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.540053    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4nq2g"
Jul 22 03:07:39.542293 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.542271    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 03:07:39.542531 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.542505    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bmpz5\""
Jul 22 03:07:39.542678 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.542661    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 03:07:39.542960 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.542947    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pc67s\""
Jul 22 03:07:39.543275 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.543257    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 03:07:39.543321 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.543267    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 03:07:39.543654 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.543640    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 03:07:39.552484 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.552465    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hd9wg"]
Jul 22 03:07:39.559253 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.559234    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4nq2g"]
Jul 22 03:07:39.681635 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.681555    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62k7d\" (UniqueName: \"kubernetes.io/projected/7f097a0c-dc21-428a-a935-83a59b8e74a5-kube-api-access-62k7d\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:39.681635 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.681592    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f097a0c-dc21-428a-a935-83a59b8e74a5-tmp-dir\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:39.681823 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.681622    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-bound-sa-token\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.681823 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.681689    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/add3a796-07cf-480d-b349-30636ae15b19-cert\") pod \"ingress-canary-4nq2g\" (UID: \"add3a796-07cf-480d-b349-30636ae15b19\") " pod="openshift-ingress-canary/ingress-canary-4nq2g"
Jul 22 03:07:39.681823 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.681705    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:39.681823 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.681723    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-certificates\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.681823 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.681744    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-trusted-ca\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.681823 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.681816    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f097a0c-dc21-428a-a935-83a59b8e74a5-config-volume\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:39.682003 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.681843    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-image-registry-private-configuration\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.682003 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.681872    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7kmt\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-kube-api-access-f7kmt\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.682003 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.681891    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.682003 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.681963    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2nvj\" (UniqueName: \"kubernetes.io/projected/add3a796-07cf-480d-b349-30636ae15b19-kube-api-access-p2nvj\") pod \"ingress-canary-4nq2g\" (UID: \"add3a796-07cf-480d-b349-30636ae15b19\") " pod="openshift-ingress-canary/ingress-canary-4nq2g"
Jul 22 03:07:39.682003 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.681994    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-ca-trust-extracted\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.682144 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.682012    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-installation-pull-secrets\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.782409 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782375    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f097a0c-dc21-428a-a935-83a59b8e74a5-tmp-dir\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:39.782577 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-bound-sa-token\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.782577 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782457    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/add3a796-07cf-480d-b349-30636ae15b19-cert\") pod \"ingress-canary-4nq2g\" (UID: \"add3a796-07cf-480d-b349-30636ae15b19\") " pod="openshift-ingress-canary/ingress-canary-4nq2g"
Jul 22 03:07:39.782577 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782476    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:39.782577 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782499    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-certificates\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.782577 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782521    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-trusted-ca\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.782577 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782548    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f097a0c-dc21-428a-a935-83a59b8e74a5-config-volume\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:39.782577 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782575    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-image-registry-private-configuration\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.782972 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782603    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7kmt\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-kube-api-access-f7kmt\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.782972 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:39.782621    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:07:39.782972 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782634    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.782972 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:39.782696    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls podName:7f097a0c-dc21-428a-a935-83a59b8e74a5 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:40.282675867 +0000 UTC m=+36.649311651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls") pod "dns-default-hd9wg" (UID: "7f097a0c-dc21-428a-a935-83a59b8e74a5") : secret "dns-default-metrics-tls" not found
Jul 22 03:07:39.782972 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782741    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2nvj\" (UniqueName: \"kubernetes.io/projected/add3a796-07cf-480d-b349-30636ae15b19-kube-api-access-p2nvj\") pod \"ingress-canary-4nq2g\" (UID: \"add3a796-07cf-480d-b349-30636ae15b19\") " pod="openshift-ingress-canary/ingress-canary-4nq2g"
Jul 22 03:07:39.782972 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:39.782751    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 03:07:39.782972 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:39.782766    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594bdf5ffc-ggqtn: secret "image-registry-tls" not found
Jul 22 03:07:39.782972 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782802    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-ca-trust-extracted\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.782972 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782829    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-installation-pull-secrets\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.782972 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:39.782849    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls podName:49f00f9e-67db-4c91-bc3a-ca8b4d1980bf nodeName:}" failed. No retries permitted until 2026-07-22 03:07:40.282833366 +0000 UTC m=+36.649469151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls") pod "image-registry-594bdf5ffc-ggqtn" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf") : secret "image-registry-tls" not found
Jul 22 03:07:39.782972 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782750    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f097a0c-dc21-428a-a935-83a59b8e74a5-tmp-dir\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:39.782972 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.782887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62k7d\" (UniqueName: \"kubernetes.io/projected/7f097a0c-dc21-428a-a935-83a59b8e74a5-kube-api-access-62k7d\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:39.783571 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.783298    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-certificates\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.783571 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.783323    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-ca-trust-extracted\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.783571 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.783321    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f097a0c-dc21-428a-a935-83a59b8e74a5-config-volume\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:39.783792 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.783746    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-trusted-ca\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.786948 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.786836    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-installation-pull-secrets\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.787057 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.786855    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-image-registry-private-configuration\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.787057 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.786974    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/add3a796-07cf-480d-b349-30636ae15b19-cert\") pod \"ingress-canary-4nq2g\" (UID: \"add3a796-07cf-480d-b349-30636ae15b19\") " pod="openshift-ingress-canary/ingress-canary-4nq2g"
Jul 22 03:07:39.793903 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.793874    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-bound-sa-token\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.793903 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.793898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62k7d\" (UniqueName: \"kubernetes.io/projected/7f097a0c-dc21-428a-a935-83a59b8e74a5-kube-api-access-62k7d\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:39.794048 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.793932    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2nvj\" (UniqueName: \"kubernetes.io/projected/add3a796-07cf-480d-b349-30636ae15b19-kube-api-access-p2nvj\") pod \"ingress-canary-4nq2g\" (UID: \"add3a796-07cf-480d-b349-30636ae15b19\") " pod="openshift-ingress-canary/ingress-canary-4nq2g"
Jul 22 03:07:39.794048 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.794006    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7kmt\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-kube-api-access-f7kmt\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:39.850784 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.850733    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4nq2g"
Jul 22 03:07:39.984583 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:39.984319    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4nq2g"]
Jul 22 03:07:39.987370 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:07:39.987347    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd3a796_07cf_480d_b349_30636ae15b19.slice/crio-5c400aad224dec998c635f837fd31d4f2724d51f9f35d3410fdf96a462fef289 WatchSource:0}: Error finding container 5c400aad224dec998c635f837fd31d4f2724d51f9f35d3410fdf96a462fef289: Status 404 returned error can't find the container with id 5c400aad224dec998c635f837fd31d4f2724d51f9f35d3410fdf96a462fef289
Jul 22 03:07:40.176786 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:40.176741    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:40.286024 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:40.285939    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:40.286024 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:40.285982    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:40.286227 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:40.286101    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:07:40.286227 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:40.286118    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 03:07:40.286227 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:40.286128    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594bdf5ffc-ggqtn: secret "image-registry-tls" not found
Jul 22 03:07:40.286227 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:40.286162    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls podName:7f097a0c-dc21-428a-a935-83a59b8e74a5 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:41.286142822 +0000 UTC m=+37.652778605 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls") pod "dns-default-hd9wg" (UID: "7f097a0c-dc21-428a-a935-83a59b8e74a5") : secret "dns-default-metrics-tls" not found
Jul 22 03:07:40.286227 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:40.286180    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls podName:49f00f9e-67db-4c91-bc3a-ca8b4d1980bf nodeName:}" failed. No retries permitted until 2026-07-22 03:07:41.286171198 +0000 UTC m=+37.652806982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls") pod "image-registry-594bdf5ffc-ggqtn" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf") : secret "image-registry-tls" not found
Jul 22 03:07:40.287760 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:40.287737    2571 generic.go:356] "Generic (PLEG): container finished" podID="b85ee724-9b31-4152-92e9-17bf4f22e994" containerID="39ce5b8389545594a4c9a958aec4ea2e45c96b9fb946127b5cc519e680963f44" exitCode=0
Jul 22 03:07:40.287876 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:40.287832    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgrm" event={"ID":"b85ee724-9b31-4152-92e9-17bf4f22e994","Type":"ContainerDied","Data":"39ce5b8389545594a4c9a958aec4ea2e45c96b9fb946127b5cc519e680963f44"}
Jul 22 03:07:40.288954 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:40.288924    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4nq2g" event={"ID":"add3a796-07cf-480d-b349-30636ae15b19","Type":"ContainerStarted","Data":"5c400aad224dec998c635f837fd31d4f2724d51f9f35d3410fdf96a462fef289"}
Jul 22 03:07:40.310407 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:40.310348    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:40.411449 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:40.411421    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:40.506798 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:40.506740    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:41.098886 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.098848    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:07:41.099058 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.098848    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:07:41.099058 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.098977    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:07:41.103350 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.103334    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 03:07:41.103527 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.103515    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 03:07:41.104441 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.104418    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-glt2k\""
Jul 22 03:07:41.104622 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.104591    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 03:07:41.108085 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.108064    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 03:07:41.109176 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.109157    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4gddc\""
Jul 22 03:07:41.157272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.157239    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:41.225807 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.225755    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:41.291551 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.291522    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:41.291706 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.291622    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:41.291706 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:41.291672    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 03:07:41.291706 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:41.291685    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594bdf5ffc-ggqtn: secret "image-registry-tls" not found
Jul 22 03:07:41.291897 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:41.291715    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:07:41.291897 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:41.291742    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls podName:49f00f9e-67db-4c91-bc3a-ca8b4d1980bf nodeName:}" failed. No retries permitted until 2026-07-22 03:07:43.291722152 +0000 UTC m=+39.658357957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls") pod "image-registry-594bdf5ffc-ggqtn" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf") : secret "image-registry-tls" not found
Jul 22 03:07:41.291897 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:41.291759    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls podName:7f097a0c-dc21-428a-a935-83a59b8e74a5 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:43.291748548 +0000 UTC m=+39.658384347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls") pod "dns-default-hd9wg" (UID: "7f097a0c-dc21-428a-a935-83a59b8e74a5") : secret "dns-default-metrics-tls" not found
Jul 22 03:07:41.294789 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.294746    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ppgrm" event={"ID":"b85ee724-9b31-4152-92e9-17bf4f22e994","Type":"ContainerStarted","Data":"818612ba6d27d04f734c94f04cd601f6da8ee22568d41cc2de32ed5facd775ab"}
Jul 22 03:07:41.322100 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.322053    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ppgrm" podStartSLOduration=11.194210487 podStartE2EDuration="37.322040163s" totalImagesPullingTime="26.127829676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:41.321875519 +0000 UTC m=+37.688511324" watchObservedRunningTime="2026-07-22 03:07:41.322040163 +0000 UTC m=+37.688675968"
Jul 22 03:07:41.523982 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:41.523706    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:42.368691 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:42.368656    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:42.440602 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:42.440569    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:42.734717 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:42.734632    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:42.801562 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:42.801524    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:43.308050 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:43.307972    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:43.308205 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:43.308085    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:43.308205 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:43.308149    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 03:07:43.308205 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:43.308167    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594bdf5ffc-ggqtn: secret "image-registry-tls" not found
Jul 22 03:07:43.308368 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:43.308205    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:07:43.308368 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:43.308224    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls podName:49f00f9e-67db-4c91-bc3a-ca8b4d1980bf nodeName:}" failed. No retries permitted until 2026-07-22 03:07:47.30820922 +0000 UTC m=+43.674845005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls") pod "image-registry-594bdf5ffc-ggqtn" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf") : secret "image-registry-tls" not found
Jul 22 03:07:43.308368 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:43.308250    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls podName:7f097a0c-dc21-428a-a935-83a59b8e74a5 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:47.308239425 +0000 UTC m=+43.674875210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls") pod "dns-default-hd9wg" (UID: "7f097a0c-dc21-428a-a935-83a59b8e74a5") : secret "dns-default-metrics-tls" not found
Jul 22 03:07:43.640134 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:43.640097    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:43.741749 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:43.741721    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:43.865972 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:43.865939    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:43.953008 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:43.952913    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:44.056534 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:44.056498    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:44.302619 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:44.302526    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4nq2g" event={"ID":"add3a796-07cf-480d-b349-30636ae15b19","Type":"ContainerStarted","Data":"e6a520b39ed9d2b05e2ac72a0cb152f31061efa25221c878d2c6dc8c8ba315a4"}
Jul 22 03:07:44.323758 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:44.323699    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4nq2g" podStartSLOduration=1.612127586 podStartE2EDuration="5.323684551s" totalImagesPullingTime="3.711556965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:07:44.32220682 +0000 UTC m=+40.688842627" watchObservedRunningTime="2026-07-22 03:07:44.323684551 +0000 UTC m=+40.690320356"
Jul 22 03:07:44.733897 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:44.733864    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:44.802787 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:44.802734    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:45.134167 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:45.134108    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:45.218029 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:45.217991    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:46.236569 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:46.236524    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:46.317858 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:46.317830    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log" limit=1024
Jul 22 03:07:47.336514 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:47.336483    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:47.336915 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:47.336526    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:47.336915 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:47.336635    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:07:47.336915 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:47.336639    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 03:07:47.336915 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:47.336655    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594bdf5ffc-ggqtn: secret "image-registry-tls" not found
Jul 22 03:07:47.336915 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:47.336700    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls podName:49f00f9e-67db-4c91-bc3a-ca8b4d1980bf nodeName:}" failed. No retries permitted until 2026-07-22 03:07:55.336683448 +0000 UTC m=+51.703319255 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls") pod "image-registry-594bdf5ffc-ggqtn" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf") : secret "image-registry-tls" not found
Jul 22 03:07:47.336915 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:47.336716    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls podName:7f097a0c-dc21-428a-a935-83a59b8e74a5 nodeName:}" failed. No retries permitted until 2026-07-22 03:07:55.336707874 +0000 UTC m=+51.703343658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls") pod "dns-default-hd9wg" (UID: "7f097a0c-dc21-428a-a935-83a59b8e74a5") : secret "dns-default-metrics-tls" not found
Jul 22 03:07:55.397677 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:55.397636    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:07:55.397677 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:07:55.397684    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:07:55.398162 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:55.397785    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:07:55.398162 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:55.397849    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls podName:7f097a0c-dc21-428a-a935-83a59b8e74a5 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:11.397833682 +0000 UTC m=+67.764469465 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls") pod "dns-default-hd9wg" (UID: "7f097a0c-dc21-428a-a935-83a59b8e74a5") : secret "dns-default-metrics-tls" not found
Jul 22 03:07:55.398162 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:55.397788    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 03:07:55.398162 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:55.397876    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594bdf5ffc-ggqtn: secret "image-registry-tls" not found
Jul 22 03:07:55.398162 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:07:55.397935    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls podName:49f00f9e-67db-4c91-bc3a-ca8b4d1980bf nodeName:}" failed. No retries permitted until 2026-07-22 03:08:11.397923588 +0000 UTC m=+67.764559372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls") pod "image-registry-594bdf5ffc-ggqtn" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf") : secret "image-registry-tls" not found
Jul 22 03:08:05.279297 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:05.279269    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q7ns8"
Jul 22 03:08:07.113019 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.112979    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"]
Jul 22 03:08:07.118871 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.118843    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-9s5pk"]
Jul 22 03:08:07.119035 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.118977    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:07.121625 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.121604    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 22 03:08:07.122564 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.122546    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67f469f5c4-f25v7"]
Jul 22 03:08:07.122691 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.122668    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.126153 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.126131    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-hwtzz"]
Jul 22 03:08:07.126276 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.126261    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.130086 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.130060    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.145049 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.145028    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"]
Jul 22 03:08:07.156832 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.156809    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fjjt8\""
Jul 22 03:08:07.156958 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.156941    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 03:08:07.157161 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.157146    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 22 03:08:07.165535 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.165519    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 22 03:08:07.170395 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.170379    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 22 03:08:07.172403 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.172390    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:08:07.176172 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.176160    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 22 03:08:07.180975 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.180962    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 22 03:08:07.183249 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183235    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 22 03:08:07.183571 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183555    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-default-certificate\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.183620 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183579    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-stats-auth\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.183620 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183604    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23911fb3-ab85-424c-bddc-377af8b7f57b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.183697 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183656    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkz2p\" (UniqueName: \"kubernetes.io/projected/2b78099e-aa06-419a-b007-3e026982ee8e-kube-api-access-dkz2p\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:07.183697 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183674    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 22 03:08:07.183697 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183679    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.183815 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb53639c-5549-446f-9cef-c864401e6ffc-trusted-ca\") pod \"console-operator-565b7b569d-9s5pk\" (UID: \"fb53639c-5549-446f-9cef-c864401e6ffc\") " pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.183815 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183765    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23911fb3-ab85-424c-bddc-377af8b7f57b-tmp\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.183815 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183809    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb53639c-5549-446f-9cef-c864401e6ffc-serving-cert\") pod \"console-operator-565b7b569d-9s5pk\" (UID: \"fb53639c-5549-446f-9cef-c864401e6ffc\") " pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.183922 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183846    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.183922 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183879    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgqt2\" (UniqueName: \"kubernetes.io/projected/fb53639c-5549-446f-9cef-c864401e6ffc-kube-api-access-jgqt2\") pod \"console-operator-565b7b569d-9s5pk\" (UID: \"fb53639c-5549-446f-9cef-c864401e6ffc\") " pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.183922 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183900    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:07.184019 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183930    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z5g8\" (UniqueName: \"kubernetes.io/projected/eeed144b-f174-4605-b794-37eca9426475-kube-api-access-7z5g8\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.184019 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183952    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gbkz\" (UniqueName: \"kubernetes.io/projected/23911fb3-ab85-424c-bddc-377af8b7f57b-kube-api-access-2gbkz\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.184019 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183970    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23911fb3-ab85-424c-bddc-377af8b7f57b-service-ca-bundle\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.184019 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.183994    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23911fb3-ab85-424c-bddc-377af8b7f57b-serving-cert\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.184155 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.184041    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb53639c-5549-446f-9cef-c864401e6ffc-config\") pod \"console-operator-565b7b569d-9s5pk\" (UID: \"fb53639c-5549-446f-9cef-c864401e6ffc\") " pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.184155 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.184084    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2b78099e-aa06-419a-b007-3e026982ee8e-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:07.184155 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.184105    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/23911fb3-ab85-424c-bddc-377af8b7f57b-snapshots\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.195376 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.195358    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 03:08:07.197132 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.197114    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-hwtzz"]
Jul 22 03:08:07.197696 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.197677    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-9s5pk"]
Jul 22 03:08:07.199495 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.199480    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 03:08:07.201104 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.201092    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 22 03:08:07.201525 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.201483    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 03:08:07.201627 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.201612    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-v9n6v\""
Jul 22 03:08:07.201707 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.201692    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 03:08:07.201824 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.201810    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6qkhb\""
Jul 22 03:08:07.201933 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.201914    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8hbzh\""
Jul 22 03:08:07.202052 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.202034    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 03:08:07.202127 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.202111    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 22 03:08:07.202784 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.202756    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 22 03:08:07.207496 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.207481    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 22 03:08:07.208253 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.208240    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 22 03:08:07.220238 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.220182    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67f469f5c4-f25v7"]
Jul 22 03:08:07.240090 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.240069    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bqh8z"]
Jul 22 03:08:07.243807 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.243791    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"]
Jul 22 03:08:07.243894 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.243849    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bqh8z"
Jul 22 03:08:07.246357 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.246336    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wc6hd\""
Jul 22 03:08:07.246869 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.246851    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:08:07.246970 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.246955    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 22 03:08:07.247164 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.247151    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:07.249741 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.249723    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 22 03:08:07.250012 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.249998    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qmxpd\""
Jul 22 03:08:07.250083 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.250002    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:08:07.250083 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.250043    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 22 03:08:07.256850 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.256833    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bqh8z"]
Jul 22 03:08:07.257800 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.257765    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"]
Jul 22 03:08:07.285135 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285111    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:07.285272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285140    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z5g8\" (UniqueName: \"kubernetes.io/projected/eeed144b-f174-4605-b794-37eca9426475-kube-api-access-7z5g8\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.285272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285161    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4pjh\" (UniqueName: \"kubernetes.io/projected/47df5352-da28-4ef7-8227-20b03259cb10-kube-api-access-v4pjh\") pod \"volume-data-source-validator-78cf4c6f6-bqh8z\" (UID: \"47df5352-da28-4ef7-8227-20b03259cb10\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bqh8z"
Jul 22 03:08:07.285272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285178    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9qw7b\" (UID: \"0739ce58-839f-4b50-aa28-46c81706f461\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:07.285272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285196    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gbkz\" (UniqueName: \"kubernetes.io/projected/23911fb3-ab85-424c-bddc-377af8b7f57b-kube-api-access-2gbkz\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.285272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285214    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23911fb3-ab85-424c-bddc-377af8b7f57b-service-ca-bundle\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.285272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285259    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23911fb3-ab85-424c-bddc-377af8b7f57b-serving-cert\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.285487 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.285282    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 03:08:07.285487 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285421    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb53639c-5549-446f-9cef-c864401e6ffc-config\") pod \"console-operator-565b7b569d-9s5pk\" (UID: \"fb53639c-5549-446f-9cef-c864401e6ffc\") " pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.285487 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.285439    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls podName:2b78099e-aa06-419a-b007-3e026982ee8e nodeName:}" failed. No retries permitted until 2026-07-22 03:08:07.785421666 +0000 UTC m=+64.152057463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xstqz" (UID: "2b78099e-aa06-419a-b007-3e026982ee8e") : secret "cluster-monitoring-operator-tls" not found
Jul 22 03:08:07.285614 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285489    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsgtm\" (UniqueName: \"kubernetes.io/projected/0739ce58-839f-4b50-aa28-46c81706f461-kube-api-access-hsgtm\") pod \"cluster-samples-operator-79b7c55f87-9qw7b\" (UID: \"0739ce58-839f-4b50-aa28-46c81706f461\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:07.285614 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285529    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2b78099e-aa06-419a-b007-3e026982ee8e-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:07.285614 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285557    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/23911fb3-ab85-424c-bddc-377af8b7f57b-snapshots\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.285763 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285614    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-default-certificate\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.285763 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285641    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-stats-auth\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.285763 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285682    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23911fb3-ab85-424c-bddc-377af8b7f57b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.285763 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285707    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkz2p\" (UniqueName: \"kubernetes.io/projected/2b78099e-aa06-419a-b007-3e026982ee8e-kube-api-access-dkz2p\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:07.285763 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285730    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.286034 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.285850    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle podName:eeed144b-f174-4605-b794-37eca9426475 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:07.785834086 +0000 UTC m=+64.152469887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle") pod "router-default-67f469f5c4-f25v7" (UID: "eeed144b-f174-4605-b794-37eca9426475") : configmap references non-existent config key: service-ca.crt
Jul 22 03:08:07.286034 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285923    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23911fb3-ab85-424c-bddc-377af8b7f57b-service-ca-bundle\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.286034 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.285992    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb53639c-5549-446f-9cef-c864401e6ffc-trusted-ca\") pod \"console-operator-565b7b569d-9s5pk\" (UID: \"fb53639c-5549-446f-9cef-c864401e6ffc\") " pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.286195 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.286042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23911fb3-ab85-424c-bddc-377af8b7f57b-tmp\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.286195 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.286079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb53639c-5549-446f-9cef-c864401e6ffc-serving-cert\") pod \"console-operator-565b7b569d-9s5pk\" (UID: \"fb53639c-5549-446f-9cef-c864401e6ffc\") " pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.286195 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.286103    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.286195 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.286130    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgqt2\" (UniqueName: \"kubernetes.io/projected/fb53639c-5549-446f-9cef-c864401e6ffc-kube-api-access-jgqt2\") pod \"console-operator-565b7b569d-9s5pk\" (UID: \"fb53639c-5549-446f-9cef-c864401e6ffc\") " pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.286195 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.286146    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fb53639c-5549-446f-9cef-c864401e6ffc-config\") pod \"console-operator-565b7b569d-9s5pk\" (UID: \"fb53639c-5549-446f-9cef-c864401e6ffc\") " pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.286853 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.286256    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/23911fb3-ab85-424c-bddc-377af8b7f57b-snapshots\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.286853 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.286350    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2b78099e-aa06-419a-b007-3e026982ee8e-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:07.286853 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.286398    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 03:08:07.286853 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.286450    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs podName:eeed144b-f174-4605-b794-37eca9426475 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:07.786436038 +0000 UTC m=+64.153071821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs") pod "router-default-67f469f5c4-f25v7" (UID: "eeed144b-f174-4605-b794-37eca9426475") : secret "router-metrics-certs-default" not found
Jul 22 03:08:07.286853 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.286619    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23911fb3-ab85-424c-bddc-377af8b7f57b-tmp\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.287339 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.287312    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb53639c-5549-446f-9cef-c864401e6ffc-trusted-ca\") pod \"console-operator-565b7b569d-9s5pk\" (UID: \"fb53639c-5549-446f-9cef-c864401e6ffc\") " pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.288498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.288470    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23911fb3-ab85-424c-bddc-377af8b7f57b-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.289799 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.289761    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/23911fb3-ab85-424c-bddc-377af8b7f57b-serving-cert\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.289872 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.289799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb53639c-5549-446f-9cef-c864401e6ffc-serving-cert\") pod \"console-operator-565b7b569d-9s5pk\" (UID: \"fb53639c-5549-446f-9cef-c864401e6ffc\") " pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.290002 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.289986    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-default-certificate\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.290037 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.289992    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-stats-auth\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.298487 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.298462    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z5g8\" (UniqueName: \"kubernetes.io/projected/eeed144b-f174-4605-b794-37eca9426475-kube-api-access-7z5g8\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.299063 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.299047    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgqt2\" (UniqueName: \"kubernetes.io/projected/fb53639c-5549-446f-9cef-c864401e6ffc-kube-api-access-jgqt2\") pod \"console-operator-565b7b569d-9s5pk\" (UID: \"fb53639c-5549-446f-9cef-c864401e6ffc\") " pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.299144 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.299069    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkz2p\" (UniqueName: \"kubernetes.io/projected/2b78099e-aa06-419a-b007-3e026982ee8e-kube-api-access-dkz2p\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:07.299329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.299310    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gbkz\" (UniqueName: \"kubernetes.io/projected/23911fb3-ab85-424c-bddc-377af8b7f57b-kube-api-access-2gbkz\") pod \"insights-operator-555d9d7885-hwtzz\" (UID: \"23911fb3-ab85-424c-bddc-377af8b7f57b\") " pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.386730 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.386662    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4pjh\" (UniqueName: \"kubernetes.io/projected/47df5352-da28-4ef7-8227-20b03259cb10-kube-api-access-v4pjh\") pod \"volume-data-source-validator-78cf4c6f6-bqh8z\" (UID: \"47df5352-da28-4ef7-8227-20b03259cb10\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bqh8z"
Jul 22 03:08:07.386730 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.386691    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9qw7b\" (UID: \"0739ce58-839f-4b50-aa28-46c81706f461\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:07.386945 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.386734    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsgtm\" (UniqueName: \"kubernetes.io/projected/0739ce58-839f-4b50-aa28-46c81706f461-kube-api-access-hsgtm\") pod \"cluster-samples-operator-79b7c55f87-9qw7b\" (UID: \"0739ce58-839f-4b50-aa28-46c81706f461\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:07.386945 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.386848    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 03:08:07.386945 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.386909    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls podName:0739ce58-839f-4b50-aa28-46c81706f461 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:07.886890084 +0000 UTC m=+64.253525870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-9qw7b" (UID: "0739ce58-839f-4b50-aa28-46c81706f461") : secret "samples-operator-tls" not found
Jul 22 03:08:07.397197 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.397174    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4pjh\" (UniqueName: \"kubernetes.io/projected/47df5352-da28-4ef7-8227-20b03259cb10-kube-api-access-v4pjh\") pod \"volume-data-source-validator-78cf4c6f6-bqh8z\" (UID: \"47df5352-da28-4ef7-8227-20b03259cb10\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bqh8z"
Jul 22 03:08:07.397295 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.397201    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsgtm\" (UniqueName: \"kubernetes.io/projected/0739ce58-839f-4b50-aa28-46c81706f461-kube-api-access-hsgtm\") pod \"cluster-samples-operator-79b7c55f87-9qw7b\" (UID: \"0739ce58-839f-4b50-aa28-46c81706f461\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:07.435412 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.435389    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:07.445914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.445890    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-hwtzz"
Jul 22 03:08:07.553099 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.553065    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bqh8z"
Jul 22 03:08:07.571144 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.571118    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-9s5pk"]
Jul 22 03:08:07.575150 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:07.575125    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb53639c_5549_446f_9cef_c864401e6ffc.slice/crio-3b5126fc6b1eb76d07c135a0b4a13cd9b9e2806c60fd5f01caead6cbcca17735 WatchSource:0}: Error finding container 3b5126fc6b1eb76d07c135a0b4a13cd9b9e2806c60fd5f01caead6cbcca17735: Status 404 returned error can't find the container with id 3b5126fc6b1eb76d07c135a0b4a13cd9b9e2806c60fd5f01caead6cbcca17735
Jul 22 03:08:07.584167 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.584140    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-hwtzz"]
Jul 22 03:08:07.587376 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:07.587355    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23911fb3_ab85_424c_bddc_377af8b7f57b.slice/crio-fe52ce66aa90c27c2c90bdc8d9366f8bd7db77c527ab4966485a60d20bf3d63f WatchSource:0}: Error finding container fe52ce66aa90c27c2c90bdc8d9366f8bd7db77c527ab4966485a60d20bf3d63f: Status 404 returned error can't find the container with id fe52ce66aa90c27c2c90bdc8d9366f8bd7db77c527ab4966485a60d20bf3d63f
Jul 22 03:08:07.677676 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.677577    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bqh8z"]
Jul 22 03:08:07.679976 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:07.679954    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47df5352_da28_4ef7_8227_20b03259cb10.slice/crio-b9adb0d91c2fda59d1f8b92f1f0510d26a443cb76af0290aff3b66cc6f1e7241 WatchSource:0}: Error finding container b9adb0d91c2fda59d1f8b92f1f0510d26a443cb76af0290aff3b66cc6f1e7241: Status 404 returned error can't find the container with id b9adb0d91c2fda59d1f8b92f1f0510d26a443cb76af0290aff3b66cc6f1e7241
Jul 22 03:08:07.789710 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.789677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:07.789896 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.789814    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.789896 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.789854    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:07.789896 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.789878    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 03:08:07.790052 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.789934    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 03:08:07.790052 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.789958    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls podName:2b78099e-aa06-419a-b007-3e026982ee8e nodeName:}" failed. No retries permitted until 2026-07-22 03:08:08.789937499 +0000 UTC m=+65.156573299 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xstqz" (UID: "2b78099e-aa06-419a-b007-3e026982ee8e") : secret "cluster-monitoring-operator-tls" not found
Jul 22 03:08:07.790052 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.789979    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle podName:eeed144b-f174-4605-b794-37eca9426475 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:08.789968942 +0000 UTC m=+65.156604727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle") pod "router-default-67f469f5c4-f25v7" (UID: "eeed144b-f174-4605-b794-37eca9426475") : configmap references non-existent config key: service-ca.crt
Jul 22 03:08:07.790052 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.789995    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs podName:eeed144b-f174-4605-b794-37eca9426475 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:08.789986195 +0000 UTC m=+65.156621984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs") pod "router-default-67f469f5c4-f25v7" (UID: "eeed144b-f174-4605-b794-37eca9426475") : secret "router-metrics-certs-default" not found
Jul 22 03:08:07.890507 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:07.890471    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9qw7b\" (UID: \"0739ce58-839f-4b50-aa28-46c81706f461\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:07.890665 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.890614    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 03:08:07.890715 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:07.890675    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls podName:0739ce58-839f-4b50-aa28-46c81706f461 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:08.890660553 +0000 UTC m=+65.257296336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-9qw7b" (UID: "0739ce58-839f-4b50-aa28-46c81706f461") : secret "samples-operator-tls" not found
Jul 22 03:08:08.359935 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:08.359896    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk" event={"ID":"fb53639c-5549-446f-9cef-c864401e6ffc","Type":"ContainerStarted","Data":"3b5126fc6b1eb76d07c135a0b4a13cd9b9e2806c60fd5f01caead6cbcca17735"}
Jul 22 03:08:08.361356 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:08.361323    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bqh8z" event={"ID":"47df5352-da28-4ef7-8227-20b03259cb10","Type":"ContainerStarted","Data":"b9adb0d91c2fda59d1f8b92f1f0510d26a443cb76af0290aff3b66cc6f1e7241"}
Jul 22 03:08:08.363116 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:08.363090    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-hwtzz" event={"ID":"23911fb3-ab85-424c-bddc-377af8b7f57b","Type":"ContainerStarted","Data":"fe52ce66aa90c27c2c90bdc8d9366f8bd7db77c527ab4966485a60d20bf3d63f"}
Jul 22 03:08:08.800408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:08.800323    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:08.800408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:08.800399    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:08.800621 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:08.800432    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:08.800621 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:08.800531    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle podName:eeed144b-f174-4605-b794-37eca9426475 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:10.800508015 +0000 UTC m=+67.167143807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle") pod "router-default-67f469f5c4-f25v7" (UID: "eeed144b-f174-4605-b794-37eca9426475") : configmap references non-existent config key: service-ca.crt
Jul 22 03:08:08.800621 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:08.800592    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 03:08:08.800755 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:08.800642    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls podName:2b78099e-aa06-419a-b007-3e026982ee8e nodeName:}" failed. No retries permitted until 2026-07-22 03:08:10.800627485 +0000 UTC m=+67.167263276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xstqz" (UID: "2b78099e-aa06-419a-b007-3e026982ee8e") : secret "cluster-monitoring-operator-tls" not found
Jul 22 03:08:08.800755 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:08.800701    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 03:08:08.800755 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:08.800731    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs podName:eeed144b-f174-4605-b794-37eca9426475 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:10.800720743 +0000 UTC m=+67.167356531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs") pod "router-default-67f469f5c4-f25v7" (UID: "eeed144b-f174-4605-b794-37eca9426475") : secret "router-metrics-certs-default" not found
Jul 22 03:08:08.901350 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:08.901317    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9qw7b\" (UID: \"0739ce58-839f-4b50-aa28-46c81706f461\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:08.901538 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:08.901494    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 03:08:08.901606 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:08.901567    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls podName:0739ce58-839f-4b50-aa28-46c81706f461 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:10.901544895 +0000 UTC m=+67.268180706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-9qw7b" (UID: "0739ce58-839f-4b50-aa28-46c81706f461") : secret "samples-operator-tls" not found
Jul 22 03:08:09.367391 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:09.367354    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bqh8z" event={"ID":"47df5352-da28-4ef7-8227-20b03259cb10","Type":"ContainerStarted","Data":"16774ebc8437ada7780297d0892257f4807e3eb190df21facc5230589a909153"}
Jul 22 03:08:09.385922 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:09.385879    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-bqh8z" podStartSLOduration=1.085578123 podStartE2EDuration="2.385863058s" totalImagesPullingTime="1.300284935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:09.385558903 +0000 UTC m=+65.752194710" watchObservedRunningTime="2026-07-22 03:08:09.385863058 +0000 UTC m=+65.752498842"
Jul 22 03:08:09.910031 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:09.909991    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:08:09.910201 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:09.910082    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:08:09.912992 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:09.912964    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 03:08:09.912992 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:09.912981    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 03:08:09.920575 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:09.920550    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 03:08:09.920702 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:09.920638    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs podName:7067f007-63eb-4ec1-93b0-2d8393994233 nodeName:}" failed. No retries permitted until 2026-07-22 03:09:13.920616637 +0000 UTC m=+130.287252421 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs") pod "network-metrics-daemon-ggt8f" (UID: "7067f007-63eb-4ec1-93b0-2d8393994233") : secret "metrics-daemon-secret" not found
Jul 22 03:08:09.922908 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:09.922888    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca554050-1a54-4d4a-86ac-fe03455e9bef-original-pull-secret\") pod \"global-pull-secret-syncer-64nk5\" (UID: \"ca554050-1a54-4d4a-86ac-fe03455e9bef\") " pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:08:10.011197 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.011157    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b58r\" (UniqueName: \"kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r\") pod \"network-check-target-8hkl6\" (UID: \"caa42fdc-cc77-4d75-9fb0-082c328be3bc\") " pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:08:10.014114 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.014093    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 03:08:10.016493 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.016473    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"]
Jul 22 03:08:10.019909 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.019889    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"
Jul 22 03:08:10.022642 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.022625    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 22 03:08:10.023055 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.023033    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:08:10.023135 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.023082    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 22 03:08:10.023135 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.023099    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-lwnfj\""
Jul 22 03:08:10.023251 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.023033    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 22 03:08:10.024857 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.024839    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 03:08:10.029259 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.029206    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"]
Jul 22 03:08:10.035444 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.035425    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b58r\" (UniqueName: \"kubernetes.io/projected/caa42fdc-cc77-4d75-9fb0-082c328be3bc-kube-api-access-5b58r\") pod \"network-check-target-8hkl6\" (UID: \"caa42fdc-cc77-4d75-9fb0-082c328be3bc\") " pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:08:10.111676 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.111646    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7315427a-044b-4fc9-b4f7-cbf7ba4f821c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-2xhvz\" (UID: \"7315427a-044b-4fc9-b4f7-cbf7ba4f821c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"
Jul 22 03:08:10.111848 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.111732    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7315427a-044b-4fc9-b4f7-cbf7ba4f821c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-2xhvz\" (UID: \"7315427a-044b-4fc9-b4f7-cbf7ba4f821c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"
Jul 22 03:08:10.111848 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.111756    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b2sv\" (UniqueName: \"kubernetes.io/projected/7315427a-044b-4fc9-b4f7-cbf7ba4f821c-kube-api-access-2b2sv\") pod \"kube-storage-version-migrator-operator-7658d9b749-2xhvz\" (UID: \"7315427a-044b-4fc9-b4f7-cbf7ba4f821c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"
Jul 22 03:08:10.209447 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.209361    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-64nk5"
Jul 22 03:08:10.212663 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.212211    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7315427a-044b-4fc9-b4f7-cbf7ba4f821c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-2xhvz\" (UID: \"7315427a-044b-4fc9-b4f7-cbf7ba4f821c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"
Jul 22 03:08:10.212663 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.212303    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7315427a-044b-4fc9-b4f7-cbf7ba4f821c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-2xhvz\" (UID: \"7315427a-044b-4fc9-b4f7-cbf7ba4f821c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"
Jul 22 03:08:10.212663 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.212335    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b2sv\" (UniqueName: \"kubernetes.io/projected/7315427a-044b-4fc9-b4f7-cbf7ba4f821c-kube-api-access-2b2sv\") pod \"kube-storage-version-migrator-operator-7658d9b749-2xhvz\" (UID: \"7315427a-044b-4fc9-b4f7-cbf7ba4f821c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"
Jul 22 03:08:10.213047 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.213020    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7315427a-044b-4fc9-b4f7-cbf7ba4f821c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-2xhvz\" (UID: \"7315427a-044b-4fc9-b4f7-cbf7ba4f821c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"
Jul 22 03:08:10.215085 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.215060    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7315427a-044b-4fc9-b4f7-cbf7ba4f821c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-2xhvz\" (UID: \"7315427a-044b-4fc9-b4f7-cbf7ba4f821c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"
Jul 22 03:08:10.217468 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.217440    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-glt2k\""
Jul 22 03:08:10.221680 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.221661    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b2sv\" (UniqueName: \"kubernetes.io/projected/7315427a-044b-4fc9-b4f7-cbf7ba4f821c-kube-api-access-2b2sv\") pod \"kube-storage-version-migrator-operator-7658d9b749-2xhvz\" (UID: \"7315427a-044b-4fc9-b4f7-cbf7ba4f821c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"
Jul 22 03:08:10.225505 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.225483    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:08:10.331633 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.331598    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"
Jul 22 03:08:10.502491 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.502458    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-64nk5"]
Jul 22 03:08:10.517024 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.516960    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8hkl6"]
Jul 22 03:08:10.529765 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:10.529732    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca554050_1a54_4d4a_86ac_fe03455e9bef.slice/crio-f4b6b5ca115d18d14c7ccbfea37a9acf39c54b752ece80991365a11ea759e253 WatchSource:0}: Error finding container f4b6b5ca115d18d14c7ccbfea37a9acf39c54b752ece80991365a11ea759e253: Status 404 returned error can't find the container with id f4b6b5ca115d18d14c7ccbfea37a9acf39c54b752ece80991365a11ea759e253
Jul 22 03:08:10.533662 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.533642    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz"]
Jul 22 03:08:10.544622 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:10.544595    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa42fdc_cc77_4d75_9fb0_082c328be3bc.slice/crio-5ca3de903cae563210a28670770260d769d73d35a46de1964624c8898fece3bf WatchSource:0}: Error finding container 5ca3de903cae563210a28670770260d769d73d35a46de1964624c8898fece3bf: Status 404 returned error can't find the container with id 5ca3de903cae563210a28670770260d769d73d35a46de1964624c8898fece3bf
Jul 22 03:08:10.544868 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:10.544846    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7315427a_044b_4fc9_b4f7_cbf7ba4f821c.slice/crio-b51e895b5fffa62c97efd621c0d22482b34352cd8b1b0178ccd7667233a9af27 WatchSource:0}: Error finding container b51e895b5fffa62c97efd621c0d22482b34352cd8b1b0178ccd7667233a9af27: Status 404 returned error can't find the container with id b51e895b5fffa62c97efd621c0d22482b34352cd8b1b0178ccd7667233a9af27
Jul 22 03:08:10.822178 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.822152    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:10.822310 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.822266    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:10.822375 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.822314    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:10.822375 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:10.822318    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 03:08:10.822451 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:10.822394    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls podName:2b78099e-aa06-419a-b007-3e026982ee8e nodeName:}" failed. No retries permitted until 2026-07-22 03:08:14.822375362 +0000 UTC m=+71.189011169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xstqz" (UID: "2b78099e-aa06-419a-b007-3e026982ee8e") : secret "cluster-monitoring-operator-tls" not found
Jul 22 03:08:10.822451 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:10.822399    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 03:08:10.822451 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:10.822422    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle podName:eeed144b-f174-4605-b794-37eca9426475 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:14.822405466 +0000 UTC m=+71.189041250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle") pod "router-default-67f469f5c4-f25v7" (UID: "eeed144b-f174-4605-b794-37eca9426475") : configmap references non-existent config key: service-ca.crt
Jul 22 03:08:10.822451 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:10.822445    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs podName:eeed144b-f174-4605-b794-37eca9426475 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:14.82243801 +0000 UTC m=+71.189073794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs") pod "router-default-67f469f5c4-f25v7" (UID: "eeed144b-f174-4605-b794-37eca9426475") : secret "router-metrics-certs-default" not found
Jul 22 03:08:10.923288 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:10.923250    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9qw7b\" (UID: \"0739ce58-839f-4b50-aa28-46c81706f461\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:10.923447 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:10.923420    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 03:08:10.923506 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:10.923495    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls podName:0739ce58-839f-4b50-aa28-46c81706f461 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:14.92347607 +0000 UTC m=+71.290111857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-9qw7b" (UID: "0739ce58-839f-4b50-aa28-46c81706f461") : secret "samples-operator-tls" not found
Jul 22 03:08:11.377216 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.377172    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8hkl6" event={"ID":"caa42fdc-cc77-4d75-9fb0-082c328be3bc","Type":"ContainerStarted","Data":"5ca3de903cae563210a28670770260d769d73d35a46de1964624c8898fece3bf"}
Jul 22 03:08:11.379825 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.379320    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-hwtzz" event={"ID":"23911fb3-ab85-424c-bddc-377af8b7f57b","Type":"ContainerStarted","Data":"580d3a790996eb6c1b87274740f42e46c7496f6a84763bb7d19df75c3bf8a549"}
Jul 22 03:08:11.381556 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.381234    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/0.log"
Jul 22 03:08:11.381556 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.381270    2571 generic.go:356] "Generic (PLEG): container finished" podID="fb53639c-5549-446f-9cef-c864401e6ffc" containerID="cdea6278f374c2463ef1ef29764b23a278738130fd1fc557e00587e77c59c350" exitCode=255
Jul 22 03:08:11.381556 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.381336    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk" event={"ID":"fb53639c-5549-446f-9cef-c864401e6ffc","Type":"ContainerDied","Data":"cdea6278f374c2463ef1ef29764b23a278738130fd1fc557e00587e77c59c350"}
Jul 22 03:08:11.382067 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.382045    2571 scope.go:117] "RemoveContainer" containerID="cdea6278f374c2463ef1ef29764b23a278738130fd1fc557e00587e77c59c350"
Jul 22 03:08:11.384213 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.384132    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz" event={"ID":"7315427a-044b-4fc9-b4f7-cbf7ba4f821c","Type":"ContainerStarted","Data":"b51e895b5fffa62c97efd621c0d22482b34352cd8b1b0178ccd7667233a9af27"}
Jul 22 03:08:11.386226 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.386202    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-64nk5" event={"ID":"ca554050-1a54-4d4a-86ac-fe03455e9bef","Type":"ContainerStarted","Data":"f4b6b5ca115d18d14c7ccbfea37a9acf39c54b752ece80991365a11ea759e253"}
Jul 22 03:08:11.420303 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.420084    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-hwtzz" podStartSLOduration=1.660697604 podStartE2EDuration="4.420062177s" totalImagesPullingTime="2.759364573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:11.398102578 +0000 UTC m=+67.764738387" watchObservedRunningTime="2026-07-22 03:08:11.420062177 +0000 UTC m=+67.786697983"
Jul 22 03:08:11.428364 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.428337    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:08:11.428521 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.428427    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:08:11.429813 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:11.429225    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 03:08:11.429813 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:11.429247    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594bdf5ffc-ggqtn: secret "image-registry-tls" not found
Jul 22 03:08:11.429813 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:11.429302    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls podName:49f00f9e-67db-4c91-bc3a-ca8b4d1980bf nodeName:}" failed. No retries permitted until 2026-07-22 03:08:43.429283363 +0000 UTC m=+99.795919148 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls") pod "image-registry-594bdf5ffc-ggqtn" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf") : secret "image-registry-tls" not found
Jul 22 03:08:11.429813 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:11.429640    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:08:11.429813 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:11.429690    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls podName:7f097a0c-dc21-428a-a935-83a59b8e74a5 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:43.429672728 +0000 UTC m=+99.796308529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls") pod "dns-default-hd9wg" (UID: "7f097a0c-dc21-428a-a935-83a59b8e74a5") : secret "dns-default-metrics-tls" not found
Jul 22 03:08:11.455157 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.455092    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7w8wg"]
Jul 22 03:08:11.459844 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.459823    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:11.464623 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.464268    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 03:08:11.465011 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.464987    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ms47k\""
Jul 22 03:08:11.465842 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.465585    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 03:08:11.489356 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.489208    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7w8wg"]
Jul 22 03:08:11.529523 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.529482    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:11.530020 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.529898    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cca486d-9cf2-45cb-8556-24146b4f0805-data-volume\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:11.530020 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.530013    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmqc7\" (UniqueName: \"kubernetes.io/projected/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-api-access-zmqc7\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:11.530130 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.530042    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:11.530130 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.530061    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1cca486d-9cf2-45cb-8556-24146b4f0805-crio-socket\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:11.631341 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.631260    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:11.631487 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.631349    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cca486d-9cf2-45cb-8556-24146b4f0805-data-volume\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:11.631487 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.631443    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmqc7\" (UniqueName: \"kubernetes.io/projected/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-api-access-zmqc7\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:11.631487 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.631478    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:11.631639 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.631508    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1cca486d-9cf2-45cb-8556-24146b4f0805-crio-socket\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:11.631685 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.631636    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1cca486d-9cf2-45cb-8556-24146b4f0805-crio-socket\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:11.631765 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:11.631748    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:11.631865 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:11.631841    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls podName:1cca486d-9cf2-45cb-8556-24146b4f0805 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:12.131822005 +0000 UTC m=+68.498457795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7w8wg" (UID: "1cca486d-9cf2-45cb-8556-24146b4f0805") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:11.632682 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.632324    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1cca486d-9cf2-45cb-8556-24146b4f0805-data-volume\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:11.632682 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:11.632599    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 03:08:11.632682 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:11.632646    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm podName:1cca486d-9cf2-45cb-8556-24146b4f0805 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:12.132629922 +0000 UTC m=+68.499265720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7w8wg" (UID: "1cca486d-9cf2-45cb-8556-24146b4f0805") : configmap "kube-rbac-proxy" not found
Jul 22 03:08:11.644013 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:11.643987    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmqc7\" (UniqueName: \"kubernetes.io/projected/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-api-access-zmqc7\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:12.137688 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.136851    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:12.137688 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.136960    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:12.137688 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:12.137176    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:12.137688 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:12.137232    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls podName:1cca486d-9cf2-45cb-8556-24146b4f0805 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:13.137217629 +0000 UTC m=+69.503853414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7w8wg" (UID: "1cca486d-9cf2-45cb-8556-24146b4f0805") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:12.137688 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:12.137594    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 03:08:12.137688 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:12.137643    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm podName:1cca486d-9cf2-45cb-8556-24146b4f0805 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:13.137626445 +0000 UTC m=+69.504262243 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7w8wg" (UID: "1cca486d-9cf2-45cb-8556-24146b4f0805") : configmap "kube-rbac-proxy" not found
Jul 22 03:08:12.392247 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.392173    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/1.log"
Jul 22 03:08:12.392689 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.392670    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/0.log"
Jul 22 03:08:12.392821 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.392708    2571 generic.go:356] "Generic (PLEG): container finished" podID="fb53639c-5549-446f-9cef-c864401e6ffc" containerID="4902c68df44b0fee4b02e5fe729683547aed5424e63114777a76cb4ad27a0dc7" exitCode=255
Jul 22 03:08:12.393397 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.393371    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk" event={"ID":"fb53639c-5549-446f-9cef-c864401e6ffc","Type":"ContainerDied","Data":"4902c68df44b0fee4b02e5fe729683547aed5424e63114777a76cb4ad27a0dc7"}
Jul 22 03:08:12.393492 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.393431    2571 scope.go:117] "RemoveContainer" containerID="cdea6278f374c2463ef1ef29764b23a278738130fd1fc557e00587e77c59c350"
Jul 22 03:08:12.395462 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.393758    2571 scope.go:117] "RemoveContainer" containerID="4902c68df44b0fee4b02e5fe729683547aed5424e63114777a76cb4ad27a0dc7"
Jul 22 03:08:12.395462 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:12.395122    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-9s5pk_openshift-console-operator(fb53639c-5549-446f-9cef-c864401e6ffc)\"" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk" podUID="fb53639c-5549-446f-9cef-c864401e6ffc"
Jul 22 03:08:12.650687 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.650614    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nkwt5_d09ef900-140e-47ef-91a0-5e325001248c/dns-node-resolver/0.log"
Jul 22 03:08:12.858975 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.857791    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-2wrm9"]
Jul 22 03:08:12.889430 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.888712    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-2wrm9"]
Jul 22 03:08:12.889430 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.888866    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2wrm9"
Jul 22 03:08:12.891830 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.891722    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hmd5b\""
Jul 22 03:08:12.945898 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:12.945806    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksvdr\" (UniqueName: \"kubernetes.io/projected/48a86d77-3bc6-460f-b7c5-6722c57c8ce9-kube-api-access-ksvdr\") pod \"network-check-source-7bc5b6bf85-2wrm9\" (UID: \"48a86d77-3bc6-460f-b7c5-6722c57c8ce9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2wrm9"
Jul 22 03:08:13.021242 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.021209    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"]
Jul 22 03:08:13.045155 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.045121    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"]
Jul 22 03:08:13.045310 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.045245    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"
Jul 22 03:08:13.046992 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.046955    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksvdr\" (UniqueName: \"kubernetes.io/projected/48a86d77-3bc6-460f-b7c5-6722c57c8ce9-kube-api-access-ksvdr\") pod \"network-check-source-7bc5b6bf85-2wrm9\" (UID: \"48a86d77-3bc6-460f-b7c5-6722c57c8ce9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2wrm9"
Jul 22 03:08:13.047992 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.047970    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:08:13.048133 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.048010    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 22 03:08:13.048133 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.048016    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-v5xct\""
Jul 22 03:08:13.048133 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.047968    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 22 03:08:13.048331 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.048304    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 22 03:08:13.057951 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.057895    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksvdr\" (UniqueName: \"kubernetes.io/projected/48a86d77-3bc6-460f-b7c5-6722c57c8ce9-kube-api-access-ksvdr\") pod \"network-check-source-7bc5b6bf85-2wrm9\" (UID: \"48a86d77-3bc6-460f-b7c5-6722c57c8ce9\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2wrm9"
Jul 22 03:08:13.147780 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.147742    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qhsw\" (UniqueName: \"kubernetes.io/projected/cd97be45-ef32-4732-ae5d-bc1c74d33833-kube-api-access-7qhsw\") pod \"service-ca-operator-5bcbc94c78-b8dmz\" (UID: \"cd97be45-ef32-4732-ae5d-bc1c74d33833\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"
Jul 22 03:08:13.147968 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.147829    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd97be45-ef32-4732-ae5d-bc1c74d33833-config\") pod \"service-ca-operator-5bcbc94c78-b8dmz\" (UID: \"cd97be45-ef32-4732-ae5d-bc1c74d33833\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"
Jul 22 03:08:13.147968 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.147877    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:13.147968 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.147910    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd97be45-ef32-4732-ae5d-bc1c74d33833-serving-cert\") pod \"service-ca-operator-5bcbc94c78-b8dmz\" (UID: \"cd97be45-ef32-4732-ae5d-bc1c74d33833\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"
Jul 22 03:08:13.147968 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.147957    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:13.148185 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:13.147992    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 03:08:13.148185 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:13.148065    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm podName:1cca486d-9cf2-45cb-8556-24146b4f0805 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:15.14804466 +0000 UTC m=+71.514680466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7w8wg" (UID: "1cca486d-9cf2-45cb-8556-24146b4f0805") : configmap "kube-rbac-proxy" not found
Jul 22 03:08:13.148185 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:13.148131    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:13.148185 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:13.148173    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls podName:1cca486d-9cf2-45cb-8556-24146b4f0805 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:15.148162905 +0000 UTC m=+71.514798689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7w8wg" (UID: "1cca486d-9cf2-45cb-8556-24146b4f0805") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:13.201455 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.201367    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2wrm9"
Jul 22 03:08:13.249532 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.249499    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qhsw\" (UniqueName: \"kubernetes.io/projected/cd97be45-ef32-4732-ae5d-bc1c74d33833-kube-api-access-7qhsw\") pod \"service-ca-operator-5bcbc94c78-b8dmz\" (UID: \"cd97be45-ef32-4732-ae5d-bc1c74d33833\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"
Jul 22 03:08:13.249704 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.249546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd97be45-ef32-4732-ae5d-bc1c74d33833-config\") pod \"service-ca-operator-5bcbc94c78-b8dmz\" (UID: \"cd97be45-ef32-4732-ae5d-bc1c74d33833\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"
Jul 22 03:08:13.249704 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.249599    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd97be45-ef32-4732-ae5d-bc1c74d33833-serving-cert\") pod \"service-ca-operator-5bcbc94c78-b8dmz\" (UID: \"cd97be45-ef32-4732-ae5d-bc1c74d33833\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"
Jul 22 03:08:13.250408 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.250372    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd97be45-ef32-4732-ae5d-bc1c74d33833-config\") pod \"service-ca-operator-5bcbc94c78-b8dmz\" (UID: \"cd97be45-ef32-4732-ae5d-bc1c74d33833\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"
Jul 22 03:08:13.252338 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.252316    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd97be45-ef32-4732-ae5d-bc1c74d33833-serving-cert\") pod \"service-ca-operator-5bcbc94c78-b8dmz\" (UID: \"cd97be45-ef32-4732-ae5d-bc1c74d33833\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"
Jul 22 03:08:13.259818 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.259794    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qhsw\" (UniqueName: \"kubernetes.io/projected/cd97be45-ef32-4732-ae5d-bc1c74d33833-kube-api-access-7qhsw\") pod \"service-ca-operator-5bcbc94c78-b8dmz\" (UID: \"cd97be45-ef32-4732-ae5d-bc1c74d33833\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"
Jul 22 03:08:13.357815 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.357759    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"
Jul 22 03:08:13.396932 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.396903    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/1.log"
Jul 22 03:08:13.397285 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.397262    2571 scope.go:117] "RemoveContainer" containerID="4902c68df44b0fee4b02e5fe729683547aed5424e63114777a76cb4ad27a0dc7"
Jul 22 03:08:13.397476 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:13.397456    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-9s5pk_openshift-console-operator(fb53639c-5549-446f-9cef-c864401e6ffc)\"" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk" podUID="fb53639c-5549-446f-9cef-c864401e6ffc"
Jul 22 03:08:13.649975 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:13.649949    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nnsvz_1a6d5075-10f2-4d3b-9462-0d22b9c76bae/node-ca/0.log"
Jul 22 03:08:14.249931 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:14.249852    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4nq2g_add3a796-07cf-480d-b349-30636ae15b19/serve-healthcheck-canary/0.log"
Jul 22 03:08:14.864346 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:14.864313    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:14.864560 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:14.864365    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:14.864560 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:14.864425    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:14.864560 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:14.864542    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 03:08:14.864729 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:14.864596    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle podName:eeed144b-f174-4605-b794-37eca9426475 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:22.864575824 +0000 UTC m=+79.231211630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle") pod "router-default-67f469f5c4-f25v7" (UID: "eeed144b-f174-4605-b794-37eca9426475") : configmap references non-existent config key: service-ca.crt
Jul 22 03:08:14.864729 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:14.864608    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 03:08:14.864729 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:14.864647    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls podName:2b78099e-aa06-419a-b007-3e026982ee8e nodeName:}" failed. No retries permitted until 2026-07-22 03:08:22.86462897 +0000 UTC m=+79.231264758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xstqz" (UID: "2b78099e-aa06-419a-b007-3e026982ee8e") : secret "cluster-monitoring-operator-tls" not found
Jul 22 03:08:14.864729 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:14.864662    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs podName:eeed144b-f174-4605-b794-37eca9426475 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:22.864655182 +0000 UTC m=+79.231290965 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs") pod "router-default-67f469f5c4-f25v7" (UID: "eeed144b-f174-4605-b794-37eca9426475") : secret "router-metrics-certs-default" not found
Jul 22 03:08:14.966252 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:14.966213    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 03:08:14.966399 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:14.966289    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls podName:0739ce58-839f-4b50-aa28-46c81706f461 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:22.966275992 +0000 UTC m=+79.332911776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-9qw7b" (UID: "0739ce58-839f-4b50-aa28-46c81706f461") : secret "samples-operator-tls" not found
Jul 22 03:08:14.966399 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:14.966217    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9qw7b\" (UID: \"0739ce58-839f-4b50-aa28-46c81706f461\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:15.168921 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:15.168824    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:15.169101 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:15.169008    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:15.169101 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:15.169013    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:15.169101 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:15.169072    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 03:08:15.169256 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:15.169082    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls podName:1cca486d-9cf2-45cb-8556-24146b4f0805 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:19.169062484 +0000 UTC m=+75.535698271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7w8wg" (UID: "1cca486d-9cf2-45cb-8556-24146b4f0805") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:15.169256 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:15.169170    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm podName:1cca486d-9cf2-45cb-8556-24146b4f0805 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:19.169147978 +0000 UTC m=+75.535783776 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7w8wg" (UID: "1cca486d-9cf2-45cb-8556-24146b4f0805") : configmap "kube-rbac-proxy" not found
Jul 22 03:08:16.037365 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:16.037214    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-2wrm9"]
Jul 22 03:08:16.040742 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:16.040701    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a86d77_3bc6_460f_b7c5_6722c57c8ce9.slice/crio-de33d2dfbb9937ce56655bf43600f9829c5312ff7b678cc956bc28b01cd84c9e WatchSource:0}: Error finding container de33d2dfbb9937ce56655bf43600f9829c5312ff7b678cc956bc28b01cd84c9e: Status 404 returned error can't find the container with id de33d2dfbb9937ce56655bf43600f9829c5312ff7b678cc956bc28b01cd84c9e
Jul 22 03:08:16.082487 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:16.082382    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz"]
Jul 22 03:08:16.087627 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:16.087598    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd97be45_ef32_4732_ae5d_bc1c74d33833.slice/crio-31481666c35b3354ccf03130c7e34f7d296b864fb42a5f610458b1905774d8f9 WatchSource:0}: Error finding container 31481666c35b3354ccf03130c7e34f7d296b864fb42a5f610458b1905774d8f9: Status 404 returned error can't find the container with id 31481666c35b3354ccf03130c7e34f7d296b864fb42a5f610458b1905774d8f9
Jul 22 03:08:16.407260 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:16.407223    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8hkl6" event={"ID":"caa42fdc-cc77-4d75-9fb0-082c328be3bc","Type":"ContainerStarted","Data":"6c1a96470726bba387277784f5cb42c545e5938a509e9383120641d7706ee718"}
Jul 22 03:08:16.407460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:16.407348    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:08:16.408832 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:16.408802    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2wrm9" event={"ID":"48a86d77-3bc6-460f-b7c5-6722c57c8ce9","Type":"ContainerStarted","Data":"8ae66b3d63ab466503980d3677d0b3f4e88dcc6273e2390c59cdb6e6faddb7a1"}
Jul 22 03:08:16.409025 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:16.408988    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2wrm9" event={"ID":"48a86d77-3bc6-460f-b7c5-6722c57c8ce9","Type":"ContainerStarted","Data":"de33d2dfbb9937ce56655bf43600f9829c5312ff7b678cc956bc28b01cd84c9e"}
Jul 22 03:08:16.410106 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:16.410059    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz" event={"ID":"cd97be45-ef32-4732-ae5d-bc1c74d33833","Type":"ContainerStarted","Data":"31481666c35b3354ccf03130c7e34f7d296b864fb42a5f610458b1905774d8f9"}
Jul 22 03:08:16.411793 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:16.411754    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz" event={"ID":"7315427a-044b-4fc9-b4f7-cbf7ba4f821c","Type":"ContainerStarted","Data":"f684e244df4f04c4e9d17402fa5dc1bebfd037feca67734f077f30eb5f1f314f"}
Jul 22 03:08:16.413480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:16.413459    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-64nk5" event={"ID":"ca554050-1a54-4d4a-86ac-fe03455e9bef","Type":"ContainerStarted","Data":"74ead739cd48ff02066ffd6f47829d602868a2d075623f3df11016a8474bfff9"}
Jul 22 03:08:16.424289 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:16.424248    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8hkl6" podStartSLOduration=67.035905194 podStartE2EDuration="1m12.424235136s" totalImagesPullingTime="5.388329942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:16.423688874 +0000 UTC m=+72.790324684" watchObservedRunningTime="2026-07-22 03:08:16.424235136 +0000 UTC m=+72.790870947"
Jul 22 03:08:16.442819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:16.442740    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-64nk5" podStartSLOduration=67.02572069 podStartE2EDuration="1m12.442720802s" totalImagesPullingTime="5.417000112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:16.442000741 +0000 UTC m=+72.808636548" watchObservedRunningTime="2026-07-22 03:08:16.442720802 +0000 UTC m=+72.809356590"
Jul 22 03:08:16.460296 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:16.460251    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-2wrm9" podStartSLOduration=4.460236386 podStartE2EDuration="4.460236386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:16.458856961 +0000 UTC m=+72.825492767" watchObservedRunningTime="2026-07-22 03:08:16.460236386 +0000 UTC m=+72.826872172"
Jul 22 03:08:17.435605 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:17.435552    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:17.436134 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:17.435922    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:17.436134 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:17.436026    2571 scope.go:117] "RemoveContainer" containerID="4902c68df44b0fee4b02e5fe729683547aed5424e63114777a76cb4ad27a0dc7"
Jul 22 03:08:17.436250 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:17.436220    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-9s5pk_openshift-console-operator(fb53639c-5549-446f-9cef-c864401e6ffc)\"" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk" podUID="fb53639c-5549-446f-9cef-c864401e6ffc"
Jul 22 03:08:18.422162 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:18.422135    2571 scope.go:117] "RemoveContainer" containerID="4902c68df44b0fee4b02e5fe729683547aed5424e63114777a76cb4ad27a0dc7"
Jul 22 03:08:18.422367 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:18.422339    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-9s5pk_openshift-console-operator(fb53639c-5549-446f-9cef-c864401e6ffc)\"" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk" podUID="fb53639c-5549-446f-9cef-c864401e6ffc"
Jul 22 03:08:19.210922 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:19.210865    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:19.211319 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:19.210969    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:19.211319 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:19.210992    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 03:08:19.211319 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:19.211077    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm podName:1cca486d-9cf2-45cb-8556-24146b4f0805 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:27.211055312 +0000 UTC m=+83.577691119 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7w8wg" (UID: "1cca486d-9cf2-45cb-8556-24146b4f0805") : configmap "kube-rbac-proxy" not found
Jul 22 03:08:19.211319 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:19.211141    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:19.211319 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:19.211207    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls podName:1cca486d-9cf2-45cb-8556-24146b4f0805 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:27.211190401 +0000 UTC m=+83.577826189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7w8wg" (UID: "1cca486d-9cf2-45cb-8556-24146b4f0805") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:19.426268 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:19.426236    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz" event={"ID":"cd97be45-ef32-4732-ae5d-bc1c74d33833","Type":"ContainerStarted","Data":"3593d0520d368f2691359eb0d9d6a5e8c892b154375dd3dea157f1f474fc0a14"}
Jul 22 03:08:19.449531 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:19.449481    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz" podStartSLOduration=3.984356737 podStartE2EDuration="6.449467568s" totalImagesPullingTime="2.465110831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:19.448431465 +0000 UTC m=+75.815067284" watchObservedRunningTime="2026-07-22 03:08:19.449467568 +0000 UTC m=+75.816103374"
Jul 22 03:08:19.450327 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:19.450299    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz" podStartSLOduration=5.082834916 podStartE2EDuration="10.450291601s" totalImagesPullingTime="5.367456685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:16.477502702 +0000 UTC m=+72.844138508" watchObservedRunningTime="2026-07-22 03:08:19.450291601 +0000 UTC m=+75.816927433"
Jul 22 03:08:22.942095 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:22.942062    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:22.942462 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:22.942108    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:22.942462 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:22.942130    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:22.942462 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:22.942228    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 22 03:08:22.942462 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:22.942230    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 22 03:08:22.942462 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:22.942258    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle podName:eeed144b-f174-4605-b794-37eca9426475 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:38.94224028 +0000 UTC m=+95.308876087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle") pod "router-default-67f469f5c4-f25v7" (UID: "eeed144b-f174-4605-b794-37eca9426475") : configmap references non-existent config key: service-ca.crt
Jul 22 03:08:22.942462 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:22.942281    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls podName:2b78099e-aa06-419a-b007-3e026982ee8e nodeName:}" failed. No retries permitted until 2026-07-22 03:08:38.942273709 +0000 UTC m=+95.308909493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-xstqz" (UID: "2b78099e-aa06-419a-b007-3e026982ee8e") : secret "cluster-monitoring-operator-tls" not found
Jul 22 03:08:22.942462 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:22.942296    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs podName:eeed144b-f174-4605-b794-37eca9426475 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:38.942287369 +0000 UTC m=+95.308923153 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs") pod "router-default-67f469f5c4-f25v7" (UID: "eeed144b-f174-4605-b794-37eca9426475") : secret "router-metrics-certs-default" not found
Jul 22 03:08:23.043494 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:23.043460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9qw7b\" (UID: \"0739ce58-839f-4b50-aa28-46c81706f461\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:23.043676 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:23.043568    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 22 03:08:23.043676 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:23.043624    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls podName:0739ce58-839f-4b50-aa28-46c81706f461 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:39.043611237 +0000 UTC m=+95.410247021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-9qw7b" (UID: "0739ce58-839f-4b50-aa28-46c81706f461") : secret "samples-operator-tls" not found
Jul 22 03:08:27.279179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:27.279044    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:27.279179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:27.279112    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:27.279709 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:27.279222    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:27.279709 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:27.279284    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls podName:1cca486d-9cf2-45cb-8556-24146b4f0805 nodeName:}" failed. No retries permitted until 2026-07-22 03:08:43.279268154 +0000 UTC m=+99.645903939 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7w8wg" (UID: "1cca486d-9cf2-45cb-8556-24146b4f0805") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:08:27.279709 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:27.279625    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1cca486d-9cf2-45cb-8556-24146b4f0805-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:31.098437 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:31.098405    2571 scope.go:117] "RemoveContainer" containerID="4902c68df44b0fee4b02e5fe729683547aed5424e63114777a76cb4ad27a0dc7"
Jul 22 03:08:31.464698 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:31.464627    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:08:31.465024 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:31.465007    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/1.log"
Jul 22 03:08:31.465077 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:31.465045    2571 generic.go:356] "Generic (PLEG): container finished" podID="fb53639c-5549-446f-9cef-c864401e6ffc" containerID="e005d61e5408e5bc40a41c2304a75d94accc3dfc28a86a54ac13a0afc8f42f4f" exitCode=255
Jul 22 03:08:31.465111 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:31.465078    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk" event={"ID":"fb53639c-5549-446f-9cef-c864401e6ffc","Type":"ContainerDied","Data":"e005d61e5408e5bc40a41c2304a75d94accc3dfc28a86a54ac13a0afc8f42f4f"}
Jul 22 03:08:31.465149 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:31.465123    2571 scope.go:117] "RemoveContainer" containerID="4902c68df44b0fee4b02e5fe729683547aed5424e63114777a76cb4ad27a0dc7"
Jul 22 03:08:31.465516 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:31.465499    2571 scope.go:117] "RemoveContainer" containerID="e005d61e5408e5bc40a41c2304a75d94accc3dfc28a86a54ac13a0afc8f42f4f"
Jul 22 03:08:31.465706 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:31.465687    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-9s5pk_openshift-console-operator(fb53639c-5549-446f-9cef-c864401e6ffc)\"" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk" podUID="fb53639c-5549-446f-9cef-c864401e6ffc"
Jul 22 03:08:32.469818 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:32.469793    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:08:37.436296 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:37.436244    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:37.436723 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:37.436336    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:08:37.436723 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:37.436627    2571 scope.go:117] "RemoveContainer" containerID="e005d61e5408e5bc40a41c2304a75d94accc3dfc28a86a54ac13a0afc8f42f4f"
Jul 22 03:08:37.436816 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:37.436766    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-9s5pk_openshift-console-operator(fb53639c-5549-446f-9cef-c864401e6ffc)\"" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk" podUID="fb53639c-5549-446f-9cef-c864401e6ffc"
Jul 22 03:08:38.978505 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:38.978456    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:38.978505 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:38.978518    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:38.979093 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:38.978542    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:38.979141 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:38.979093    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeed144b-f174-4605-b794-37eca9426475-service-ca-bundle\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:38.981126 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:38.981100    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeed144b-f174-4605-b794-37eca9426475-metrics-certs\") pod \"router-default-67f469f5c4-f25v7\" (UID: \"eeed144b-f174-4605-b794-37eca9426475\") " pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:38.981228 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:38.981145    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2b78099e-aa06-419a-b007-3e026982ee8e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-xstqz\" (UID: \"2b78099e-aa06-419a-b007-3e026982ee8e\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:39.079156 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:39.079124    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9qw7b\" (UID: \"0739ce58-839f-4b50-aa28-46c81706f461\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:39.081609 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:39.081582    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0739ce58-839f-4b50-aa28-46c81706f461-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-9qw7b\" (UID: \"0739ce58-839f-4b50-aa28-46c81706f461\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:39.229343 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:39.229264    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"
Jul 22 03:08:39.241559 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:39.241535    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:39.359123 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:39.359091    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"
Jul 22 03:08:39.368534 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:39.368502    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz"]
Jul 22 03:08:39.371694 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:39.371669    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b78099e_aa06_419a_b007_3e026982ee8e.slice/crio-42ce0cd41db4a9f1621c221b15137da1e6ed7b602a54ced5d4d5301bf20271d5 WatchSource:0}: Error finding container 42ce0cd41db4a9f1621c221b15137da1e6ed7b602a54ced5d4d5301bf20271d5: Status 404 returned error can't find the container with id 42ce0cd41db4a9f1621c221b15137da1e6ed7b602a54ced5d4d5301bf20271d5
Jul 22 03:08:39.390299 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:39.390266    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67f469f5c4-f25v7"]
Jul 22 03:08:39.396216 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:39.396191    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeed144b_f174_4605_b794_37eca9426475.slice/crio-4b866dc9a0844f06cb884e31728f2a1abe3289ec1369eb23e159e8d8bb6ed4ab WatchSource:0}: Error finding container 4b866dc9a0844f06cb884e31728f2a1abe3289ec1369eb23e159e8d8bb6ed4ab: Status 404 returned error can't find the container with id 4b866dc9a0844f06cb884e31728f2a1abe3289ec1369eb23e159e8d8bb6ed4ab
Jul 22 03:08:39.497976 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:39.497894    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67f469f5c4-f25v7" event={"ID":"eeed144b-f174-4605-b794-37eca9426475","Type":"ContainerStarted","Data":"d3ce2dc8a995bce264023566d7ff8e8d71687de813473dbdd05fc5fa2ffa4c05"}
Jul 22 03:08:39.497976 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:39.497968    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67f469f5c4-f25v7" event={"ID":"eeed144b-f174-4605-b794-37eca9426475","Type":"ContainerStarted","Data":"4b866dc9a0844f06cb884e31728f2a1abe3289ec1369eb23e159e8d8bb6ed4ab"}
Jul 22 03:08:39.498435 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:39.498416    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b"]
Jul 22 03:08:39.499205 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:39.499179    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz" event={"ID":"2b78099e-aa06-419a-b007-3e026982ee8e","Type":"ContainerStarted","Data":"42ce0cd41db4a9f1621c221b15137da1e6ed7b602a54ced5d4d5301bf20271d5"}
Jul 22 03:08:39.520550 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:39.520505    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-67f469f5c4-f25v7" podStartSLOduration=32.520487802 podStartE2EDuration="32.520487802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:39.519361331 +0000 UTC m=+95.885997138" watchObservedRunningTime="2026-07-22 03:08:39.520487802 +0000 UTC m=+95.887123608"
Jul 22 03:08:40.242142 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:40.242104    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:40.245314 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:40.245292    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:40.506981 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:40.506854    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b" event={"ID":"0739ce58-839f-4b50-aa28-46c81706f461","Type":"ContainerStarted","Data":"86f4d851ad06ceb43c2cad40b714c7f9414c0ccb485a1517f14a9eca6bba06b1"}
Jul 22 03:08:40.507282 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:40.507257    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:40.508766 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:40.508742    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-67f469f5c4-f25v7"
Jul 22 03:08:42.514456 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:42.514370    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz" event={"ID":"2b78099e-aa06-419a-b007-3e026982ee8e","Type":"ContainerStarted","Data":"bfeeb808b9c11e71f059e8af4156d3b8b0bd7fd2081def29283ee9b1091ca7ef"}
Jul 22 03:08:42.516348 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:42.516318    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b" event={"ID":"0739ce58-839f-4b50-aa28-46c81706f461","Type":"ContainerStarted","Data":"2da05f4e3fe645118779d2647b6e2a7464c7e7df7f0e069f30b2a84ccfca9b5f"}
Jul 22 03:08:42.516524 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:42.516371    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b" event={"ID":"0739ce58-839f-4b50-aa28-46c81706f461","Type":"ContainerStarted","Data":"c86d58d0a1902891a507954a329cd92db58e87470b4c8c6d8ffa8d4744282236"}
Jul 22 03:08:42.565287 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:42.565239    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-xstqz" podStartSLOduration=32.856314976 podStartE2EDuration="35.565223452s" totalImagesPullingTime="2.708908476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:42.564514795 +0000 UTC m=+98.931150601" watchObservedRunningTime="2026-07-22 03:08:42.565223452 +0000 UTC m=+98.931859283"
Jul 22 03:08:42.602690 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:42.602643    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-9qw7b" podStartSLOduration=33.055446215 podStartE2EDuration="35.602625765s" totalImagesPullingTime="2.54717955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:42.60180421 +0000 UTC m=+98.968440009" watchObservedRunningTime="2026-07-22 03:08:42.602625765 +0000 UTC m=+98.969261571"
Jul 22 03:08:43.316366 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.316271    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:43.318842 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.318813    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1cca486d-9cf2-45cb-8556-24146b4f0805-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w8wg\" (UID: \"1cca486d-9cf2-45cb-8556-24146b4f0805\") " pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:43.517909 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.517875    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:08:43.518314 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.517936    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:08:43.520913 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.520881    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls\") pod \"image-registry-594bdf5ffc-ggqtn\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") " pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:08:43.524179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.522121    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f097a0c-dc21-428a-a935-83a59b8e74a5-metrics-tls\") pod \"dns-default-hd9wg\" (UID: \"7f097a0c-dc21-428a-a935-83a59b8e74a5\") " pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:08:43.574961 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.574932    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7w8wg"
Jul 22 03:08:43.715119 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.715085    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7w8wg"]
Jul 22 03:08:43.718584 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:43.718552    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cca486d_9cf2_45cb_8556_24146b4f0805.slice/crio-6a64ec57fc1c9246f9016e822ece8aede357400441d97cc3450286c21345bf6f WatchSource:0}: Error finding container 6a64ec57fc1c9246f9016e822ece8aede357400441d97cc3450286c21345bf6f: Status 404 returned error can't find the container with id 6a64ec57fc1c9246f9016e822ece8aede357400441d97cc3450286c21345bf6f
Jul 22 03:08:43.730464 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.730434    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ndl8t\""
Jul 22 03:08:43.737764 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.737743    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:08:43.749405 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.749364    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bmpz5\""
Jul 22 03:08:43.756564 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.756539    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:08:43.888823 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.888790    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-594bdf5ffc-ggqtn"]
Jul 22 03:08:43.892381 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:43.892348    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f00f9e_67db_4c91_bc3a_ca8b4d1980bf.slice/crio-5396a94aeef6e4483e26a15410d23b30387ef3139d86f3fa6500e9c471fc1cd0 WatchSource:0}: Error finding container 5396a94aeef6e4483e26a15410d23b30387ef3139d86f3fa6500e9c471fc1cd0: Status 404 returned error can't find the container with id 5396a94aeef6e4483e26a15410d23b30387ef3139d86f3fa6500e9c471fc1cd0
Jul 22 03:08:43.903826 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:43.903803    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hd9wg"]
Jul 22 03:08:43.906959 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:43.906932    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f097a0c_dc21_428a_a935_83a59b8e74a5.slice/crio-3cb80bb2ba1fb77146c9abfd62762d19825b2914589449246b15186e9a0b4ee1 WatchSource:0}: Error finding container 3cb80bb2ba1fb77146c9abfd62762d19825b2914589449246b15186e9a0b4ee1: Status 404 returned error can't find the container with id 3cb80bb2ba1fb77146c9abfd62762d19825b2914589449246b15186e9a0b4ee1
Jul 22 03:08:44.527743 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:44.527668    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hd9wg" event={"ID":"7f097a0c-dc21-428a-a935-83a59b8e74a5","Type":"ContainerStarted","Data":"3cb80bb2ba1fb77146c9abfd62762d19825b2914589449246b15186e9a0b4ee1"}
Jul 22 03:08:44.530518 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:44.530418    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7w8wg" event={"ID":"1cca486d-9cf2-45cb-8556-24146b4f0805","Type":"ContainerStarted","Data":"6a64ec57fc1c9246f9016e822ece8aede357400441d97cc3450286c21345bf6f"}
Jul 22 03:08:44.533101 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:44.533070    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn" event={"ID":"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf","Type":"ContainerStarted","Data":"9d3db2cbf39dd08815224d579054cf98fab50ff00b1f9bfd7d70f8d221422b07"}
Jul 22 03:08:44.533224 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:44.533122    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn" event={"ID":"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf","Type":"ContainerStarted","Data":"5396a94aeef6e4483e26a15410d23b30387ef3139d86f3fa6500e9c471fc1cd0"}
Jul 22 03:08:44.533284 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:44.533257    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:08:44.570930 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:44.570868    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn" podStartSLOduration=78.57084416000001 podStartE2EDuration="1m18.57084416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:07:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:44.570118859 +0000 UTC m=+100.936754667" watchObservedRunningTime="2026-07-22 03:08:44.57084416 +0000 UTC m=+100.937479967"
Jul 22 03:08:46.543582 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:46.543541    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hd9wg" event={"ID":"7f097a0c-dc21-428a-a935-83a59b8e74a5","Type":"ContainerStarted","Data":"9bf871917e64cd9ad9507e5f0abdad3bbe2b0e0cd200a1fe52d425fe4ee2c0d4"}
Jul 22 03:08:46.544068 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:46.543644    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hd9wg" event={"ID":"7f097a0c-dc21-428a-a935-83a59b8e74a5","Type":"ContainerStarted","Data":"ed740c8ffb24c4b37dc997369c41f2dac5ff6b42d13b4aa15147fb8c062597cf"}
Jul 22 03:08:46.544396 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:46.544375    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:08:46.573532 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:46.573458    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hd9wg" podStartSLOduration=65.762483754 podStartE2EDuration="1m7.57343647s" totalImagesPullingTime="1.810952716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:46.572123255 +0000 UTC m=+102.938759066" watchObservedRunningTime="2026-07-22 03:08:46.57343647 +0000 UTC m=+102.940072280"
Jul 22 03:08:47.422015 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:47.421983    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8hkl6"
Jul 22 03:08:50.099116 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:50.099087    2571 scope.go:117] "RemoveContainer" containerID="e005d61e5408e5bc40a41c2304a75d94accc3dfc28a86a54ac13a0afc8f42f4f"
Jul 22 03:08:50.099565 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:50.099283    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-9s5pk_openshift-console-operator(fb53639c-5549-446f-9cef-c864401e6ffc)\"" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk" podUID="fb53639c-5549-446f-9cef-c864401e6ffc"
Jul 22 03:08:50.559429 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:50.559345    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7w8wg" event={"ID":"1cca486d-9cf2-45cb-8556-24146b4f0805","Type":"ContainerStarted","Data":"ca5320d9f7e14198d0918d02bc5665b795a0ece35422697c282d532a45859fe1"}
Jul 22 03:08:54.576167 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:54.576127    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7w8wg" event={"ID":"1cca486d-9cf2-45cb-8556-24146b4f0805","Type":"ContainerStarted","Data":"7e3b60642a6d09677760bde5b3b703d5bb778f323e79c36c89e5d94e249fd740"}
Jul 22 03:08:56.232327 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.232286    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"]
Jul 22 03:08:56.246257 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.246225    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4pqtr"]
Jul 22 03:08:56.246442 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.246373    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.250008 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.249978    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 22 03:08:56.250151 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.250008    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 22 03:08:56.250151 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.249983    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 03:08:56.250151 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.250130    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.250823 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.250801    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gff8z\""
Jul 22 03:08:56.253918 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.253899    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 03:08:56.254042 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.253987    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 03:08:56.254042 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.254036    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 03:08:56.254153 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.254124    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4pp55\""
Jul 22 03:08:56.256819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.256795    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"]
Jul 22 03:08:56.323794 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.323740    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-accelerators-collector-config\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.323794 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.323795    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrpxf\" (UniqueName: \"kubernetes.io/projected/5d7d958b-af45-4329-8099-667f2963ae42-kube-api-access-jrpxf\") pod \"openshift-state-metrics-79f6958cdf-6ffjx\" (UID: \"5d7d958b-af45-4329-8099-667f2963ae42\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.324007 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.323827    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d7d958b-af45-4329-8099-667f2963ae42-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-6ffjx\" (UID: \"5d7d958b-af45-4329-8099-667f2963ae42\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.324007 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.323876    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-textfile\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.324007 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.323916    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d7d958b-af45-4329-8099-667f2963ae42-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-6ffjx\" (UID: \"5d7d958b-af45-4329-8099-667f2963ae42\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.324007 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.323941    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-metrics-client-ca\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.324007 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.323956    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.324007 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.323983    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-wtmp\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.324007 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.324000    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-root\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.324276 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.324018    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-tls\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.324276 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.324086    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-sys\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.324276 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.324104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d7d958b-af45-4329-8099-667f2963ae42-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-6ffjx\" (UID: \"5d7d958b-af45-4329-8099-667f2963ae42\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.324276 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.324133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxjlx\" (UniqueName: \"kubernetes.io/projected/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-kube-api-access-jxjlx\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.425367 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425333    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-root\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.425367 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-tls\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.425640 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425438    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-sys\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.425640 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425440    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-root\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.425640 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425468    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d7d958b-af45-4329-8099-667f2963ae42-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-6ffjx\" (UID: \"5d7d958b-af45-4329-8099-667f2963ae42\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.425640 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425493    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-sys\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.425640 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425500    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxjlx\" (UniqueName: \"kubernetes.io/projected/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-kube-api-access-jxjlx\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.425966 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425690    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-accelerators-collector-config\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.425966 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425737    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrpxf\" (UniqueName: \"kubernetes.io/projected/5d7d958b-af45-4329-8099-667f2963ae42-kube-api-access-jrpxf\") pod \"openshift-state-metrics-79f6958cdf-6ffjx\" (UID: \"5d7d958b-af45-4329-8099-667f2963ae42\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.425966 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425767    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d7d958b-af45-4329-8099-667f2963ae42-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-6ffjx\" (UID: \"5d7d958b-af45-4329-8099-667f2963ae42\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.425966 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425827    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-textfile\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.425966 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425871    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d7d958b-af45-4329-8099-667f2963ae42-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-6ffjx\" (UID: \"5d7d958b-af45-4329-8099-667f2963ae42\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.425966 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425901    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-metrics-client-ca\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.425966 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425925    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.425966 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.425950    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-wtmp\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.426364 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.426110    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-wtmp\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.426441 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.426415    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-accelerators-collector-config\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.426905 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.426589    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-metrics-client-ca\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.426905 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.426797    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d7d958b-af45-4329-8099-667f2963ae42-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-6ffjx\" (UID: \"5d7d958b-af45-4329-8099-667f2963ae42\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.426905 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.426865    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-textfile\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.428690 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.428640    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-tls\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.428897 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.428867    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d7d958b-af45-4329-8099-667f2963ae42-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-6ffjx\" (UID: \"5d7d958b-af45-4329-8099-667f2963ae42\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.428992 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.428952    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d7d958b-af45-4329-8099-667f2963ae42-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-6ffjx\" (UID: \"5d7d958b-af45-4329-8099-667f2963ae42\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.429285 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.429256    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.435198 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.435172    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxjlx\" (UniqueName: \"kubernetes.io/projected/cef933de-f1fb-40bc-b9fe-34e45bcb0bb7-kube-api-access-jxjlx\") pod \"node-exporter-4pqtr\" (UID: \"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7\") " pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:56.435468 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.435445    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrpxf\" (UniqueName: \"kubernetes.io/projected/5d7d958b-af45-4329-8099-667f2963ae42-kube-api-access-jrpxf\") pod \"openshift-state-metrics-79f6958cdf-6ffjx\" (UID: \"5d7d958b-af45-4329-8099-667f2963ae42\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.561967 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.561824    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"
Jul 22 03:08:56.567019 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:56.566983    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4pqtr"
Jul 22 03:08:57.329314 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.329286    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx"]
Jul 22 03:08:57.332861 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:57.332833    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7d958b_af45_4329_8099_667f2963ae42.slice/crio-6237183ffc26c2c251e8ccf69b8d3a03d62149d92605ab2ad01c661dd32b76d2 WatchSource:0}: Error finding container 6237183ffc26c2c251e8ccf69b8d3a03d62149d92605ab2ad01c661dd32b76d2: Status 404 returned error can't find the container with id 6237183ffc26c2c251e8ccf69b8d3a03d62149d92605ab2ad01c661dd32b76d2
Jul 22 03:08:57.348172 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.348152    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 03:08:57.352910 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.352892    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.355646 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.355615    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 03:08:57.355756 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.355645    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qqfw6\""
Jul 22 03:08:57.355756 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.355691    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 03:08:57.355756 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.355625    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 03:08:57.355756 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.355695    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 03:08:57.356039 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.355810    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 03:08:57.356039 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.355694    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 03:08:57.356039 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.355813    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 03:08:57.356200 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.356079    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 03:08:57.356200 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.356104    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 03:08:57.371359 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.371323    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 03:08:57.435039 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.434969    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.435039 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.435006    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.435211 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.435061    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnttq\" (UniqueName: \"kubernetes.io/projected/bf186a49-aaba-407d-876d-eddc8ed4e36d-kube-api-access-qnttq\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.435211 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.435107    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf186a49-aaba-407d-876d-eddc8ed4e36d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.435211 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.435127    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf186a49-aaba-407d-876d-eddc8ed4e36d-config-out\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.435211 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.435153    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.435211 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.435169    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-web-config\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.435357 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.435217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.435357 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.435239    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.435357 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.435284    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.435357 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.435345    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-config-volume\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.435472 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.435378    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.435472 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.435408    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.536838 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.536806    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf186a49-aaba-407d-876d-eddc8ed4e36d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.536838 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.536847    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf186a49-aaba-407d-876d-eddc8ed4e36d-config-out\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.537083 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.536882    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.537083 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.536906    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-web-config\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.537183 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.537063    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.537183 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.537121    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.537273 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:08:57.537226    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-trusted-ca-bundle podName:bf186a49-aaba-407d-876d-eddc8ed4e36d nodeName:}" failed. No retries permitted until 2026-07-22 03:08:58.0372004 +0000 UTC m=+114.403836195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d") : configmap references non-existent config key: ca-bundle.crt
Jul 22 03:08:57.537273 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.537255    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.537387 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.537294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-config-volume\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.537387 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.537331    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.537387 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.537372    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.537530 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.537410    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.537530 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.537445    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.537530 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.537492    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnttq\" (UniqueName: \"kubernetes.io/projected/bf186a49-aaba-407d-876d-eddc8ed4e36d-kube-api-access-qnttq\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.538087 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.538048    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.538650 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.538574    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.541387 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.540983    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-config-volume\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.541387 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.541077    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf186a49-aaba-407d-876d-eddc8ed4e36d-config-out\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.541387 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.541349    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.541589 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.541445    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-web-config\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.541886 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.541841    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.542382 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.542361    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.542495 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.542476    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf186a49-aaba-407d-876d-eddc8ed4e36d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.542888 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.542870    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.543667 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.543642    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.551208 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.551189    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnttq\" (UniqueName: \"kubernetes.io/projected/bf186a49-aaba-407d-876d-eddc8ed4e36d-kube-api-access-qnttq\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:57.551995 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.551978    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hd9wg"
Jul 22 03:08:57.589436 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.589401    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4pqtr" event={"ID":"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7","Type":"ContainerStarted","Data":"8b50ce89df731d3c0c14ff03f1f390d9077df187cb1e18daa672b52958c67fe8"}
Jul 22 03:08:57.593970 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.593931    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx" event={"ID":"5d7d958b-af45-4329-8099-667f2963ae42","Type":"ContainerStarted","Data":"a093de0d4301e2b72b4d8025e3a1ba993ec84bcbeeb00eab9f182d918c9336be"}
Jul 22 03:08:57.594104 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.593999    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx" event={"ID":"5d7d958b-af45-4329-8099-667f2963ae42","Type":"ContainerStarted","Data":"bae5092f6af09a4e2718ffd4905a51262779f956ce88ee8247ab9c83f3fcc54b"}
Jul 22 03:08:57.594104 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.594030    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx" event={"ID":"5d7d958b-af45-4329-8099-667f2963ae42","Type":"ContainerStarted","Data":"6237183ffc26c2c251e8ccf69b8d3a03d62149d92605ab2ad01c661dd32b76d2"}
Jul 22 03:08:57.598244 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.598211    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7w8wg" event={"ID":"1cca486d-9cf2-45cb-8556-24146b4f0805","Type":"ContainerStarted","Data":"9e7658f51be9a70323a1ebe9c26cee6b3744ec2d5cd544a681828e35936373e5"}
Jul 22 03:08:57.619517 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:57.619458    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7w8wg" podStartSLOduration=33.29200799 podStartE2EDuration="46.619437462s" totalImagesPullingTime="13.327429472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:08:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:57.617493993 +0000 UTC m=+113.984129801" watchObservedRunningTime="2026-07-22 03:08:57.619437462 +0000 UTC m=+113.986073275"
Jul 22 03:08:58.042442 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:58.042410    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:58.043246 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:58.043227    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:58.273902 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:58.273869    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:08:58.433063 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:58.432947    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 03:08:58.435614 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:08:58.435575    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf186a49_aaba_407d_876d_eddc8ed4e36d.slice/crio-b816c979baefa714ee709e1adcf5d6d45e9d6d3bf7923c8ff154feac8109a9de WatchSource:0}: Error finding container b816c979baefa714ee709e1adcf5d6d45e9d6d3bf7923c8ff154feac8109a9de: Status 404 returned error can't find the container with id b816c979baefa714ee709e1adcf5d6d45e9d6d3bf7923c8ff154feac8109a9de
Jul 22 03:08:58.607336 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:58.607241    2571 generic.go:356] "Generic (PLEG): container finished" podID="cef933de-f1fb-40bc-b9fe-34e45bcb0bb7" containerID="08d07018e4ad443d49ed814c544429f964b7ed847a5d6f4305a3e781ce3f4fc5" exitCode=0
Jul 22 03:08:58.607336 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:58.607313    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4pqtr" event={"ID":"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7","Type":"ContainerDied","Data":"08d07018e4ad443d49ed814c544429f964b7ed847a5d6f4305a3e781ce3f4fc5"}
Jul 22 03:08:58.608916 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:58.608890    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerStarted","Data":"b816c979baefa714ee709e1adcf5d6d45e9d6d3bf7923c8ff154feac8109a9de"}
Jul 22 03:08:59.615793 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:59.615737    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4pqtr" event={"ID":"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7","Type":"ContainerStarted","Data":"fc0bbd4b1ef17ee1341cc1bac2434d0d0394ac0e5a612b7898687864c2e1302e"}
Jul 22 03:08:59.616250 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:59.615863    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4pqtr" event={"ID":"cef933de-f1fb-40bc-b9fe-34e45bcb0bb7","Type":"ContainerStarted","Data":"3ac0c097f207b162c420730a835ea495314bc26b316849ec6e468d1ebc666fba"}
Jul 22 03:08:59.618078 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:59.618050    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx" event={"ID":"5d7d958b-af45-4329-8099-667f2963ae42","Type":"ContainerStarted","Data":"cd6b13f17fb7d262a7b49b543aca3b43494f4d361e63c4e55b2f8ba7700eb0b3"}
Jul 22 03:08:59.637935 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:59.637887    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4pqtr" podStartSLOduration=2.66018772 podStartE2EDuration="3.637869516s" totalImagesPullingTime="907.608328ms" totalInitContainerRuntime="70.073468ms" isStatefulPod=true podCreationTimestamp="2026-07-22 03:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:59.636022753 +0000 UTC m=+116.002658560" watchObservedRunningTime="2026-07-22 03:08:59.637869516 +0000 UTC m=+116.004505299"
Jul 22 03:08:59.659763 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:08:59.659714    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6ffjx" podStartSLOduration=2.3471516230000002 podStartE2EDuration="3.659692929s" totalImagesPullingTime="1.312541306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:08:59.658035431 +0000 UTC m=+116.024671239" watchObservedRunningTime="2026-07-22 03:08:59.659692929 +0000 UTC m=+116.026328734"
Jul 22 03:09:00.622965 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.622933    2571 generic.go:356] "Generic (PLEG): container finished" podID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerID="12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892" exitCode=0
Jul 22 03:09:00.623386 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.623030    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerDied","Data":"12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892"}
Jul 22 03:09:00.658285 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.658251    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-86987f9f59-wxrcd"]
Jul 22 03:09:00.661373 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.661357    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.665010 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.664981    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 22 03:09:00.665010 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.665002    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 22 03:09:00.665205 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.665037    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 22 03:09:00.665205 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.664981    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 03:09:00.665309 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.665224    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-httd8\""
Jul 22 03:09:00.666008 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.665513    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cgn3cb0t7ag5j\""
Jul 22 03:09:00.673592 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.673572    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86987f9f59-wxrcd"]
Jul 22 03:09:00.766825 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.766767    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5043de74-e6dc-4076-8880-18310933e647-client-ca-bundle\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.767020 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.766851    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5043de74-e6dc-4076-8880-18310933e647-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.767020 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.766896    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5043de74-e6dc-4076-8880-18310933e647-secret-metrics-server-client-certs\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.767020 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.766930    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5043de74-e6dc-4076-8880-18310933e647-audit-log\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.767020 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.766959    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktw66\" (UniqueName: \"kubernetes.io/projected/5043de74-e6dc-4076-8880-18310933e647-kube-api-access-ktw66\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.767020 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.766980    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5043de74-e6dc-4076-8880-18310933e647-metrics-server-audit-profiles\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.767020 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.766997    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5043de74-e6dc-4076-8880-18310933e647-secret-metrics-server-tls\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.868302 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.868270    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5043de74-e6dc-4076-8880-18310933e647-client-ca-bundle\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.868482 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.868316    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5043de74-e6dc-4076-8880-18310933e647-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.868482 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.868353    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5043de74-e6dc-4076-8880-18310933e647-secret-metrics-server-client-certs\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.868482 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.868370    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5043de74-e6dc-4076-8880-18310933e647-audit-log\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.868482 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.868392    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktw66\" (UniqueName: \"kubernetes.io/projected/5043de74-e6dc-4076-8880-18310933e647-kube-api-access-ktw66\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.868482 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.868415    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5043de74-e6dc-4076-8880-18310933e647-metrics-server-audit-profiles\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.868482 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.868441    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5043de74-e6dc-4076-8880-18310933e647-secret-metrics-server-tls\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.868950 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.868927    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5043de74-e6dc-4076-8880-18310933e647-audit-log\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.869442 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.869419    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5043de74-e6dc-4076-8880-18310933e647-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.869838 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.869817    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5043de74-e6dc-4076-8880-18310933e647-metrics-server-audit-profiles\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.871023 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.870996    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5043de74-e6dc-4076-8880-18310933e647-client-ca-bundle\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.871108 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.870997    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5043de74-e6dc-4076-8880-18310933e647-secret-metrics-server-tls\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.871108 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.871031    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5043de74-e6dc-4076-8880-18310933e647-secret-metrics-server-client-certs\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.877334 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.877284    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktw66\" (UniqueName: \"kubernetes.io/projected/5043de74-e6dc-4076-8880-18310933e647-kube-api-access-ktw66\") pod \"metrics-server-86987f9f59-wxrcd\" (UID: \"5043de74-e6dc-4076-8880-18310933e647\") " pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:00.970266 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:00.970237    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:01.098373 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.098348    2571 scope.go:117] "RemoveContainer" containerID="e005d61e5408e5bc40a41c2304a75d94accc3dfc28a86a54ac13a0afc8f42f4f"
Jul 22 03:09:01.117238 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.117209    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86987f9f59-wxrcd"]
Jul 22 03:09:01.125908 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:09:01.125879    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5043de74_e6dc_4076_8880_18310933e647.slice/crio-182e4f967881a17329dd5020439b030bcbd17011ff21d5e11fd9901c025e5582 WatchSource:0}: Error finding container 182e4f967881a17329dd5020439b030bcbd17011ff21d5e11fd9901c025e5582: Status 404 returned error can't find the container with id 182e4f967881a17329dd5020439b030bcbd17011ff21d5e11fd9901c025e5582
Jul 22 03:09:01.630857 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.630810    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd" event={"ID":"5043de74-e6dc-4076-8880-18310933e647","Type":"ContainerStarted","Data":"182e4f967881a17329dd5020439b030bcbd17011ff21d5e11fd9901c025e5582"}
Jul 22 03:09:01.633395 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.633364    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:09:01.633594 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.633423    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk" event={"ID":"fb53639c-5549-446f-9cef-c864401e6ffc","Type":"ContainerStarted","Data":"a77a46f5355eeba80513cb9030fce098444c047a8c60c7bfbef673be77ad9b17"}
Jul 22 03:09:01.634707 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.634685    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:09:01.639987 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.639935    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk"
Jul 22 03:09:01.654649 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.654596    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-9s5pk" podStartSLOduration=51.885776121 podStartE2EDuration="54.654580882s" totalImagesPullingTime="2.768804761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:09:01.653626563 +0000 UTC m=+118.020262372" watchObservedRunningTime="2026-07-22 03:09:01.654580882 +0000 UTC m=+118.021216666"
Jul 22 03:09:01.786456 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.786427    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-q4ldm"]
Jul 22 03:09:01.789696 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.789679    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-q4ldm"
Jul 22 03:09:01.793693 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.793671    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rgqlt\""
Jul 22 03:09:01.793838 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.793807    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 03:09:01.794264 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.794250    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 03:09:01.800193 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.800168    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-q4ldm"]
Jul 22 03:09:01.879463 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.879430    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hmjf\" (UniqueName: \"kubernetes.io/projected/bd3635ba-2568-454c-9fae-7d7e3fc14013-kube-api-access-6hmjf\") pod \"downloads-5bc67dcd46-q4ldm\" (UID: \"bd3635ba-2568-454c-9fae-7d7e3fc14013\") " pod="openshift-console/downloads-5bc67dcd46-q4ldm"
Jul 22 03:09:01.980483 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.980384    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hmjf\" (UniqueName: \"kubernetes.io/projected/bd3635ba-2568-454c-9fae-7d7e3fc14013-kube-api-access-6hmjf\") pod \"downloads-5bc67dcd46-q4ldm\" (UID: \"bd3635ba-2568-454c-9fae-7d7e3fc14013\") " pod="openshift-console/downloads-5bc67dcd46-q4ldm"
Jul 22 03:09:01.993955 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:01.993925    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hmjf\" (UniqueName: \"kubernetes.io/projected/bd3635ba-2568-454c-9fae-7d7e3fc14013-kube-api-access-6hmjf\") pod \"downloads-5bc67dcd46-q4ldm\" (UID: \"bd3635ba-2568-454c-9fae-7d7e3fc14013\") " pod="openshift-console/downloads-5bc67dcd46-q4ldm"
Jul 22 03:09:02.099818 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:02.099758    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-q4ldm"
Jul 22 03:09:02.271823 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:02.270802    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-q4ldm"]
Jul 22 03:09:02.522698 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:09:02.522631    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd3635ba_2568_454c_9fae_7d7e3fc14013.slice/crio-8f787659a54eb213cfd085a3d5fa3f79073b08b2958a8c5864a59d757ffbcd88 WatchSource:0}: Error finding container 8f787659a54eb213cfd085a3d5fa3f79073b08b2958a8c5864a59d757ffbcd88: Status 404 returned error can't find the container with id 8f787659a54eb213cfd085a3d5fa3f79073b08b2958a8c5864a59d757ffbcd88
Jul 22 03:09:02.639478 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:02.639438    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-q4ldm" event={"ID":"bd3635ba-2568-454c-9fae-7d7e3fc14013","Type":"ContainerStarted","Data":"8f787659a54eb213cfd085a3d5fa3f79073b08b2958a8c5864a59d757ffbcd88"}
Jul 22 03:09:03.649220 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:03.649171    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd" event={"ID":"5043de74-e6dc-4076-8880-18310933e647","Type":"ContainerStarted","Data":"25bb65a66d9cf02a1fd18560cbc89f4f578fa88b937ac2235493a12a86c5629b"}
Jul 22 03:09:03.657101 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:03.656836    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerStarted","Data":"101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f"}
Jul 22 03:09:03.657101 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:03.656926    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerStarted","Data":"42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f"}
Jul 22 03:09:03.657101 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:03.656970    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerStarted","Data":"7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502"}
Jul 22 03:09:03.657101 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:03.657009    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerStarted","Data":"c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627"}
Jul 22 03:09:03.657101 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:03.657051    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerStarted","Data":"d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88"}
Jul 22 03:09:03.670989 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:03.670925    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd" podStartSLOduration=1.850347542 podStartE2EDuration="3.670902093s" totalImagesPullingTime="1.820554551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:09:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:09:03.669958577 +0000 UTC m=+120.036594385" watchObservedRunningTime="2026-07-22 03:09:03.670902093 +0000 UTC m=+120.037537903"
Jul 22 03:09:04.665632 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:04.665593    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerStarted","Data":"0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325"}
Jul 22 03:09:04.698514 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:04.698454    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.363187669 podStartE2EDuration="7.698431826s" totalImagesPullingTime="4.320522714s" totalInitContainerRuntime="14.721443ms" isStatefulPod=false podCreationTimestamp="2026-07-22 03:08:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:09:04.696750434 +0000 UTC m=+121.063386240" watchObservedRunningTime="2026-07-22 03:09:04.698431826 +0000 UTC m=+121.065067633"
Jul 22 03:09:05.361645 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:05.361598    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-594bdf5ffc-ggqtn"]
Jul 22 03:09:05.367266 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:05.367241    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:09:13.990673 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:13.990634    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:09:13.993572 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:13.993545    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7067f007-63eb-4ec1-93b0-2d8393994233-metrics-certs\") pod \"network-metrics-daemon-ggt8f\" (UID: \"7067f007-63eb-4ec1-93b0-2d8393994233\") " pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:09:14.122106 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:14.122070    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4gddc\""
Jul 22 03:09:14.129861 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:14.129833    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggt8f"
Jul 22 03:09:19.621353 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:19.621329    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ggt8f"]
Jul 22 03:09:19.623889 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:09:19.623864    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7067f007_63eb_4ec1_93b0_2d8393994233.slice/crio-ed39f55feec2da21ad3a6137b1ea0ff075ee0d81dfd895ef5d05e6c29ff25736 WatchSource:0}: Error finding container ed39f55feec2da21ad3a6137b1ea0ff075ee0d81dfd895ef5d05e6c29ff25736: Status 404 returned error can't find the container with id ed39f55feec2da21ad3a6137b1ea0ff075ee0d81dfd895ef5d05e6c29ff25736
Jul 22 03:09:19.735252 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:19.735219    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggt8f" event={"ID":"7067f007-63eb-4ec1-93b0-2d8393994233","Type":"ContainerStarted","Data":"ed39f55feec2da21ad3a6137b1ea0ff075ee0d81dfd895ef5d05e6c29ff25736"}
Jul 22 03:09:20.741964 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:20.741914    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-q4ldm" event={"ID":"bd3635ba-2568-454c-9fae-7d7e3fc14013","Type":"ContainerStarted","Data":"ebd38936df711d14e95401b21981cb639056e962dae493e34d64ccbbdf6f8047"}
Jul 22 03:09:20.742471 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:20.742285    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-q4ldm"
Jul 22 03:09:20.764000 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:20.763914    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-q4ldm" podStartSLOduration=2.605501644 podStartE2EDuration="19.763834979s" totalImagesPullingTime="17.158333335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:09:20.761243857 +0000 UTC m=+137.127879664" watchObservedRunningTime="2026-07-22 03:09:20.763834979 +0000 UTC m=+137.130470785"
Jul 22 03:09:20.766212 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:20.766183    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-q4ldm"
Jul 22 03:09:20.971324 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:20.971285    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:20.971517 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:20.971361    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:21.749602 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:21.749506    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggt8f" event={"ID":"7067f007-63eb-4ec1-93b0-2d8393994233","Type":"ContainerStarted","Data":"0b27bddd24d7fb9d5bcaab747c0c0c9750c4242ff70b168825e279c80d941536"}
Jul 22 03:09:21.749602 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:21.749578    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggt8f" event={"ID":"7067f007-63eb-4ec1-93b0-2d8393994233","Type":"ContainerStarted","Data":"c928c6321600c0508906308b39d9add3b1bc9542fbd9ea0cbedcefdf9dea5482"}
Jul 22 03:09:21.751754 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:21.751728    2571 generic.go:356] "Generic (PLEG): container finished" podID="7315427a-044b-4fc9-b4f7-cbf7ba4f821c" containerID="f684e244df4f04c4e9d17402fa5dc1bebfd037feca67734f077f30eb5f1f314f" exitCode=0
Jul 22 03:09:21.751899 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:21.751814    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz" event={"ID":"7315427a-044b-4fc9-b4f7-cbf7ba4f821c","Type":"ContainerDied","Data":"f684e244df4f04c4e9d17402fa5dc1bebfd037feca67734f077f30eb5f1f314f"}
Jul 22 03:09:21.752305 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:21.752288    2571 scope.go:117] "RemoveContainer" containerID="f684e244df4f04c4e9d17402fa5dc1bebfd037feca67734f077f30eb5f1f314f"
Jul 22 03:09:21.767576 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:21.767529    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ggt8f" podStartSLOduration=136.20560929 podStartE2EDuration="2m17.767508555s" totalImagesPullingTime="1.561899265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:09:21.765442321 +0000 UTC m=+138.132078132" watchObservedRunningTime="2026-07-22 03:09:21.767508555 +0000 UTC m=+138.134144394"
Jul 22 03:09:22.759417 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:22.759370    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2xhvz" event={"ID":"7315427a-044b-4fc9-b4f7-cbf7ba4f821c","Type":"ContainerStarted","Data":"a202d473133ed50a3fe510094994853fc9fdfc30f8868995d6c4a04611dadae5"}
Jul 22 03:09:30.386530 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:30.386480    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn" podUID="49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" containerName="registry" containerID="cri-o://9d3db2cbf39dd08815224d579054cf98fab50ff00b1f9bfd7d70f8d221422b07" gracePeriod=30
Jul 22 03:09:30.797117 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:30.797036    2571 generic.go:356] "Generic (PLEG): container finished" podID="49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" containerID="9d3db2cbf39dd08815224d579054cf98fab50ff00b1f9bfd7d70f8d221422b07" exitCode=0
Jul 22 03:09:30.797252 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:30.797120    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn" event={"ID":"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf","Type":"ContainerDied","Data":"9d3db2cbf39dd08815224d579054cf98fab50ff00b1f9bfd7d70f8d221422b07"}
Jul 22 03:09:31.175057 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.175025    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:09:31.239376 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.239339    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-image-registry-private-configuration\") pod \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") "
Jul 22 03:09:31.239376 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.239382    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-trusted-ca\") pod \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") "
Jul 22 03:09:31.239569 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.239411    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls\") pod \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") "
Jul 22 03:09:31.239569 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.239447    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-bound-sa-token\") pod \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") "
Jul 22 03:09:31.239569 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.239471    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7kmt\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-kube-api-access-f7kmt\") pod \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") "
Jul 22 03:09:31.239569 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.239548    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-ca-trust-extracted\") pod \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") "
Jul 22 03:09:31.239747 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.239571    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-installation-pull-secrets\") pod \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") "
Jul 22 03:09:31.239747 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.239606    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-certificates\") pod \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\" (UID: \"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf\") "
Jul 22 03:09:31.239983 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.239939    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:09:31.240220 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.240195    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:09:31.242115 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.242090    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:09:31.242216 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.242161    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:09:31.242376 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.242357    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:09:31.242559 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.242539    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:09:31.242792 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.242740    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-kube-api-access-f7kmt" (OuterVolumeSpecName: "kube-api-access-f7kmt") pod "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf"). InnerVolumeSpecName "kube-api-access-f7kmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:09:31.248493 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.248467    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" (UID: "49f00f9e-67db-4c91-bc3a-ca8b4d1980bf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:09:31.341173 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.341083    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-ca-trust-extracted\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:09:31.341173 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.341114    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-installation-pull-secrets\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:09:31.341173 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.341126    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-certificates\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:09:31.341173 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.341138    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-image-registry-private-configuration\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:09:31.341173 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.341148    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-trusted-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:09:31.341173 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.341156    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-registry-tls\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:09:31.341173 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.341164    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-bound-sa-token\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:09:31.341173 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.341171    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7kmt\" (UniqueName: \"kubernetes.io/projected/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf-kube-api-access-f7kmt\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:09:31.801891 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.801806    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn" event={"ID":"49f00f9e-67db-4c91-bc3a-ca8b4d1980bf","Type":"ContainerDied","Data":"5396a94aeef6e4483e26a15410d23b30387ef3139d86f3fa6500e9c471fc1cd0"}
Jul 22 03:09:31.801891 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.801839    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594bdf5ffc-ggqtn"
Jul 22 03:09:31.801891 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.801869    2571 scope.go:117] "RemoveContainer" containerID="9d3db2cbf39dd08815224d579054cf98fab50ff00b1f9bfd7d70f8d221422b07"
Jul 22 03:09:31.833236 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.833199    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-594bdf5ffc-ggqtn"]
Jul 22 03:09:31.846446 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:31.846415    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-594bdf5ffc-ggqtn"]
Jul 22 03:09:32.103266 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:32.103235    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" path="/var/lib/kubelet/pods/49f00f9e-67db-4c91-bc3a-ca8b4d1980bf/volumes"
Jul 22 03:09:40.976310 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:40.976273    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:40.980295 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:40.980263    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-86987f9f59-wxrcd"
Jul 22 03:09:44.856923 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:44.856892    2571 generic.go:356] "Generic (PLEG): container finished" podID="cd97be45-ef32-4732-ae5d-bc1c74d33833" containerID="3593d0520d368f2691359eb0d9d6a5e8c892b154375dd3dea157f1f474fc0a14" exitCode=0
Jul 22 03:09:44.857296 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:44.856941    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz" event={"ID":"cd97be45-ef32-4732-ae5d-bc1c74d33833","Type":"ContainerDied","Data":"3593d0520d368f2691359eb0d9d6a5e8c892b154375dd3dea157f1f474fc0a14"}
Jul 22 03:09:44.857296 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:44.857226    2571 scope.go:117] "RemoveContainer" containerID="3593d0520d368f2691359eb0d9d6a5e8c892b154375dd3dea157f1f474fc0a14"
Jul 22 03:09:45.863143 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:45.863109    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-b8dmz" event={"ID":"cd97be45-ef32-4732-ae5d-bc1c74d33833","Type":"ContainerStarted","Data":"3824b542c6ac31add38096ddbbff6fcee71b677fc370bf5399bcae2038d5109a"}
Jul 22 03:09:46.868294 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:46.868262    2571 generic.go:356] "Generic (PLEG): container finished" podID="23911fb3-ab85-424c-bddc-377af8b7f57b" containerID="580d3a790996eb6c1b87274740f42e46c7496f6a84763bb7d19df75c3bf8a549" exitCode=0
Jul 22 03:09:46.868733 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:46.868310    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-hwtzz" event={"ID":"23911fb3-ab85-424c-bddc-377af8b7f57b","Type":"ContainerDied","Data":"580d3a790996eb6c1b87274740f42e46c7496f6a84763bb7d19df75c3bf8a549"}
Jul 22 03:09:46.868733 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:46.868674    2571 scope.go:117] "RemoveContainer" containerID="580d3a790996eb6c1b87274740f42e46c7496f6a84763bb7d19df75c3bf8a549"
Jul 22 03:09:47.874436 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:09:47.874398    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-hwtzz" event={"ID":"23911fb3-ab85-424c-bddc-377af8b7f57b","Type":"ContainerStarted","Data":"1a8db6d9e858d32e76631faee9cc16cf8afa388823a913138432835e769cb235"}
Jul 22 03:10:16.537255 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.537220    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 03:10:16.537794 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.537491    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="alertmanager" containerID="cri-o://d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88" gracePeriod=120
Jul 22 03:10:16.537794 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.537570    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="kube-rbac-proxy-metric" containerID="cri-o://101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f" gracePeriod=120
Jul 22 03:10:16.537794 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.537575    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="kube-rbac-proxy-web" containerID="cri-o://7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502" gracePeriod=120
Jul 22 03:10:16.537794 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.537600    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="config-reloader" containerID="cri-o://c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627" gracePeriod=120
Jul 22 03:10:16.537794 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.537642    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="kube-rbac-proxy" containerID="cri-o://42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f" gracePeriod=120
Jul 22 03:10:16.537794 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.537633    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="prom-label-proxy" containerID="cri-o://0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325" gracePeriod=120
Jul 22 03:10:16.998922 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.998891    2571 generic.go:356] "Generic (PLEG): container finished" podID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerID="0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325" exitCode=0
Jul 22 03:10:16.998922 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.998915    2571 generic.go:356] "Generic (PLEG): container finished" podID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerID="42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f" exitCode=0
Jul 22 03:10:16.998922 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.998924    2571 generic.go:356] "Generic (PLEG): container finished" podID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerID="c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627" exitCode=0
Jul 22 03:10:16.998922 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.998932    2571 generic.go:356] "Generic (PLEG): container finished" podID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerID="d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88" exitCode=0
Jul 22 03:10:16.999187 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.998966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerDied","Data":"0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325"}
Jul 22 03:10:16.999187 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.999031    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerDied","Data":"42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f"}
Jul 22 03:10:16.999187 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.999060    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerDied","Data":"c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627"}
Jul 22 03:10:16.999187 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:16.999083    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerDied","Data":"d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88"}
Jul 22 03:10:17.785872 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.785850    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:17.842130 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.842045    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy-web\") pod \"bf186a49-aaba-407d-876d-eddc8ed4e36d\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") "
Jul 22 03:10:17.842130 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.842089    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-config-volume\") pod \"bf186a49-aaba-407d-876d-eddc8ed4e36d\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") "
Jul 22 03:10:17.842130 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.842113    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnttq\" (UniqueName: \"kubernetes.io/projected/bf186a49-aaba-407d-876d-eddc8ed4e36d-kube-api-access-qnttq\") pod \"bf186a49-aaba-407d-876d-eddc8ed4e36d\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") "
Jul 22 03:10:17.842386 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.842147    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-web-config\") pod \"bf186a49-aaba-407d-876d-eddc8ed4e36d\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") "
Jul 22 03:10:17.842386 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.842174    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy\") pod \"bf186a49-aaba-407d-876d-eddc8ed4e36d\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") "
Jul 22 03:10:17.842386 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.842296    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf186a49-aaba-407d-876d-eddc8ed4e36d-config-out\") pod \"bf186a49-aaba-407d-876d-eddc8ed4e36d\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") "
Jul 22 03:10:17.842386 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.842350    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"bf186a49-aaba-407d-876d-eddc8ed4e36d\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") "
Jul 22 03:10:17.842386 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.842381    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-trusted-ca-bundle\") pod \"bf186a49-aaba-407d-876d-eddc8ed4e36d\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") "
Jul 22 03:10:17.842641 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.842411    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-main-tls\") pod \"bf186a49-aaba-407d-876d-eddc8ed4e36d\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") "
Jul 22 03:10:17.842641 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.842583    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf186a49-aaba-407d-876d-eddc8ed4e36d-tls-assets\") pod \"bf186a49-aaba-407d-876d-eddc8ed4e36d\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") "
Jul 22 03:10:17.842939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.842673    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-metrics-client-ca\") pod \"bf186a49-aaba-407d-876d-eddc8ed4e36d\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") "
Jul 22 03:10:17.842939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.842709    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-cluster-tls-config\") pod \"bf186a49-aaba-407d-876d-eddc8ed4e36d\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") "
Jul 22 03:10:17.842939 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.842742    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-main-db\") pod \"bf186a49-aaba-407d-876d-eddc8ed4e36d\" (UID: \"bf186a49-aaba-407d-876d-eddc8ed4e36d\") "
Jul 22 03:10:17.843443 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.843411    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "bf186a49-aaba-407d-876d-eddc8ed4e36d" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:10:17.843973 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.843741    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "bf186a49-aaba-407d-876d-eddc8ed4e36d" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:10:17.843973 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.843923    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "bf186a49-aaba-407d-876d-eddc8ed4e36d" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:10:17.847267 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.846958    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-config-volume" (OuterVolumeSpecName: "config-volume") pod "bf186a49-aaba-407d-876d-eddc8ed4e36d" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:17.847267 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.847035    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "bf186a49-aaba-407d-876d-eddc8ed4e36d" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:17.847267 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.847100    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf186a49-aaba-407d-876d-eddc8ed4e36d-config-out" (OuterVolumeSpecName: "config-out") pod "bf186a49-aaba-407d-876d-eddc8ed4e36d" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:10:17.847267 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.847121    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "bf186a49-aaba-407d-876d-eddc8ed4e36d" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:17.847267 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.847169    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf186a49-aaba-407d-876d-eddc8ed4e36d-kube-api-access-qnttq" (OuterVolumeSpecName: "kube-api-access-qnttq") pod "bf186a49-aaba-407d-876d-eddc8ed4e36d" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d"). InnerVolumeSpecName "kube-api-access-qnttq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:10:17.847267 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.847231    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "bf186a49-aaba-407d-876d-eddc8ed4e36d" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:17.847635 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.847580    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "bf186a49-aaba-407d-876d-eddc8ed4e36d" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:17.847908 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.847886    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf186a49-aaba-407d-876d-eddc8ed4e36d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bf186a49-aaba-407d-876d-eddc8ed4e36d" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:10:17.851594 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.851568    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "bf186a49-aaba-407d-876d-eddc8ed4e36d" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:17.859002 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.858977    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-web-config" (OuterVolumeSpecName: "web-config") pod "bf186a49-aaba-407d-876d-eddc8ed4e36d" (UID: "bf186a49-aaba-407d-876d-eddc8ed4e36d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:10:17.943683 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.943636    2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-config-volume\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:10:17.943683 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.943679    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnttq\" (UniqueName: \"kubernetes.io/projected/bf186a49-aaba-407d-876d-eddc8ed4e36d-kube-api-access-qnttq\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:10:17.943683 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.943689    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-web-config\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:10:17.943683 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.943699    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:10:17.943979 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.943708    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf186a49-aaba-407d-876d-eddc8ed4e36d-config-out\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:10:17.943979 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.943717    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:10:17.943979 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.943726    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:10:17.943979 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.943735    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-main-tls\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:10:17.943979 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.943742    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf186a49-aaba-407d-876d-eddc8ed4e36d-tls-assets\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:10:17.943979 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.943750    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf186a49-aaba-407d-876d-eddc8ed4e36d-metrics-client-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:10:17.943979 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.943758    2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-cluster-tls-config\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:10:17.943979 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.943765    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bf186a49-aaba-407d-876d-eddc8ed4e36d-alertmanager-main-db\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:10:17.943979 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:17.943797    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf186a49-aaba-407d-876d-eddc8ed4e36d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:10:18.007078 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.007047    2571 generic.go:356] "Generic (PLEG): container finished" podID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerID="101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f" exitCode=0
Jul 22 03:10:18.007078 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.007071    2571 generic.go:356] "Generic (PLEG): container finished" podID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerID="7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502" exitCode=0
Jul 22 03:10:18.007264 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.007112    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerDied","Data":"101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f"}
Jul 22 03:10:18.007264 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.007147    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.007264 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.007169    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerDied","Data":"7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502"}
Jul 22 03:10:18.007264 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.007206    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf186a49-aaba-407d-876d-eddc8ed4e36d","Type":"ContainerDied","Data":"b816c979baefa714ee709e1adcf5d6d45e9d6d3bf7923c8ff154feac8109a9de"}
Jul 22 03:10:18.007264 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.007245    2571 scope.go:117] "RemoveContainer" containerID="0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325"
Jul 22 03:10:18.020750 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.020732    2571 scope.go:117] "RemoveContainer" containerID="101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f"
Jul 22 03:10:18.028050 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.028028    2571 scope.go:117] "RemoveContainer" containerID="42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f"
Jul 22 03:10:18.035246 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.035226    2571 scope.go:117] "RemoveContainer" containerID="7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502"
Jul 22 03:10:18.035503 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.035484    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 03:10:18.041790 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.041749    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 03:10:18.042441 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.042425    2571 scope.go:117] "RemoveContainer" containerID="c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627"
Jul 22 03:10:18.049521 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.049488    2571 scope.go:117] "RemoveContainer" containerID="d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88"
Jul 22 03:10:18.056725 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.056712    2571 scope.go:117] "RemoveContainer" containerID="12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892"
Jul 22 03:10:18.063816 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.063802    2571 scope.go:117] "RemoveContainer" containerID="0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325"
Jul 22 03:10:18.064071 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:10:18.064050    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325\": container with ID starting with 0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325 not found: ID does not exist" containerID="0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325"
Jul 22 03:10:18.064117 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.064081    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325"} err="failed to get container status \"0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325\": rpc error: code = NotFound desc = could not find container \"0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325\": container with ID starting with 0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325 not found: ID does not exist"
Jul 22 03:10:18.064117 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.064114    2571 scope.go:117] "RemoveContainer" containerID="101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f"
Jul 22 03:10:18.064368 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:10:18.064351    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f\": container with ID starting with 101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f not found: ID does not exist" containerID="101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f"
Jul 22 03:10:18.064409 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.064376    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f"} err="failed to get container status \"101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f\": rpc error: code = NotFound desc = could not find container \"101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f\": container with ID starting with 101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f not found: ID does not exist"
Jul 22 03:10:18.064409 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.064393    2571 scope.go:117] "RemoveContainer" containerID="42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f"
Jul 22 03:10:18.064619 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:10:18.064603    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f\": container with ID starting with 42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f not found: ID does not exist" containerID="42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f"
Jul 22 03:10:18.064652 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.064625    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f"} err="failed to get container status \"42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f\": rpc error: code = NotFound desc = could not find container \"42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f\": container with ID starting with 42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f not found: ID does not exist"
Jul 22 03:10:18.064652 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.064642    2571 scope.go:117] "RemoveContainer" containerID="7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502"
Jul 22 03:10:18.064921 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:10:18.064898    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502\": container with ID starting with 7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502 not found: ID does not exist" containerID="7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502"
Jul 22 03:10:18.064983 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.064929    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502"} err="failed to get container status \"7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502\": rpc error: code = NotFound desc = could not find container \"7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502\": container with ID starting with 7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502 not found: ID does not exist"
Jul 22 03:10:18.064983 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.064949    2571 scope.go:117] "RemoveContainer" containerID="c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627"
Jul 22 03:10:18.065178 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:10:18.065161    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627\": container with ID starting with c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627 not found: ID does not exist" containerID="c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627"
Jul 22 03:10:18.065234 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.065187    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627"} err="failed to get container status \"c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627\": rpc error: code = NotFound desc = could not find container \"c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627\": container with ID starting with c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627 not found: ID does not exist"
Jul 22 03:10:18.065234 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.065208    2571 scope.go:117] "RemoveContainer" containerID="d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88"
Jul 22 03:10:18.065449 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:10:18.065426    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88\": container with ID starting with d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88 not found: ID does not exist" containerID="d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88"
Jul 22 03:10:18.065494 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.065445    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88"} err="failed to get container status \"d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88\": rpc error: code = NotFound desc = could not find container \"d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88\": container with ID starting with d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88 not found: ID does not exist"
Jul 22 03:10:18.065494 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.065457    2571 scope.go:117] "RemoveContainer" containerID="12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892"
Jul 22 03:10:18.065680 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:10:18.065662    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892\": container with ID starting with 12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892 not found: ID does not exist" containerID="12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892"
Jul 22 03:10:18.065767 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.065680    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892"} err="failed to get container status \"12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892\": rpc error: code = NotFound desc = could not find container \"12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892\": container with ID starting with 12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892 not found: ID does not exist"
Jul 22 03:10:18.065767 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.065694    2571 scope.go:117] "RemoveContainer" containerID="0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325"
Jul 22 03:10:18.065978 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.065958    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325"} err="failed to get container status \"0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325\": rpc error: code = NotFound desc = could not find container \"0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325\": container with ID starting with 0042eef04c7279c0c164ac1fc5ff25d82286d9fc63c4c8ef6f85501a53853325 not found: ID does not exist"
Jul 22 03:10:18.066056 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.065980    2571 scope.go:117] "RemoveContainer" containerID="101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f"
Jul 22 03:10:18.066205 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.066187    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f"} err="failed to get container status \"101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f\": rpc error: code = NotFound desc = could not find container \"101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f\": container with ID starting with 101eca110645a4893c83ca18fd9771f3669b267fef93ba25bbc7e4fa21c53c2f not found: ID does not exist"
Jul 22 03:10:18.066260 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.066206    2571 scope.go:117] "RemoveContainer" containerID="42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f"
Jul 22 03:10:18.066415 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.066398    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f"} err="failed to get container status \"42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f\": rpc error: code = NotFound desc = could not find container \"42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f\": container with ID starting with 42f28ab4db4664d7e8aaa015de8477519438a8be57879a8926d1d49301c93e3f not found: ID does not exist"
Jul 22 03:10:18.066458 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.066418    2571 scope.go:117] "RemoveContainer" containerID="7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502"
Jul 22 03:10:18.066637 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.066622    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502"} err="failed to get container status \"7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502\": rpc error: code = NotFound desc = could not find container \"7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502\": container with ID starting with 7d52b215c058f995bf02b06bb57ed133f9f68429526324eecd6897b919950502 not found: ID does not exist"
Jul 22 03:10:18.066679 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.066638    2571 scope.go:117] "RemoveContainer" containerID="c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627"
Jul 22 03:10:18.066855 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.066838    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627"} err="failed to get container status \"c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627\": rpc error: code = NotFound desc = could not find container \"c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627\": container with ID starting with c889afa9b57d403c49462effbcd4861ba6071831b16ff39b9b026849b8c24627 not found: ID does not exist"
Jul 22 03:10:18.066902 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.066855    2571 scope.go:117] "RemoveContainer" containerID="d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88"
Jul 22 03:10:18.067055 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.067041    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88"} err="failed to get container status \"d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88\": rpc error: code = NotFound desc = could not find container \"d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88\": container with ID starting with d46e8e632b261c9501eccd52824881bd4dd4077be0caea62c760e0f396924a88 not found: ID does not exist"
Jul 22 03:10:18.067102 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.067056    2571 scope.go:117] "RemoveContainer" containerID="12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892"
Jul 22 03:10:18.067279 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.067263    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892"} err="failed to get container status \"12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892\": rpc error: code = NotFound desc = could not find container \"12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892\": container with ID starting with 12ff068739902b84b3660de01d4a61c409c93514cf964d433cda9e45ab783892 not found: ID does not exist"
Jul 22 03:10:18.070221 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070203    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 03:10:18.070500 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070489    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="alertmanager"
Jul 22 03:10:18.070556 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070503    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="alertmanager"
Jul 22 03:10:18.070556 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070519    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="kube-rbac-proxy-web"
Jul 22 03:10:18.070556 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070525    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="kube-rbac-proxy-web"
Jul 22 03:10:18.070556 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070535    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="init-config-reloader"
Jul 22 03:10:18.070556 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070540    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="init-config-reloader"
Jul 22 03:10:18.070556 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070549    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" containerName="registry"
Jul 22 03:10:18.070556 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070554    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" containerName="registry"
Jul 22 03:10:18.070556 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070559    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="kube-rbac-proxy"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070564    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="kube-rbac-proxy"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070571    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="config-reloader"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070576    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="config-reloader"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070582    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="kube-rbac-proxy-metric"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070587    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="kube-rbac-proxy-metric"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070593    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="prom-label-proxy"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070598    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="prom-label-proxy"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070651    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="kube-rbac-proxy"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070659    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="49f00f9e-67db-4c91-bc3a-ca8b4d1980bf" containerName="registry"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070665    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="kube-rbac-proxy-metric"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070672    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="prom-label-proxy"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070678    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="config-reloader"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070683    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="alertmanager"
Jul 22 03:10:18.070804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.070687    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" containerName="kube-rbac-proxy-web"
Jul 22 03:10:18.074703 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.074690    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.077127 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.077101    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 03:10:18.077218 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.077105    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 03:10:18.077332 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.077317    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 03:10:18.077554 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.077537    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 03:10:18.077554 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.077545    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 03:10:18.077706 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.077561    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 03:10:18.077706 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.077579    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 03:10:18.077706 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.077660    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qqfw6\""
Jul 22 03:10:18.077964 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.077909    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 03:10:18.082742 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.082722    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 03:10:18.092316 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.092259    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 03:10:18.103617 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.103594    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf186a49-aaba-407d-876d-eddc8ed4e36d" path="/var/lib/kubelet/pods/bf186a49-aaba-407d-876d-eddc8ed4e36d/volumes"
Jul 22 03:10:18.145648 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.145612    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.145648 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.145646    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.145864 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.145664    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-web-config\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.145864 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.145682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.145864 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.145736    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4573da65-d60e-4639-81cf-476725196fcb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.145864 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.145757    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kvvj\" (UniqueName: \"kubernetes.io/projected/4573da65-d60e-4639-81cf-476725196fcb-kube-api-access-2kvvj\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.145864 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.145793    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4573da65-d60e-4639-81cf-476725196fcb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.145864 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.145853    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.146045 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.145895    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.146045 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.145953    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4573da65-d60e-4639-81cf-476725196fcb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.146045 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.145981    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4573da65-d60e-4639-81cf-476725196fcb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.146045 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.146029    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-config-volume\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.146160 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.146050    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4573da65-d60e-4639-81cf-476725196fcb-config-out\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.246428 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.246389    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4573da65-d60e-4639-81cf-476725196fcb-config-out\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.246599 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.246437    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.246599 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.246457    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.246599 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.246472    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-web-config\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.246735 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.246596    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.246735 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.246640    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4573da65-d60e-4639-81cf-476725196fcb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.246735 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.246669    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kvvj\" (UniqueName: \"kubernetes.io/projected/4573da65-d60e-4639-81cf-476725196fcb-kube-api-access-2kvvj\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.246735 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.246692    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4573da65-d60e-4639-81cf-476725196fcb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.246735 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.246728    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.247006 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.246748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.247006 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.246821    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4573da65-d60e-4639-81cf-476725196fcb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.247006 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.246862    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4573da65-d60e-4639-81cf-476725196fcb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.247006 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.246906    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-config-volume\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.247602 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.247564    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4573da65-d60e-4639-81cf-476725196fcb-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.249215 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.249185    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-web-config\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.249586 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.249562    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4573da65-d60e-4639-81cf-476725196fcb-config-out\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.249710 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.249681    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.249936 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.249906    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.249936 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.249911    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.250059 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.250012    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4573da65-d60e-4639-81cf-476725196fcb-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.250196 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.250176    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4573da65-d60e-4639-81cf-476725196fcb-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.250463 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.250446    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4573da65-d60e-4639-81cf-476725196fcb-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.250530 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.250511    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-config-volume\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.251226 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.251211    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.251740 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.251717    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4573da65-d60e-4639-81cf-476725196fcb-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.258195 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.258178    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kvvj\" (UniqueName: \"kubernetes.io/projected/4573da65-d60e-4639-81cf-476725196fcb-kube-api-access-2kvvj\") pod \"alertmanager-main-0\" (UID: \"4573da65-d60e-4639-81cf-476725196fcb\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.384618 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.384542    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 03:10:18.536503 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:18.536479    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 03:10:18.538531 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:10:18.538501    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4573da65_d60e_4639_81cf_476725196fcb.slice/crio-e9ad556c6128a85a300502b84de5b4a669c4c2cc886f4ac4729053b26f7ee8eb WatchSource:0}: Error finding container e9ad556c6128a85a300502b84de5b4a669c4c2cc886f4ac4729053b26f7ee8eb: Status 404 returned error can't find the container with id e9ad556c6128a85a300502b84de5b4a669c4c2cc886f4ac4729053b26f7ee8eb
Jul 22 03:10:19.012911 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:19.012823    2571 generic.go:356] "Generic (PLEG): container finished" podID="4573da65-d60e-4639-81cf-476725196fcb" containerID="ee3ffee40f74cfcb504ff3767872eebdd4523301851b2afc5575875be0429f02" exitCode=0
Jul 22 03:10:19.012911 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:19.012876    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4573da65-d60e-4639-81cf-476725196fcb","Type":"ContainerDied","Data":"ee3ffee40f74cfcb504ff3767872eebdd4523301851b2afc5575875be0429f02"}
Jul 22 03:10:19.013305 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:19.012931    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4573da65-d60e-4639-81cf-476725196fcb","Type":"ContainerStarted","Data":"e9ad556c6128a85a300502b84de5b4a669c4c2cc886f4ac4729053b26f7ee8eb"}
Jul 22 03:10:20.021220 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.021182    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4573da65-d60e-4639-81cf-476725196fcb","Type":"ContainerStarted","Data":"a2ec9f0804d22abc575d4221982ee1884f9eff3caaa253ce8b8bf199ad951cac"}
Jul 22 03:10:20.021637 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.021276    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4573da65-d60e-4639-81cf-476725196fcb","Type":"ContainerStarted","Data":"e9d7fe07a923506bb0c5c4de21b2af2c64436c034e3c3615a6e2b21c387b078b"}
Jul 22 03:10:20.021637 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.021302    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4573da65-d60e-4639-81cf-476725196fcb","Type":"ContainerStarted","Data":"55eff328f06511cfd5f789d7e49ab5fc73492643ab2efb95b6f6b72def005e8d"}
Jul 22 03:10:20.021637 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.021338    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4573da65-d60e-4639-81cf-476725196fcb","Type":"ContainerStarted","Data":"f757e110662fc4d7134eeb00ae386d11cfda735b6f402f247e007d5b43cfdd6e"}
Jul 22 03:10:20.021637 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.021375    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4573da65-d60e-4639-81cf-476725196fcb","Type":"ContainerStarted","Data":"3cf85257cc5dd6815e91468321bbbaffaf3112d638022fde819f39a2856130ff"}
Jul 22 03:10:20.021637 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.021406    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4573da65-d60e-4639-81cf-476725196fcb","Type":"ContainerStarted","Data":"065c4e6d3f7a8e4673d1b718fc04372adc6a336deaed1c50030c8fa9592a178e"}
Jul 22 03:10:20.053514 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.053465    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.033631388 podStartE2EDuration="2.053449898s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.81851ms" isStatefulPod=false podCreationTimestamp="2026-07-22 03:10:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:10:20.052152618 +0000 UTC m=+196.418788423" watchObservedRunningTime="2026-07-22 03:10:20.053449898 +0000 UTC m=+196.420085703"
Jul 22 03:10:20.560717 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.560676    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7586fffd47-n2vpc"]
Jul 22 03:10:20.564558 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.564534    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.568387 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.568357    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 22 03:10:20.568520 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.568419    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 22 03:10:20.568578 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.568556    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 22 03:10:20.568672 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.568656    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bwbvs\""
Jul 22 03:10:20.568747 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.568733    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 22 03:10:20.568845 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.568825    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 22 03:10:20.573842 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.573819    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 22 03:10:20.580566 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.580537    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7586fffd47-n2vpc"]
Jul 22 03:10:20.669648 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.669612    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7123f453-da4c-467c-be3e-f1245d11dbbf-federate-client-tls\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.669882 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.669653    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7123f453-da4c-467c-be3e-f1245d11dbbf-secret-telemeter-client\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.669882 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.669694    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7123f453-da4c-467c-be3e-f1245d11dbbf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.669882 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.669719    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7123f453-da4c-467c-be3e-f1245d11dbbf-serving-certs-ca-bundle\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.669882 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.669742    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7123f453-da4c-467c-be3e-f1245d11dbbf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.669882 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.669864    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7123f453-da4c-467c-be3e-f1245d11dbbf-metrics-client-ca\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.670068 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.669904    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7123f453-da4c-467c-be3e-f1245d11dbbf-telemeter-client-tls\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.670068 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.669925    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz87k\" (UniqueName: \"kubernetes.io/projected/7123f453-da4c-467c-be3e-f1245d11dbbf-kube-api-access-fz87k\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.770424 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.770389    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7123f453-da4c-467c-be3e-f1245d11dbbf-federate-client-tls\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.770424 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.770424    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7123f453-da4c-467c-be3e-f1245d11dbbf-secret-telemeter-client\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.770641 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.770451    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7123f453-da4c-467c-be3e-f1245d11dbbf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.770641 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.770469    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7123f453-da4c-467c-be3e-f1245d11dbbf-serving-certs-ca-bundle\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.770641 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.770486    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7123f453-da4c-467c-be3e-f1245d11dbbf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.770641 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.770540    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7123f453-da4c-467c-be3e-f1245d11dbbf-metrics-client-ca\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.770641 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.770580    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7123f453-da4c-467c-be3e-f1245d11dbbf-telemeter-client-tls\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.770641 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.770604    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz87k\" (UniqueName: \"kubernetes.io/projected/7123f453-da4c-467c-be3e-f1245d11dbbf-kube-api-access-fz87k\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.771489 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.771446    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7123f453-da4c-467c-be3e-f1245d11dbbf-serving-certs-ca-bundle\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.771793 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.771740    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7123f453-da4c-467c-be3e-f1245d11dbbf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.772003 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.771980    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7123f453-da4c-467c-be3e-f1245d11dbbf-metrics-client-ca\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.773131 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.773105    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/7123f453-da4c-467c-be3e-f1245d11dbbf-secret-telemeter-client\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.773262 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.773239    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7123f453-da4c-467c-be3e-f1245d11dbbf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.773319 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.773263    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/7123f453-da4c-467c-be3e-f1245d11dbbf-federate-client-tls\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.773371 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.773338    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/7123f453-da4c-467c-be3e-f1245d11dbbf-telemeter-client-tls\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.779090 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.779070    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz87k\" (UniqueName: \"kubernetes.io/projected/7123f453-da4c-467c-be3e-f1245d11dbbf-kube-api-access-fz87k\") pod \"telemeter-client-7586fffd47-n2vpc\" (UID: \"7123f453-da4c-467c-be3e-f1245d11dbbf\") " pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:20.874955 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:20.874909    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc"
Jul 22 03:10:21.007073 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:21.007043    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7586fffd47-n2vpc"]
Jul 22 03:10:21.008914 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:10:21.008884    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7123f453_da4c_467c_be3e_f1245d11dbbf.slice/crio-da76c5d7a5c9b49d89ef6c3472ea5256a7f9f1e2f5aa1a35c29b498c80cc3e48 WatchSource:0}: Error finding container da76c5d7a5c9b49d89ef6c3472ea5256a7f9f1e2f5aa1a35c29b498c80cc3e48: Status 404 returned error can't find the container with id da76c5d7a5c9b49d89ef6c3472ea5256a7f9f1e2f5aa1a35c29b498c80cc3e48
Jul 22 03:10:21.026161 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:21.026130    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc" event={"ID":"7123f453-da4c-467c-be3e-f1245d11dbbf","Type":"ContainerStarted","Data":"da76c5d7a5c9b49d89ef6c3472ea5256a7f9f1e2f5aa1a35c29b498c80cc3e48"}
Jul 22 03:10:24.042318 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:24.042281    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc" event={"ID":"7123f453-da4c-467c-be3e-f1245d11dbbf","Type":"ContainerStarted","Data":"c326489b86598274549711539227a22371dd0d523cde31d2c502ef5df609ddb4"}
Jul 22 03:10:24.042796 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:24.042387    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc" event={"ID":"7123f453-da4c-467c-be3e-f1245d11dbbf","Type":"ContainerStarted","Data":"0d6e16931bdc9d367ea4071f0a2d0c57814295afc62c242b7d6ca45e65a779a1"}
Jul 22 03:10:24.042796 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:24.042418    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc" event={"ID":"7123f453-da4c-467c-be3e-f1245d11dbbf","Type":"ContainerStarted","Data":"47dfc04fbf9e06e5cf4e3c52ad139b9ce156cee7fd6650090ec58df7e61cd5b0"}
Jul 22 03:10:24.065854 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:10:24.065808    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7586fffd47-n2vpc" podStartSLOduration=1.88442424 podStartE2EDuration="4.065791463s" totalImagesPullingTime="2.181367223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:10:24.063293156 +0000 UTC m=+200.429928961" watchObservedRunningTime="2026-07-22 03:10:24.065791463 +0000 UTC m=+200.432427275"
Jul 22 03:12:03.997478 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:03.997450    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:12:04.002464 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:04.002437    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:12:04.005873 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:04.005853    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:12:04.008621 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:04.008602    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 03:12:04.016914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:04.016887    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:12:37.337952 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.337919    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-456tr"]
Jul 22 03:12:37.341130 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.341115    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-456tr"
Jul 22 03:12:37.343830 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.343796    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 22 03:12:37.344730 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.344715    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 22 03:12:37.344825 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.344751    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lw2n8\""
Jul 22 03:12:37.351968 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.351948    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-456tr"]
Jul 22 03:12:37.462237 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.462205    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn4nx\" (UniqueName: \"kubernetes.io/projected/a3f835bd-389f-4c11-b946-453d1de6b009-kube-api-access-kn4nx\") pod \"cert-manager-webhook-6486ffd997-456tr\" (UID: \"a3f835bd-389f-4c11-b946-453d1de6b009\") " pod="cert-manager/cert-manager-webhook-6486ffd997-456tr"
Jul 22 03:12:37.462447 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.462257    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3f835bd-389f-4c11-b946-453d1de6b009-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-456tr\" (UID: \"a3f835bd-389f-4c11-b946-453d1de6b009\") " pod="cert-manager/cert-manager-webhook-6486ffd997-456tr"
Jul 22 03:12:37.563676 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.563644    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn4nx\" (UniqueName: \"kubernetes.io/projected/a3f835bd-389f-4c11-b946-453d1de6b009-kube-api-access-kn4nx\") pod \"cert-manager-webhook-6486ffd997-456tr\" (UID: \"a3f835bd-389f-4c11-b946-453d1de6b009\") " pod="cert-manager/cert-manager-webhook-6486ffd997-456tr"
Jul 22 03:12:37.563893 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.563697    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3f835bd-389f-4c11-b946-453d1de6b009-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-456tr\" (UID: \"a3f835bd-389f-4c11-b946-453d1de6b009\") " pod="cert-manager/cert-manager-webhook-6486ffd997-456tr"
Jul 22 03:12:37.575356 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.575320    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3f835bd-389f-4c11-b946-453d1de6b009-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-456tr\" (UID: \"a3f835bd-389f-4c11-b946-453d1de6b009\") " pod="cert-manager/cert-manager-webhook-6486ffd997-456tr"
Jul 22 03:12:37.575470 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.575437    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn4nx\" (UniqueName: \"kubernetes.io/projected/a3f835bd-389f-4c11-b946-453d1de6b009-kube-api-access-kn4nx\") pod \"cert-manager-webhook-6486ffd997-456tr\" (UID: \"a3f835bd-389f-4c11-b946-453d1de6b009\") " pod="cert-manager/cert-manager-webhook-6486ffd997-456tr"
Jul 22 03:12:37.666074 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.665983    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-456tr"
Jul 22 03:12:37.795678 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.795655    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-456tr"]
Jul 22 03:12:37.798391 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:12:37.798364    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3f835bd_389f_4c11_b946_453d1de6b009.slice/crio-a451c49f252675f8da97f8b88a3912ebe57bef186d09a03e5cf301b96fc2afa7 WatchSource:0}: Error finding container a451c49f252675f8da97f8b88a3912ebe57bef186d09a03e5cf301b96fc2afa7: Status 404 returned error can't find the container with id a451c49f252675f8da97f8b88a3912ebe57bef186d09a03e5cf301b96fc2afa7
Jul 22 03:12:37.800412 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:37.800395    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:12:38.575518 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:38.575448    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-456tr" event={"ID":"a3f835bd-389f-4c11-b946-453d1de6b009","Type":"ContainerStarted","Data":"a451c49f252675f8da97f8b88a3912ebe57bef186d09a03e5cf301b96fc2afa7"}
Jul 22 03:12:41.588733 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:41.588702    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-456tr" event={"ID":"a3f835bd-389f-4c11-b946-453d1de6b009","Type":"ContainerStarted","Data":"10bab2cab8c51e11d1420127c6bdb4c954a050dfe6277d1b1c2494732b2e0cc9"}
Jul 22 03:12:41.589112 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:41.588833    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-456tr"
Jul 22 03:12:41.606728 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:41.606683    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-456tr" podStartSLOduration=1.641427314 podStartE2EDuration="4.606667672s" totalImagesPullingTime="2.965240358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:12:41.605938237 +0000 UTC m=+337.972574043" watchObservedRunningTime="2026-07-22 03:12:41.606667672 +0000 UTC m=+337.973303478"
Jul 22 03:12:47.595631 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:47.595600    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-456tr"
Jul 22 03:12:49.972268 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:49.972234    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qftfx"]
Jul 22 03:12:49.975819 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:49.975800    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qftfx"
Jul 22 03:12:49.978594 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:49.978568    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mxftq\""
Jul 22 03:12:49.986246 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:49.986227    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qftfx"]
Jul 22 03:12:50.073871 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:50.073837    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28bcd66c-9022-47a8-b0c6-27f4cb40fae8-bound-sa-token\") pod \"cert-manager-55b4d954d5-qftfx\" (UID: \"28bcd66c-9022-47a8-b0c6-27f4cb40fae8\") " pod="cert-manager/cert-manager-55b4d954d5-qftfx"
Jul 22 03:12:50.074041 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:50.073890    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp7gw\" (UniqueName: \"kubernetes.io/projected/28bcd66c-9022-47a8-b0c6-27f4cb40fae8-kube-api-access-xp7gw\") pod \"cert-manager-55b4d954d5-qftfx\" (UID: \"28bcd66c-9022-47a8-b0c6-27f4cb40fae8\") " pod="cert-manager/cert-manager-55b4d954d5-qftfx"
Jul 22 03:12:50.174917 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:50.174875    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28bcd66c-9022-47a8-b0c6-27f4cb40fae8-bound-sa-token\") pod \"cert-manager-55b4d954d5-qftfx\" (UID: \"28bcd66c-9022-47a8-b0c6-27f4cb40fae8\") " pod="cert-manager/cert-manager-55b4d954d5-qftfx"
Jul 22 03:12:50.174917 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:50.174911    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp7gw\" (UniqueName: \"kubernetes.io/projected/28bcd66c-9022-47a8-b0c6-27f4cb40fae8-kube-api-access-xp7gw\") pod \"cert-manager-55b4d954d5-qftfx\" (UID: \"28bcd66c-9022-47a8-b0c6-27f4cb40fae8\") " pod="cert-manager/cert-manager-55b4d954d5-qftfx"
Jul 22 03:12:50.184365 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:50.184329    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp7gw\" (UniqueName: \"kubernetes.io/projected/28bcd66c-9022-47a8-b0c6-27f4cb40fae8-kube-api-access-xp7gw\") pod \"cert-manager-55b4d954d5-qftfx\" (UID: \"28bcd66c-9022-47a8-b0c6-27f4cb40fae8\") " pod="cert-manager/cert-manager-55b4d954d5-qftfx"
Jul 22 03:12:50.184365 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:50.184331    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/28bcd66c-9022-47a8-b0c6-27f4cb40fae8-bound-sa-token\") pod \"cert-manager-55b4d954d5-qftfx\" (UID: \"28bcd66c-9022-47a8-b0c6-27f4cb40fae8\") " pod="cert-manager/cert-manager-55b4d954d5-qftfx"
Jul 22 03:12:50.285744 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:50.285652    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qftfx"
Jul 22 03:12:50.415496 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:50.415470    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qftfx"]
Jul 22 03:12:50.417970 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:12:50.417945    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28bcd66c_9022_47a8_b0c6_27f4cb40fae8.slice/crio-7c5389bd91d3ce6bc22819c75f2eda003310b09626374440a197b141e425c113 WatchSource:0}: Error finding container 7c5389bd91d3ce6bc22819c75f2eda003310b09626374440a197b141e425c113: Status 404 returned error can't find the container with id 7c5389bd91d3ce6bc22819c75f2eda003310b09626374440a197b141e425c113
Jul 22 03:12:50.626936 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:50.626906    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qftfx" event={"ID":"28bcd66c-9022-47a8-b0c6-27f4cb40fae8","Type":"ContainerStarted","Data":"8afcc0334a17dd416e1d61d42ce4f4cf921cac79b072e282f2af545fca342185"}
Jul 22 03:12:50.626936 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:50.626949    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qftfx" event={"ID":"28bcd66c-9022-47a8-b0c6-27f4cb40fae8","Type":"ContainerStarted","Data":"7c5389bd91d3ce6bc22819c75f2eda003310b09626374440a197b141e425c113"}
Jul 22 03:12:50.642886 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:12:50.642834    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-qftfx" podStartSLOduration=1.642818272 podStartE2EDuration="1.642818272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:12:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:12:50.641848679 +0000 UTC m=+347.008484486" watchObservedRunningTime="2026-07-22 03:12:50.642818272 +0000 UTC m=+347.009454078"
Jul 22 03:13:11.472894 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.472811    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"]
Jul 22 03:13:11.476183 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.476163    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.479077 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.479054    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 03:13:11.479224 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.479053    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 03:13:11.479224 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.479057    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 03:13:11.479224 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.479137    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mmj5l\""
Jul 22 03:13:11.479224 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.479170    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 03:13:11.497144 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.497122    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"]
Jul 22 03:13:11.568645 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.568612    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.568645 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.568648    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.568925 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.568678    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-manifests\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.568925 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.568738    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-tmp\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.568925 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.568811    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flx7n\" (UniqueName: \"kubernetes.io/projected/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-kube-api-access-flx7n\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.669475 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.669439    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.669475 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.669479    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.669681 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.669543    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-manifests\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.669681 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.669590    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-tmp\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.669681 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.669627    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flx7n\" (UniqueName: \"kubernetes.io/projected/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-kube-api-access-flx7n\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.670072 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.670043    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-manifests\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.671902 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.671880    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-tmp\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.672109 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.672093    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.672267 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.672247    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.678655 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.678633    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flx7n\" (UniqueName: \"kubernetes.io/projected/486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514-kube-api-access-flx7n\") pod \"opendatahub-operator-controller-manager-5fb7f869bf-jr644\" (UID: \"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514\") " pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.787295 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.787195    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:11.928192 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:11.928168    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"]
Jul 22 03:13:11.930340 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:13:11.930308    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod486a0fbe_f8c2_4fd3_9c6a_5e471cfc3514.slice/crio-7eff2fcec3058f41f1272dcba51ed40b4403f37205f8621ebe42e3fbcf198c7a WatchSource:0}: Error finding container 7eff2fcec3058f41f1272dcba51ed40b4403f37205f8621ebe42e3fbcf198c7a: Status 404 returned error can't find the container with id 7eff2fcec3058f41f1272dcba51ed40b4403f37205f8621ebe42e3fbcf198c7a
Jul 22 03:13:12.719506 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:12.719424    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644" event={"ID":"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514","Type":"ContainerStarted","Data":"7eff2fcec3058f41f1272dcba51ed40b4403f37205f8621ebe42e3fbcf198c7a"}
Jul 22 03:13:15.735790 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:15.735729    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644" event={"ID":"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514","Type":"ContainerStarted","Data":"4c7cc4726c48e1e6cb808c9ffcbd1b3d6a4d45d1480b78b88a64733dca7bacf0"}
Jul 22 03:13:16.741994 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:16.741965    2571 generic.go:356] "Generic (PLEG): container finished" podID="486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514" containerID="4c7cc4726c48e1e6cb808c9ffcbd1b3d6a4d45d1480b78b88a64733dca7bacf0" exitCode=0
Jul 22 03:13:16.742429 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:16.742018    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644" event={"ID":"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514","Type":"ContainerDied","Data":"4c7cc4726c48e1e6cb808c9ffcbd1b3d6a4d45d1480b78b88a64733dca7bacf0"}
Jul 22 03:13:17.754047 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:17.754014    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644" event={"ID":"486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514","Type":"ContainerStarted","Data":"5c793f3ef033c10d6d9db55def419d69e26b7c3809c93fd94a0b510bd8a3a4a9"}
Jul 22 03:13:17.754424 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:17.754164    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:17.776948 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:17.776901    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644" podStartSLOduration=2.1957711189999998 podStartE2EDuration="6.776886722s" totalImagesPullingTime="3.530745111s" totalInitContainerRuntime="1.050370492s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:13:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:13:17.775504298 +0000 UTC m=+374.142140104" watchObservedRunningTime="2026-07-22 03:13:17.776886722 +0000 UTC m=+374.143522527"
Jul 22 03:13:28.761121 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:28.761091    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5fb7f869bf-jr644"
Jul 22 03:13:31.811894 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:31.811859    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-g7gbq"]
Jul 22 03:13:31.815317 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:31.815296    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq"
Jul 22 03:13:31.823404 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:31.823376    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 22 03:13:31.823534 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:31.823499    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-chb5j\""
Jul 22 03:13:31.847695 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:31.847668    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-g7gbq"]
Jul 22 03:13:31.937575 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:31.937544    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdtbp\" (UniqueName: \"kubernetes.io/projected/dfa09bc1-7028-4848-b7ee-d4a6caf43e44-kube-api-access-vdtbp\") pod \"odh-model-controller-7998c67dc4-g7gbq\" (UID: \"dfa09bc1-7028-4848-b7ee-d4a6caf43e44\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq"
Jul 22 03:13:31.937744 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:31.937595    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfa09bc1-7028-4848-b7ee-d4a6caf43e44-cert\") pod \"odh-model-controller-7998c67dc4-g7gbq\" (UID: \"dfa09bc1-7028-4848-b7ee-d4a6caf43e44\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq"
Jul 22 03:13:32.038164 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.038131    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdtbp\" (UniqueName: \"kubernetes.io/projected/dfa09bc1-7028-4848-b7ee-d4a6caf43e44-kube-api-access-vdtbp\") pod \"odh-model-controller-7998c67dc4-g7gbq\" (UID: \"dfa09bc1-7028-4848-b7ee-d4a6caf43e44\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq"
Jul 22 03:13:32.038320 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.038173    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfa09bc1-7028-4848-b7ee-d4a6caf43e44-cert\") pod \"odh-model-controller-7998c67dc4-g7gbq\" (UID: \"dfa09bc1-7028-4848-b7ee-d4a6caf43e44\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq"
Jul 22 03:13:32.038320 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:13:32.038302    2571 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 22 03:13:32.038389 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:13:32.038383    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfa09bc1-7028-4848-b7ee-d4a6caf43e44-cert podName:dfa09bc1-7028-4848-b7ee-d4a6caf43e44 nodeName:}" failed. No retries permitted until 2026-07-22 03:13:32.538366161 +0000 UTC m=+388.905001945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/dfa09bc1-7028-4848-b7ee-d4a6caf43e44-cert") pod "odh-model-controller-7998c67dc4-g7gbq" (UID: "dfa09bc1-7028-4848-b7ee-d4a6caf43e44") : secret "odh-model-controller-webhook-cert" not found
Jul 22 03:13:32.053875 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.053848    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdtbp\" (UniqueName: \"kubernetes.io/projected/dfa09bc1-7028-4848-b7ee-d4a6caf43e44-kube-api-access-vdtbp\") pod \"odh-model-controller-7998c67dc4-g7gbq\" (UID: \"dfa09bc1-7028-4848-b7ee-d4a6caf43e44\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq"
Jul 22 03:13:32.543289 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.543257    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfa09bc1-7028-4848-b7ee-d4a6caf43e44-cert\") pod \"odh-model-controller-7998c67dc4-g7gbq\" (UID: \"dfa09bc1-7028-4848-b7ee-d4a6caf43e44\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq"
Jul 22 03:13:32.546328 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.546297    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dfa09bc1-7028-4848-b7ee-d4a6caf43e44-cert\") pod \"odh-model-controller-7998c67dc4-g7gbq\" (UID: \"dfa09bc1-7028-4848-b7ee-d4a6caf43e44\") " pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq"
Jul 22 03:13:32.605077 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.605046    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-h8xnw"]
Jul 22 03:13:32.608461 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.608445    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw"
Jul 22 03:13:32.610994 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.610976    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 22 03:13:32.611198 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.611183    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-7jj8k\""
Jul 22 03:13:32.621102 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.621080    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-h8xnw"]
Jul 22 03:13:32.643861 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.643830    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2skm\" (UniqueName: \"kubernetes.io/projected/2ed7d733-d08e-48f9-bd9e-0a1246525b69-kube-api-access-f2skm\") pod \"model-serving-api-54d89bd5fc-h8xnw\" (UID: \"2ed7d733-d08e-48f9-bd9e-0a1246525b69\") " pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw"
Jul 22 03:13:32.643976 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.643869    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed7d733-d08e-48f9-bd9e-0a1246525b69-tls-certs\") pod \"model-serving-api-54d89bd5fc-h8xnw\" (UID: \"2ed7d733-d08e-48f9-bd9e-0a1246525b69\") " pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw"
Jul 22 03:13:32.724922 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.724891    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq"
Jul 22 03:13:32.745033 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.745003    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2skm\" (UniqueName: \"kubernetes.io/projected/2ed7d733-d08e-48f9-bd9e-0a1246525b69-kube-api-access-f2skm\") pod \"model-serving-api-54d89bd5fc-h8xnw\" (UID: \"2ed7d733-d08e-48f9-bd9e-0a1246525b69\") " pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw"
Jul 22 03:13:32.745162 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.745055    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed7d733-d08e-48f9-bd9e-0a1246525b69-tls-certs\") pod \"model-serving-api-54d89bd5fc-h8xnw\" (UID: \"2ed7d733-d08e-48f9-bd9e-0a1246525b69\") " pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw"
Jul 22 03:13:32.745229 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:13:32.745213    2571 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 22 03:13:32.745281 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:13:32.745272    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ed7d733-d08e-48f9-bd9e-0a1246525b69-tls-certs podName:2ed7d733-d08e-48f9-bd9e-0a1246525b69 nodeName:}" failed. No retries permitted until 2026-07-22 03:13:33.245253409 +0000 UTC m=+389.611889193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2ed7d733-d08e-48f9-bd9e-0a1246525b69-tls-certs") pod "model-serving-api-54d89bd5fc-h8xnw" (UID: "2ed7d733-d08e-48f9-bd9e-0a1246525b69") : secret "model-serving-api-tls" not found
Jul 22 03:13:32.755768 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.755742    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2skm\" (UniqueName: \"kubernetes.io/projected/2ed7d733-d08e-48f9-bd9e-0a1246525b69-kube-api-access-f2skm\") pod \"model-serving-api-54d89bd5fc-h8xnw\" (UID: \"2ed7d733-d08e-48f9-bd9e-0a1246525b69\") " pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw"
Jul 22 03:13:32.861855 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:32.861835    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-g7gbq"]
Jul 22 03:13:32.863868 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:13:32.863841    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa09bc1_7028_4848_b7ee_d4a6caf43e44.slice/crio-bcbb9febb3dfd8b2baf56c7d1e40954fc9b479fb0f15d086f4af5b29ae9a3f32 WatchSource:0}: Error finding container bcbb9febb3dfd8b2baf56c7d1e40954fc9b479fb0f15d086f4af5b29ae9a3f32: Status 404 returned error can't find the container with id bcbb9febb3dfd8b2baf56c7d1e40954fc9b479fb0f15d086f4af5b29ae9a3f32
Jul 22 03:13:33.250112 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:33.250070    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed7d733-d08e-48f9-bd9e-0a1246525b69-tls-certs\") pod \"model-serving-api-54d89bd5fc-h8xnw\" (UID: \"2ed7d733-d08e-48f9-bd9e-0a1246525b69\") " pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw"
Jul 22 03:13:33.252635 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:33.252615    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ed7d733-d08e-48f9-bd9e-0a1246525b69-tls-certs\") pod \"model-serving-api-54d89bd5fc-h8xnw\" (UID: \"2ed7d733-d08e-48f9-bd9e-0a1246525b69\") " pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw"
Jul 22 03:13:33.518638 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:33.518556    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw"
Jul 22 03:13:33.683694 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:33.683664    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-h8xnw"]
Jul 22 03:13:33.686217 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:13:33.686182    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed7d733_d08e_48f9_bd9e_0a1246525b69.slice/crio-343de51a7ec33775d4ca701b0a0b10f11c85eb79a139bc745147339a6438800a WatchSource:0}: Error finding container 343de51a7ec33775d4ca701b0a0b10f11c85eb79a139bc745147339a6438800a: Status 404 returned error can't find the container with id 343de51a7ec33775d4ca701b0a0b10f11c85eb79a139bc745147339a6438800a
Jul 22 03:13:33.828887 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:33.827832    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq" event={"ID":"dfa09bc1-7028-4848-b7ee-d4a6caf43e44","Type":"ContainerStarted","Data":"bcbb9febb3dfd8b2baf56c7d1e40954fc9b479fb0f15d086f4af5b29ae9a3f32"}
Jul 22 03:13:33.829596 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:33.829566    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw" event={"ID":"2ed7d733-d08e-48f9-bd9e-0a1246525b69","Type":"ContainerStarted","Data":"343de51a7ec33775d4ca701b0a0b10f11c85eb79a139bc745147339a6438800a"}
Jul 22 03:13:34.569433 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.569398    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"]
Jul 22 03:13:34.574555 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.574516    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"
Jul 22 03:13:34.577246 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.577221    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2q29k\""
Jul 22 03:13:34.578232 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.578200    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 03:13:34.578415 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.578389    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 03:13:34.586274 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.585551    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"]
Jul 22 03:13:34.661730 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.661698    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8lm8\" (UniqueName: \"kubernetes.io/projected/7bd5ed64-0553-479d-acce-98988406c7f5-kube-api-access-j8lm8\") pod \"kube-auth-proxy-59676447d6-rhd9p\" (UID: \"7bd5ed64-0553-479d-acce-98988406c7f5\") " pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"
Jul 22 03:13:34.661931 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.661758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd5ed64-0553-479d-acce-98988406c7f5-tls-certs\") pod \"kube-auth-proxy-59676447d6-rhd9p\" (UID: \"7bd5ed64-0553-479d-acce-98988406c7f5\") " pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"
Jul 22 03:13:34.661931 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.661808    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bd5ed64-0553-479d-acce-98988406c7f5-tmp\") pod \"kube-auth-proxy-59676447d6-rhd9p\" (UID: \"7bd5ed64-0553-479d-acce-98988406c7f5\") " pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"
Jul 22 03:13:34.762349 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.762311    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bd5ed64-0553-479d-acce-98988406c7f5-tmp\") pod \"kube-auth-proxy-59676447d6-rhd9p\" (UID: \"7bd5ed64-0553-479d-acce-98988406c7f5\") " pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"
Jul 22 03:13:34.762536 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.762451    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8lm8\" (UniqueName: \"kubernetes.io/projected/7bd5ed64-0553-479d-acce-98988406c7f5-kube-api-access-j8lm8\") pod \"kube-auth-proxy-59676447d6-rhd9p\" (UID: \"7bd5ed64-0553-479d-acce-98988406c7f5\") " pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"
Jul 22 03:13:34.762536 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.762495    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd5ed64-0553-479d-acce-98988406c7f5-tls-certs\") pod \"kube-auth-proxy-59676447d6-rhd9p\" (UID: \"7bd5ed64-0553-479d-acce-98988406c7f5\") " pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"
Jul 22 03:13:34.765267 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.765203    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bd5ed64-0553-479d-acce-98988406c7f5-tmp\") pod \"kube-auth-proxy-59676447d6-rhd9p\" (UID: \"7bd5ed64-0553-479d-acce-98988406c7f5\") " pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"
Jul 22 03:13:34.765407 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.765279    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd5ed64-0553-479d-acce-98988406c7f5-tls-certs\") pod \"kube-auth-proxy-59676447d6-rhd9p\" (UID: \"7bd5ed64-0553-479d-acce-98988406c7f5\") " pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"
Jul 22 03:13:34.771625 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.771574    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8lm8\" (UniqueName: \"kubernetes.io/projected/7bd5ed64-0553-479d-acce-98988406c7f5-kube-api-access-j8lm8\") pod \"kube-auth-proxy-59676447d6-rhd9p\" (UID: \"7bd5ed64-0553-479d-acce-98988406c7f5\") " pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"
Jul 22 03:13:34.890490 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:34.890411    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"
Jul 22 03:13:36.396604 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:36.396574    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59676447d6-rhd9p"]
Jul 22 03:13:36.398916 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:13:36.398889    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd5ed64_0553_479d_acce_98988406c7f5.slice/crio-4c9621731f10cc8c756bd01c8328c51bf7310f6ef2390b7f2a8927aba68c2328 WatchSource:0}: Error finding container 4c9621731f10cc8c756bd01c8328c51bf7310f6ef2390b7f2a8927aba68c2328: Status 404 returned error can't find the container with id 4c9621731f10cc8c756bd01c8328c51bf7310f6ef2390b7f2a8927aba68c2328
Jul 22 03:13:36.848373 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:36.848335    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p" event={"ID":"7bd5ed64-0553-479d-acce-98988406c7f5","Type":"ContainerStarted","Data":"4c9621731f10cc8c756bd01c8328c51bf7310f6ef2390b7f2a8927aba68c2328"}
Jul 22 03:13:36.849809 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:36.849758    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq" event={"ID":"dfa09bc1-7028-4848-b7ee-d4a6caf43e44","Type":"ContainerStarted","Data":"43c64a5c7e931c9262b5ad8cf12031eb42f68e48f4291cead2a0214f64d89283"}
Jul 22 03:13:36.849924 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:36.849873    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq"
Jul 22 03:13:36.851228 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:36.851205    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw" event={"ID":"2ed7d733-d08e-48f9-bd9e-0a1246525b69","Type":"ContainerStarted","Data":"5244f62549fc020063974bec07063be53af7562f655cf5a74d20cdf5b2aeeffc"}
Jul 22 03:13:36.851339 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:36.851263    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw"
Jul 22 03:13:36.868097 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:36.868057    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq" podStartSLOduration=2.475659231 podStartE2EDuration="5.868044415s" totalImagesPullingTime="3.392385184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:13:36.86723856 +0000 UTC m=+393.233874379" watchObservedRunningTime="2026-07-22 03:13:36.868044415 +0000 UTC m=+393.234680221"
Jul 22 03:13:36.883859 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:36.883812    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw" podStartSLOduration=2.319196653 podStartE2EDuration="4.883789408s" totalImagesPullingTime="2.564592755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:13:36.883353887 +0000 UTC m=+393.249989720" watchObservedRunningTime="2026-07-22 03:13:36.883789408 +0000 UTC m=+393.250425209"
Jul 22 03:13:38.662662 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.662619    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"]
Jul 22 03:13:38.666847 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.666820    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:38.671273 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.671250    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-p2dvb\""
Jul 22 03:13:38.671409 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.671275    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 03:13:38.671409 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.671308    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 03:13:38.671409 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.671331    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 03:13:38.671611 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.671593    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 03:13:38.671660 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.671593    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:13:38.678313 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.678288    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"]
Jul 22 03:13:38.804570 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.804545    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b316f64f-e462-4d49-8080-6942526569b4-cert\") pod \"lws-controller-manager-8587dbf975-zww8t\" (UID: \"b316f64f-e462-4d49-8080-6942526569b4\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:38.804707 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.804581    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62vng\" (UniqueName: \"kubernetes.io/projected/b316f64f-e462-4d49-8080-6942526569b4-kube-api-access-62vng\") pod \"lws-controller-manager-8587dbf975-zww8t\" (UID: \"b316f64f-e462-4d49-8080-6942526569b4\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:38.804760 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.804696    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b316f64f-e462-4d49-8080-6942526569b4-manager-config\") pod \"lws-controller-manager-8587dbf975-zww8t\" (UID: \"b316f64f-e462-4d49-8080-6942526569b4\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:38.804861 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.804844    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b316f64f-e462-4d49-8080-6942526569b4-metrics-cert\") pod \"lws-controller-manager-8587dbf975-zww8t\" (UID: \"b316f64f-e462-4d49-8080-6942526569b4\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:38.862979 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.862949    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p" event={"ID":"7bd5ed64-0553-479d-acce-98988406c7f5","Type":"ContainerStarted","Data":"06ca6c9399aa0a099824bbf7e7d91dcd56fe5477ada1773b479f0cd154e69cb1"}
Jul 22 03:13:38.902607 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.902547    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59676447d6-rhd9p" podStartSLOduration=2.557822238 podStartE2EDuration="4.902530581s" totalImagesPullingTime="2.344708343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:13:38.902291637 +0000 UTC m=+395.268927443" watchObservedRunningTime="2026-07-22 03:13:38.902530581 +0000 UTC m=+395.269166387"
Jul 22 03:13:38.905650 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.905617    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62vng\" (UniqueName: \"kubernetes.io/projected/b316f64f-e462-4d49-8080-6942526569b4-kube-api-access-62vng\") pod \"lws-controller-manager-8587dbf975-zww8t\" (UID: \"b316f64f-e462-4d49-8080-6942526569b4\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:38.905736 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.905686    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b316f64f-e462-4d49-8080-6942526569b4-manager-config\") pod \"lws-controller-manager-8587dbf975-zww8t\" (UID: \"b316f64f-e462-4d49-8080-6942526569b4\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:38.905808 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.905748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b316f64f-e462-4d49-8080-6942526569b4-metrics-cert\") pod \"lws-controller-manager-8587dbf975-zww8t\" (UID: \"b316f64f-e462-4d49-8080-6942526569b4\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:38.905853 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.905821    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b316f64f-e462-4d49-8080-6942526569b4-cert\") pod \"lws-controller-manager-8587dbf975-zww8t\" (UID: \"b316f64f-e462-4d49-8080-6942526569b4\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:38.906571 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.906471    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b316f64f-e462-4d49-8080-6942526569b4-manager-config\") pod \"lws-controller-manager-8587dbf975-zww8t\" (UID: \"b316f64f-e462-4d49-8080-6942526569b4\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:38.908480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.908457    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b316f64f-e462-4d49-8080-6942526569b4-metrics-cert\") pod \"lws-controller-manager-8587dbf975-zww8t\" (UID: \"b316f64f-e462-4d49-8080-6942526569b4\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:38.908567 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.908513    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b316f64f-e462-4d49-8080-6942526569b4-cert\") pod \"lws-controller-manager-8587dbf975-zww8t\" (UID: \"b316f64f-e462-4d49-8080-6942526569b4\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:38.933707 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.933640    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62vng\" (UniqueName: \"kubernetes.io/projected/b316f64f-e462-4d49-8080-6942526569b4-kube-api-access-62vng\") pod \"lws-controller-manager-8587dbf975-zww8t\" (UID: \"b316f64f-e462-4d49-8080-6942526569b4\") " pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:38.980698 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:38.980665    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:39.134818 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:39.134795    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"]
Jul 22 03:13:39.137227 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:13:39.137195    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb316f64f_e462_4d49_8080_6942526569b4.slice/crio-deb7b35444fc4f5f1a7f5b72c36e2e78aff7538b0665d201c3190ef01a40041b WatchSource:0}: Error finding container deb7b35444fc4f5f1a7f5b72c36e2e78aff7538b0665d201c3190ef01a40041b: Status 404 returned error can't find the container with id deb7b35444fc4f5f1a7f5b72c36e2e78aff7538b0665d201c3190ef01a40041b
Jul 22 03:13:39.872103 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:39.872066    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t" event={"ID":"b316f64f-e462-4d49-8080-6942526569b4","Type":"ContainerStarted","Data":"deb7b35444fc4f5f1a7f5b72c36e2e78aff7538b0665d201c3190ef01a40041b"}
Jul 22 03:13:41.883390 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:41.883341    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t" event={"ID":"b316f64f-e462-4d49-8080-6942526569b4","Type":"ContainerStarted","Data":"f63f22b26dedfdbb600f8337f922d8b0a53d76c38bae7d53ccefa5c608a8f112"}
Jul 22 03:13:41.883768 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:41.883522    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:13:41.918842 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:41.918783    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t" podStartSLOduration=1.53026412 podStartE2EDuration="3.918752964s" totalImagesPullingTime="2.388488844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:13:41.91675624 +0000 UTC m=+398.283392046" watchObservedRunningTime="2026-07-22 03:13:41.918752964 +0000 UTC m=+398.285388769"
Jul 22 03:13:47.859404 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:47.859375    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-g7gbq"
Jul 22 03:13:47.861238 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:47.861213    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-h8xnw"
Jul 22 03:13:52.890695 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:13:52.890664    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8587dbf975-zww8t"
Jul 22 03:15:26.496973 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.496942    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"]
Jul 22 03:15:26.500207 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.500190    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"
Jul 22 03:15:26.503621 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.503601    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 03:15:26.503735 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.503617    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 22 03:15:26.503952 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.503935    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 22 03:15:26.504057 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.503988    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 03:15:26.504765 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.504748    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2pb9b\""
Jul 22 03:15:26.515172 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.515148    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"]
Jul 22 03:15:26.637486 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.637452    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/830a11f9-2890-44e4-a366-58619ae60c73-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8qf2c\" (UID: \"830a11f9-2890-44e4-a366-58619ae60c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"
Jul 22 03:15:26.637667 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.637509    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5fnp\" (UniqueName: \"kubernetes.io/projected/830a11f9-2890-44e4-a366-58619ae60c73-kube-api-access-d5fnp\") pod \"kuadrant-console-plugin-66b5774985-8qf2c\" (UID: \"830a11f9-2890-44e4-a366-58619ae60c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"
Jul 22 03:15:26.637667 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.637531    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/830a11f9-2890-44e4-a366-58619ae60c73-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8qf2c\" (UID: \"830a11f9-2890-44e4-a366-58619ae60c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"
Jul 22 03:15:26.738839 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.738805    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5fnp\" (UniqueName: \"kubernetes.io/projected/830a11f9-2890-44e4-a366-58619ae60c73-kube-api-access-d5fnp\") pod \"kuadrant-console-plugin-66b5774985-8qf2c\" (UID: \"830a11f9-2890-44e4-a366-58619ae60c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"
Jul 22 03:15:26.739011 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.738853    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/830a11f9-2890-44e4-a366-58619ae60c73-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8qf2c\" (UID: \"830a11f9-2890-44e4-a366-58619ae60c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"
Jul 22 03:15:26.739011 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.738966    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/830a11f9-2890-44e4-a366-58619ae60c73-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8qf2c\" (UID: \"830a11f9-2890-44e4-a366-58619ae60c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"
Jul 22 03:15:26.739554 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.739519    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/830a11f9-2890-44e4-a366-58619ae60c73-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-8qf2c\" (UID: \"830a11f9-2890-44e4-a366-58619ae60c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"
Jul 22 03:15:26.741574 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.741546    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/830a11f9-2890-44e4-a366-58619ae60c73-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-8qf2c\" (UID: \"830a11f9-2890-44e4-a366-58619ae60c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"
Jul 22 03:15:26.747707 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.747652    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5fnp\" (UniqueName: \"kubernetes.io/projected/830a11f9-2890-44e4-a366-58619ae60c73-kube-api-access-d5fnp\") pod \"kuadrant-console-plugin-66b5774985-8qf2c\" (UID: \"830a11f9-2890-44e4-a366-58619ae60c73\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"
Jul 22 03:15:26.808830 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.808798    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"
Jul 22 03:15:26.942798 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:26.942759    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c"]
Jul 22 03:15:26.944794 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:15:26.944746    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod830a11f9_2890_44e4_a366_58619ae60c73.slice/crio-e429f107cba7492e7faece43a769af40d99333497da623ddf9aef104502ac5e5 WatchSource:0}: Error finding container e429f107cba7492e7faece43a769af40d99333497da623ddf9aef104502ac5e5: Status 404 returned error can't find the container with id e429f107cba7492e7faece43a769af40d99333497da623ddf9aef104502ac5e5
Jul 22 03:15:27.367744 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:27.367703    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c" event={"ID":"830a11f9-2890-44e4-a366-58619ae60c73","Type":"ContainerStarted","Data":"e429f107cba7492e7faece43a769af40d99333497da623ddf9aef104502ac5e5"}
Jul 22 03:15:49.487059 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:49.486975    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c" event={"ID":"830a11f9-2890-44e4-a366-58619ae60c73","Type":"ContainerStarted","Data":"a2284c8682e08711b6aa25e36c67ab6b4ac8c6bb08b3296f63c7bd4ef0aeb8f0"}
Jul 22 03:15:49.513492 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:15:49.513427    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-8qf2c" podStartSLOduration=1.288563954 podStartE2EDuration="23.5134063s" totalImagesPullingTime="22.224842346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:15:49.512795841 +0000 UTC m=+525.879431641" watchObservedRunningTime="2026-07-22 03:15:49.5134063 +0000 UTC m=+525.880042109"
Jul 22 03:16:10.260833 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.260739    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-t5f6b"]
Jul 22 03:16:10.404840 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.404805    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-t5f6b"]
Jul 22 03:16:10.404999 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.404902    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t5f6b"
Jul 22 03:16:10.414631 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.414607    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kmkz9\""
Jul 22 03:16:10.540366 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.540282    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfmth\" (UniqueName: \"kubernetes.io/projected/800c3a7f-e3ab-459c-af23-5bd275bfe3a3-kube-api-access-xfmth\") pod \"authorino-58cd955675-t5f6b\" (UID: \"800c3a7f-e3ab-459c-af23-5bd275bfe3a3\") " pod="kuadrant-system/authorino-58cd955675-t5f6b"
Jul 22 03:16:10.575458 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.575427    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7k8t8"]
Jul 22 03:16:10.608084 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.608048    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7k8t8"]
Jul 22 03:16:10.608256 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.608153    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7k8t8"
Jul 22 03:16:10.641096 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.641062    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfmth\" (UniqueName: \"kubernetes.io/projected/800c3a7f-e3ab-459c-af23-5bd275bfe3a3-kube-api-access-xfmth\") pod \"authorino-58cd955675-t5f6b\" (UID: \"800c3a7f-e3ab-459c-af23-5bd275bfe3a3\") " pod="kuadrant-system/authorino-58cd955675-t5f6b"
Jul 22 03:16:10.649357 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.649336    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfmth\" (UniqueName: \"kubernetes.io/projected/800c3a7f-e3ab-459c-af23-5bd275bfe3a3-kube-api-access-xfmth\") pod \"authorino-58cd955675-t5f6b\" (UID: \"800c3a7f-e3ab-459c-af23-5bd275bfe3a3\") " pod="kuadrant-system/authorino-58cd955675-t5f6b"
Jul 22 03:16:10.714301 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.714275    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t5f6b"
Jul 22 03:16:10.742012 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.741972    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mvdl\" (UniqueName: \"kubernetes.io/projected/3b9dd5c2-8a49-43a7-962f-1e3db9b65234-kube-api-access-2mvdl\") pod \"authorino-75d556bd77-7k8t8\" (UID: \"3b9dd5c2-8a49-43a7-962f-1e3db9b65234\") " pod="kuadrant-system/authorino-75d556bd77-7k8t8"
Jul 22 03:16:10.843553 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.843515    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mvdl\" (UniqueName: \"kubernetes.io/projected/3b9dd5c2-8a49-43a7-962f-1e3db9b65234-kube-api-access-2mvdl\") pod \"authorino-75d556bd77-7k8t8\" (UID: \"3b9dd5c2-8a49-43a7-962f-1e3db9b65234\") " pod="kuadrant-system/authorino-75d556bd77-7k8t8"
Jul 22 03:16:10.851903 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.851875    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mvdl\" (UniqueName: \"kubernetes.io/projected/3b9dd5c2-8a49-43a7-962f-1e3db9b65234-kube-api-access-2mvdl\") pod \"authorino-75d556bd77-7k8t8\" (UID: \"3b9dd5c2-8a49-43a7-962f-1e3db9b65234\") " pod="kuadrant-system/authorino-75d556bd77-7k8t8"
Jul 22 03:16:10.865739 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.865717    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-t5f6b"]
Jul 22 03:16:10.867900 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:16:10.867874    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod800c3a7f_e3ab_459c_af23_5bd275bfe3a3.slice/crio-2c28a0d488bdab5abd65d6f8b31a846735370f41e95d33d3914c626b562f06f6 WatchSource:0}: Error finding container 2c28a0d488bdab5abd65d6f8b31a846735370f41e95d33d3914c626b562f06f6: Status 404 returned error can't find the container with id 2c28a0d488bdab5abd65d6f8b31a846735370f41e95d33d3914c626b562f06f6
Jul 22 03:16:10.917226 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:10.917201    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7k8t8"
Jul 22 03:16:11.075411 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:11.075302    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7k8t8"]
Jul 22 03:16:11.077498 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:16:11.077473    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b9dd5c2_8a49_43a7_962f_1e3db9b65234.slice/crio-4cb00fdde0da7d6807b96fba47d5998d3be534782c646e090d9a35da7794004b WatchSource:0}: Error finding container 4cb00fdde0da7d6807b96fba47d5998d3be534782c646e090d9a35da7794004b: Status 404 returned error can't find the container with id 4cb00fdde0da7d6807b96fba47d5998d3be534782c646e090d9a35da7794004b
Jul 22 03:16:11.590153 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:11.590116    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t5f6b" event={"ID":"800c3a7f-e3ab-459c-af23-5bd275bfe3a3","Type":"ContainerStarted","Data":"2c28a0d488bdab5abd65d6f8b31a846735370f41e95d33d3914c626b562f06f6"}
Jul 22 03:16:11.591551 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:11.591526    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7k8t8" event={"ID":"3b9dd5c2-8a49-43a7-962f-1e3db9b65234","Type":"ContainerStarted","Data":"4cb00fdde0da7d6807b96fba47d5998d3be534782c646e090d9a35da7794004b"}
Jul 22 03:16:15.620837 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:15.620805    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t5f6b" event={"ID":"800c3a7f-e3ab-459c-af23-5bd275bfe3a3","Type":"ContainerStarted","Data":"a93e29b4c483129ed22176bbbc90d06e94ec5a216b9801d534f6b42fc3f0a86e"}
Jul 22 03:16:15.647815 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:15.647738    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-t5f6b" podStartSLOduration=1.096531384 podStartE2EDuration="5.647720244s" totalImagesPullingTime="4.55118886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:16:15.646220041 +0000 UTC m=+552.012855842" watchObservedRunningTime="2026-07-22 03:16:15.647720244 +0000 UTC m=+552.014356050"
Jul 22 03:16:16.627506 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:16.627465    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7k8t8" event={"ID":"3b9dd5c2-8a49-43a7-962f-1e3db9b65234","Type":"ContainerStarted","Data":"f517eb732fc5c838d3c06a86e8335926332481c04e5e220538260f5660708600"}
Jul 22 03:16:16.643185 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:16.643135    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7k8t8" podStartSLOduration=2.290296047 podStartE2EDuration="6.643118184s" totalImagesPullingTime="4.352822137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:16:16.641514567 +0000 UTC m=+553.008150373" watchObservedRunningTime="2026-07-22 03:16:16.643118184 +0000 UTC m=+553.009753991"
Jul 22 03:16:16.671536 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:16.671502    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-t5f6b"]
Jul 22 03:16:17.632188 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:17.632147    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-t5f6b" podUID="800c3a7f-e3ab-459c-af23-5bd275bfe3a3" containerName="authorino" containerID="cri-o://a93e29b4c483129ed22176bbbc90d06e94ec5a216b9801d534f6b42fc3f0a86e" gracePeriod=30
Jul 22 03:16:17.926236 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:17.926205    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t5f6b"
Jul 22 03:16:18.012836 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:18.012808    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfmth\" (UniqueName: \"kubernetes.io/projected/800c3a7f-e3ab-459c-af23-5bd275bfe3a3-kube-api-access-xfmth\") pod \"800c3a7f-e3ab-459c-af23-5bd275bfe3a3\" (UID: \"800c3a7f-e3ab-459c-af23-5bd275bfe3a3\") "
Jul 22 03:16:18.015268 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:18.015232    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/800c3a7f-e3ab-459c-af23-5bd275bfe3a3-kube-api-access-xfmth" (OuterVolumeSpecName: "kube-api-access-xfmth") pod "800c3a7f-e3ab-459c-af23-5bd275bfe3a3" (UID: "800c3a7f-e3ab-459c-af23-5bd275bfe3a3"). InnerVolumeSpecName "kube-api-access-xfmth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:16:18.115301 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:18.114091    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfmth\" (UniqueName: \"kubernetes.io/projected/800c3a7f-e3ab-459c-af23-5bd275bfe3a3-kube-api-access-xfmth\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:16:18.638124 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:18.638089    2571 generic.go:356] "Generic (PLEG): container finished" podID="800c3a7f-e3ab-459c-af23-5bd275bfe3a3" containerID="a93e29b4c483129ed22176bbbc90d06e94ec5a216b9801d534f6b42fc3f0a86e" exitCode=0
Jul 22 03:16:18.638593 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:18.638153    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t5f6b"
Jul 22 03:16:18.638593 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:18.638163    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t5f6b" event={"ID":"800c3a7f-e3ab-459c-af23-5bd275bfe3a3","Type":"ContainerDied","Data":"a93e29b4c483129ed22176bbbc90d06e94ec5a216b9801d534f6b42fc3f0a86e"}
Jul 22 03:16:18.638593 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:18.638196    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t5f6b" event={"ID":"800c3a7f-e3ab-459c-af23-5bd275bfe3a3","Type":"ContainerDied","Data":"2c28a0d488bdab5abd65d6f8b31a846735370f41e95d33d3914c626b562f06f6"}
Jul 22 03:16:18.638593 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:18.638212    2571 scope.go:117] "RemoveContainer" containerID="a93e29b4c483129ed22176bbbc90d06e94ec5a216b9801d534f6b42fc3f0a86e"
Jul 22 03:16:18.646882 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:18.646849    2571 scope.go:117] "RemoveContainer" containerID="a93e29b4c483129ed22176bbbc90d06e94ec5a216b9801d534f6b42fc3f0a86e"
Jul 22 03:16:18.647169 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:16:18.647134    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a93e29b4c483129ed22176bbbc90d06e94ec5a216b9801d534f6b42fc3f0a86e\": container with ID starting with a93e29b4c483129ed22176bbbc90d06e94ec5a216b9801d534f6b42fc3f0a86e not found: ID does not exist" containerID="a93e29b4c483129ed22176bbbc90d06e94ec5a216b9801d534f6b42fc3f0a86e"
Jul 22 03:16:18.647252 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:18.647180    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a93e29b4c483129ed22176bbbc90d06e94ec5a216b9801d534f6b42fc3f0a86e"} err="failed to get container status \"a93e29b4c483129ed22176bbbc90d06e94ec5a216b9801d534f6b42fc3f0a86e\": rpc error: code = NotFound desc = could not find container \"a93e29b4c483129ed22176bbbc90d06e94ec5a216b9801d534f6b42fc3f0a86e\": container with ID starting with a93e29b4c483129ed22176bbbc90d06e94ec5a216b9801d534f6b42fc3f0a86e not found: ID does not exist"
Jul 22 03:16:18.653897 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:18.653874    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-t5f6b"]
Jul 22 03:16:18.657892 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:18.657870    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-t5f6b"]
Jul 22 03:16:20.104162 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:20.104133    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="800c3a7f-e3ab-459c-af23-5bd275bfe3a3" path="/var/lib/kubelet/pods/800c3a7f-e3ab-459c-af23-5bd275bfe3a3/volumes"
Jul 22 03:16:37.839405 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:37.839370    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cmjwb"]
Jul 22 03:16:37.839864 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:37.839710    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="800c3a7f-e3ab-459c-af23-5bd275bfe3a3" containerName="authorino"
Jul 22 03:16:37.839864 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:37.839720    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="800c3a7f-e3ab-459c-af23-5bd275bfe3a3" containerName="authorino"
Jul 22 03:16:37.839864 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:37.839805    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="800c3a7f-e3ab-459c-af23-5bd275bfe3a3" containerName="authorino"
Jul 22 03:16:37.842679 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:37.842663    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cmjwb"
Jul 22 03:16:37.852857 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:37.852835    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cmjwb"]
Jul 22 03:16:37.888784 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:37.888728    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2w9k\" (UniqueName: \"kubernetes.io/projected/9b1e2602-b9f0-4dbb-943f-d68758058102-kube-api-access-m2w9k\") pod \"authorino-5d4b67c446-cmjwb\" (UID: \"9b1e2602-b9f0-4dbb-943f-d68758058102\") " pod="kuadrant-system/authorino-5d4b67c446-cmjwb"
Jul 22 03:16:37.989956 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:37.989924    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2w9k\" (UniqueName: \"kubernetes.io/projected/9b1e2602-b9f0-4dbb-943f-d68758058102-kube-api-access-m2w9k\") pod \"authorino-5d4b67c446-cmjwb\" (UID: \"9b1e2602-b9f0-4dbb-943f-d68758058102\") " pod="kuadrant-system/authorino-5d4b67c446-cmjwb"
Jul 22 03:16:37.997978 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:37.997956    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2w9k\" (UniqueName: \"kubernetes.io/projected/9b1e2602-b9f0-4dbb-943f-d68758058102-kube-api-access-m2w9k\") pod \"authorino-5d4b67c446-cmjwb\" (UID: \"9b1e2602-b9f0-4dbb-943f-d68758058102\") " pod="kuadrant-system/authorino-5d4b67c446-cmjwb"
Jul 22 03:16:38.062645 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.062609    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cmjwb"]
Jul 22 03:16:38.062899 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.062886    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cmjwb"
Jul 22 03:16:38.086123 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.086096    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cd8dfdc9f-8lmm2"]
Jul 22 03:16:38.095594 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.095510    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd8dfdc9f-8lmm2"
Jul 22 03:16:38.106990 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.106962    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cd8dfdc9f-8lmm2"]
Jul 22 03:16:38.197323 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.197290    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c88nw\" (UniqueName: \"kubernetes.io/projected/f39ce320-61bd-493c-ba44-e27d4e055036-kube-api-access-c88nw\") pod \"authorino-cd8dfdc9f-8lmm2\" (UID: \"f39ce320-61bd-493c-ba44-e27d4e055036\") " pod="kuadrant-system/authorino-cd8dfdc9f-8lmm2"
Jul 22 03:16:38.204131 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.204107    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cmjwb"]
Jul 22 03:16:38.206635 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:16:38.206606    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b1e2602_b9f0_4dbb_943f_d68758058102.slice/crio-b6339132ad1a9f0681a83f8422e676dad6eedb02e963058f50c73187a9a5e956 WatchSource:0}: Error finding container b6339132ad1a9f0681a83f8422e676dad6eedb02e963058f50c73187a9a5e956: Status 404 returned error can't find the container with id b6339132ad1a9f0681a83f8422e676dad6eedb02e963058f50c73187a9a5e956
Jul 22 03:16:38.297853 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.297823    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c88nw\" (UniqueName: \"kubernetes.io/projected/f39ce320-61bd-493c-ba44-e27d4e055036-kube-api-access-c88nw\") pod \"authorino-cd8dfdc9f-8lmm2\" (UID: \"f39ce320-61bd-493c-ba44-e27d4e055036\") " pod="kuadrant-system/authorino-cd8dfdc9f-8lmm2"
Jul 22 03:16:38.306087 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.306065    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c88nw\" (UniqueName: \"kubernetes.io/projected/f39ce320-61bd-493c-ba44-e27d4e055036-kube-api-access-c88nw\") pod \"authorino-cd8dfdc9f-8lmm2\" (UID: \"f39ce320-61bd-493c-ba44-e27d4e055036\") " pod="kuadrant-system/authorino-cd8dfdc9f-8lmm2"
Jul 22 03:16:38.408555 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.408452    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd8dfdc9f-8lmm2"
Jul 22 03:16:38.538914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.538891    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cd8dfdc9f-8lmm2"]
Jul 22 03:16:38.540521 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:16:38.540498    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf39ce320_61bd_493c_ba44_e27d4e055036.slice/crio-e0ba621b5806efc3563f55868f92d16e4477284f67a92570db011f6db9a442b9 WatchSource:0}: Error finding container e0ba621b5806efc3563f55868f92d16e4477284f67a92570db011f6db9a442b9: Status 404 returned error can't find the container with id e0ba621b5806efc3563f55868f92d16e4477284f67a92570db011f6db9a442b9
Jul 22 03:16:38.735208 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.735099    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-cmjwb" podUID="9b1e2602-b9f0-4dbb-943f-d68758058102" containerName="authorino" containerID="cri-o://fa13617275c427962e824d3aad025e4393b3c6ee28eb1685c9b0b726f842620f" gracePeriod=30
Jul 22 03:16:38.735384 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.735105    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cmjwb" event={"ID":"9b1e2602-b9f0-4dbb-943f-d68758058102","Type":"ContainerStarted","Data":"fa13617275c427962e824d3aad025e4393b3c6ee28eb1685c9b0b726f842620f"}
Jul 22 03:16:38.735384 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.735250    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cmjwb" event={"ID":"9b1e2602-b9f0-4dbb-943f-d68758058102","Type":"ContainerStarted","Data":"b6339132ad1a9f0681a83f8422e676dad6eedb02e963058f50c73187a9a5e956"}
Jul 22 03:16:38.736482 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.736458    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cd8dfdc9f-8lmm2" event={"ID":"f39ce320-61bd-493c-ba44-e27d4e055036","Type":"ContainerStarted","Data":"e0ba621b5806efc3563f55868f92d16e4477284f67a92570db011f6db9a442b9"}
Jul 22 03:16:38.751081 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.751038    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-cmjwb" podStartSLOduration=1.364136202 podStartE2EDuration="1.751022971s" totalImagesPullingTime="386.886769ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:16:38.750190177 +0000 UTC m=+575.116825984" watchObservedRunningTime="2026-07-22 03:16:38.751022971 +0000 UTC m=+575.117658776"
Jul 22 03:16:38.977857 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:38.977831    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cmjwb"
Jul 22 03:16:39.104310 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.104279    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2w9k\" (UniqueName: \"kubernetes.io/projected/9b1e2602-b9f0-4dbb-943f-d68758058102-kube-api-access-m2w9k\") pod \"9b1e2602-b9f0-4dbb-943f-d68758058102\" (UID: \"9b1e2602-b9f0-4dbb-943f-d68758058102\") "
Jul 22 03:16:39.106412 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.106387    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b1e2602-b9f0-4dbb-943f-d68758058102-kube-api-access-m2w9k" (OuterVolumeSpecName: "kube-api-access-m2w9k") pod "9b1e2602-b9f0-4dbb-943f-d68758058102" (UID: "9b1e2602-b9f0-4dbb-943f-d68758058102"). InnerVolumeSpecName "kube-api-access-m2w9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:16:39.205762 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.205727    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2w9k\" (UniqueName: \"kubernetes.io/projected/9b1e2602-b9f0-4dbb-943f-d68758058102-kube-api-access-m2w9k\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:16:39.742477 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.742445    2571 generic.go:356] "Generic (PLEG): container finished" podID="9b1e2602-b9f0-4dbb-943f-d68758058102" containerID="fa13617275c427962e824d3aad025e4393b3c6ee28eb1685c9b0b726f842620f" exitCode=0
Jul 22 03:16:39.742669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.742490    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-cmjwb"
Jul 22 03:16:39.742669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.742527    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cmjwb" event={"ID":"9b1e2602-b9f0-4dbb-943f-d68758058102","Type":"ContainerDied","Data":"fa13617275c427962e824d3aad025e4393b3c6ee28eb1685c9b0b726f842620f"}
Jul 22 03:16:39.742669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.742571    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-cmjwb" event={"ID":"9b1e2602-b9f0-4dbb-943f-d68758058102","Type":"ContainerDied","Data":"b6339132ad1a9f0681a83f8422e676dad6eedb02e963058f50c73187a9a5e956"}
Jul 22 03:16:39.742669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.742589    2571 scope.go:117] "RemoveContainer" containerID="fa13617275c427962e824d3aad025e4393b3c6ee28eb1685c9b0b726f842620f"
Jul 22 03:16:39.744150 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.744130    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cd8dfdc9f-8lmm2" event={"ID":"f39ce320-61bd-493c-ba44-e27d4e055036","Type":"ContainerStarted","Data":"342943c4c27da4b98e37e0de350d478340b7c1fd51c8d215e62941736ee5de78"}
Jul 22 03:16:39.752531 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.752517    2571 scope.go:117] "RemoveContainer" containerID="fa13617275c427962e824d3aad025e4393b3c6ee28eb1685c9b0b726f842620f"
Jul 22 03:16:39.752793 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:16:39.752751    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa13617275c427962e824d3aad025e4393b3c6ee28eb1685c9b0b726f842620f\": container with ID starting with fa13617275c427962e824d3aad025e4393b3c6ee28eb1685c9b0b726f842620f not found: ID does not exist" containerID="fa13617275c427962e824d3aad025e4393b3c6ee28eb1685c9b0b726f842620f"
Jul 22 03:16:39.752873 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.752852    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa13617275c427962e824d3aad025e4393b3c6ee28eb1685c9b0b726f842620f"} err="failed to get container status \"fa13617275c427962e824d3aad025e4393b3c6ee28eb1685c9b0b726f842620f\": rpc error: code = NotFound desc = could not find container \"fa13617275c427962e824d3aad025e4393b3c6ee28eb1685c9b0b726f842620f\": container with ID starting with fa13617275c427962e824d3aad025e4393b3c6ee28eb1685c9b0b726f842620f not found: ID does not exist"
Jul 22 03:16:39.762539 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.762497    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-cd8dfdc9f-8lmm2" podStartSLOduration=1.415313937 podStartE2EDuration="1.762484352s" totalImagesPullingTime="347.170415ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:16:39.761528424 +0000 UTC m=+576.128164234" watchObservedRunningTime="2026-07-22 03:16:39.762484352 +0000 UTC m=+576.129120158"
Jul 22 03:16:39.776619 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.776591    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cmjwb"]
Jul 22 03:16:39.783128 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.783101    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-cmjwb"]
Jul 22 03:16:39.787918 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.787896    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7k8t8"]
Jul 22 03:16:39.788073 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.788052    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7k8t8" podUID="3b9dd5c2-8a49-43a7-962f-1e3db9b65234" containerName="authorino" containerID="cri-o://f517eb732fc5c838d3c06a86e8335926332481c04e5e220538260f5660708600" gracePeriod=30
Jul 22 03:16:39.927224 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.927194    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-644ffd4dc5-76lrg"]
Jul 22 03:16:39.927574 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.927560    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b1e2602-b9f0-4dbb-943f-d68758058102" containerName="authorino"
Jul 22 03:16:39.927574 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.927573    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b1e2602-b9f0-4dbb-943f-d68758058102" containerName="authorino"
Jul 22 03:16:39.927701 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.927636    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b1e2602-b9f0-4dbb-943f-d68758058102" containerName="authorino"
Jul 22 03:16:39.930804 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.930761    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-644ffd4dc5-76lrg"
Jul 22 03:16:39.933309 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.933285    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 22 03:16:39.936921 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:39.936895    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-644ffd4dc5-76lrg"]
Jul 22 03:16:40.013676 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.013595    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b87tv\" (UniqueName: \"kubernetes.io/projected/c5f15134-01ba-488a-847f-94ad668e138a-kube-api-access-b87tv\") pod \"authorino-644ffd4dc5-76lrg\" (UID: \"c5f15134-01ba-488a-847f-94ad668e138a\") " pod="kuadrant-system/authorino-644ffd4dc5-76lrg"
Jul 22 03:16:40.013676 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.013643    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5f15134-01ba-488a-847f-94ad668e138a-tls-cert\") pod \"authorino-644ffd4dc5-76lrg\" (UID: \"c5f15134-01ba-488a-847f-94ad668e138a\") " pod="kuadrant-system/authorino-644ffd4dc5-76lrg"
Jul 22 03:16:40.041705 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.041686    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7k8t8"
Jul 22 03:16:40.104715 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.104684    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b1e2602-b9f0-4dbb-943f-d68758058102" path="/var/lib/kubelet/pods/9b1e2602-b9f0-4dbb-943f-d68758058102/volumes"
Jul 22 03:16:40.114722 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.114697    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mvdl\" (UniqueName: \"kubernetes.io/projected/3b9dd5c2-8a49-43a7-962f-1e3db9b65234-kube-api-access-2mvdl\") pod \"3b9dd5c2-8a49-43a7-962f-1e3db9b65234\" (UID: \"3b9dd5c2-8a49-43a7-962f-1e3db9b65234\") "
Jul 22 03:16:40.114972 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.114952    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b87tv\" (UniqueName: \"kubernetes.io/projected/c5f15134-01ba-488a-847f-94ad668e138a-kube-api-access-b87tv\") pod \"authorino-644ffd4dc5-76lrg\" (UID: \"c5f15134-01ba-488a-847f-94ad668e138a\") " pod="kuadrant-system/authorino-644ffd4dc5-76lrg"
Jul 22 03:16:40.115116 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.115004    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5f15134-01ba-488a-847f-94ad668e138a-tls-cert\") pod \"authorino-644ffd4dc5-76lrg\" (UID: \"c5f15134-01ba-488a-847f-94ad668e138a\") " pod="kuadrant-system/authorino-644ffd4dc5-76lrg"
Jul 22 03:16:40.116911 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.116890    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b9dd5c2-8a49-43a7-962f-1e3db9b65234-kube-api-access-2mvdl" (OuterVolumeSpecName: "kube-api-access-2mvdl") pod "3b9dd5c2-8a49-43a7-962f-1e3db9b65234" (UID: "3b9dd5c2-8a49-43a7-962f-1e3db9b65234"). InnerVolumeSpecName "kube-api-access-2mvdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:16:40.117645 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.117627    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5f15134-01ba-488a-847f-94ad668e138a-tls-cert\") pod \"authorino-644ffd4dc5-76lrg\" (UID: \"c5f15134-01ba-488a-847f-94ad668e138a\") " pod="kuadrant-system/authorino-644ffd4dc5-76lrg"
Jul 22 03:16:40.122972 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.122954    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b87tv\" (UniqueName: \"kubernetes.io/projected/c5f15134-01ba-488a-847f-94ad668e138a-kube-api-access-b87tv\") pod \"authorino-644ffd4dc5-76lrg\" (UID: \"c5f15134-01ba-488a-847f-94ad668e138a\") " pod="kuadrant-system/authorino-644ffd4dc5-76lrg"
Jul 22 03:16:40.216222 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.216183    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mvdl\" (UniqueName: \"kubernetes.io/projected/3b9dd5c2-8a49-43a7-962f-1e3db9b65234-kube-api-access-2mvdl\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:16:40.241033 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.241009    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-644ffd4dc5-76lrg"
Jul 22 03:16:40.369669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.369639    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-644ffd4dc5-76lrg"]
Jul 22 03:16:40.371425 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:16:40.371403    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5f15134_01ba_488a_847f_94ad668e138a.slice/crio-d2b3e0fa9fda795f5f93dfe43029edce861a052a5100c6646f8fa60ad279735d WatchSource:0}: Error finding container d2b3e0fa9fda795f5f93dfe43029edce861a052a5100c6646f8fa60ad279735d: Status 404 returned error can't find the container with id d2b3e0fa9fda795f5f93dfe43029edce861a052a5100c6646f8fa60ad279735d
Jul 22 03:16:40.750206 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.750177    2571 generic.go:356] "Generic (PLEG): container finished" podID="3b9dd5c2-8a49-43a7-962f-1e3db9b65234" containerID="f517eb732fc5c838d3c06a86e8335926332481c04e5e220538260f5660708600" exitCode=0
Jul 22 03:16:40.750405 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.750214    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7k8t8"
Jul 22 03:16:40.750405 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.750264    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7k8t8" event={"ID":"3b9dd5c2-8a49-43a7-962f-1e3db9b65234","Type":"ContainerDied","Data":"f517eb732fc5c838d3c06a86e8335926332481c04e5e220538260f5660708600"}
Jul 22 03:16:40.750405 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.750305    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7k8t8" event={"ID":"3b9dd5c2-8a49-43a7-962f-1e3db9b65234","Type":"ContainerDied","Data":"4cb00fdde0da7d6807b96fba47d5998d3be534782c646e090d9a35da7794004b"}
Jul 22 03:16:40.750405 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.750322    2571 scope.go:117] "RemoveContainer" containerID="f517eb732fc5c838d3c06a86e8335926332481c04e5e220538260f5660708600"
Jul 22 03:16:40.756558 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.756305    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-644ffd4dc5-76lrg" event={"ID":"c5f15134-01ba-488a-847f-94ad668e138a","Type":"ContainerStarted","Data":"d2b3e0fa9fda795f5f93dfe43029edce861a052a5100c6646f8fa60ad279735d"}
Jul 22 03:16:40.760975 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.760960    2571 scope.go:117] "RemoveContainer" containerID="f517eb732fc5c838d3c06a86e8335926332481c04e5e220538260f5660708600"
Jul 22 03:16:40.761197 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:16:40.761181    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f517eb732fc5c838d3c06a86e8335926332481c04e5e220538260f5660708600\": container with ID starting with f517eb732fc5c838d3c06a86e8335926332481c04e5e220538260f5660708600 not found: ID does not exist" containerID="f517eb732fc5c838d3c06a86e8335926332481c04e5e220538260f5660708600"
Jul 22 03:16:40.761264 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.761203    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f517eb732fc5c838d3c06a86e8335926332481c04e5e220538260f5660708600"} err="failed to get container status \"f517eb732fc5c838d3c06a86e8335926332481c04e5e220538260f5660708600\": rpc error: code = NotFound desc = could not find container \"f517eb732fc5c838d3c06a86e8335926332481c04e5e220538260f5660708600\": container with ID starting with f517eb732fc5c838d3c06a86e8335926332481c04e5e220538260f5660708600 not found: ID does not exist"
Jul 22 03:16:40.771725 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.771704    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7k8t8"]
Jul 22 03:16:40.775661 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:40.775641    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7k8t8"]
Jul 22 03:16:41.763044 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:41.763009    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-644ffd4dc5-76lrg" event={"ID":"c5f15134-01ba-488a-847f-94ad668e138a","Type":"ContainerStarted","Data":"1fc96b9d0bc8db1be43e7b27815cadf3442d445762bd59c2139b7c60ec6c4c2d"}
Jul 22 03:16:41.780242 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:41.780194    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-644ffd4dc5-76lrg" podStartSLOduration=2.209881759 podStartE2EDuration="2.780178152s" totalImagesPullingTime="570.296393ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:16:41.778332163 +0000 UTC m=+578.144967968" watchObservedRunningTime="2026-07-22 03:16:41.780178152 +0000 UTC m=+578.146813996"
Jul 22 03:16:41.808254 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:41.808222    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cd8dfdc9f-8lmm2"]
Jul 22 03:16:41.808431 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:41.808403    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-cd8dfdc9f-8lmm2" podUID="f39ce320-61bd-493c-ba44-e27d4e055036" containerName="authorino" containerID="cri-o://342943c4c27da4b98e37e0de350d478340b7c1fd51c8d215e62941736ee5de78" gracePeriod=30
Jul 22 03:16:42.063570 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.063545    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd8dfdc9f-8lmm2"
Jul 22 03:16:42.104221 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.104191    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b9dd5c2-8a49-43a7-962f-1e3db9b65234" path="/var/lib/kubelet/pods/3b9dd5c2-8a49-43a7-962f-1e3db9b65234/volumes"
Jul 22 03:16:42.135302 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.135268    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c88nw\" (UniqueName: \"kubernetes.io/projected/f39ce320-61bd-493c-ba44-e27d4e055036-kube-api-access-c88nw\") pod \"f39ce320-61bd-493c-ba44-e27d4e055036\" (UID: \"f39ce320-61bd-493c-ba44-e27d4e055036\") "
Jul 22 03:16:42.137469 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.137435    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f39ce320-61bd-493c-ba44-e27d4e055036-kube-api-access-c88nw" (OuterVolumeSpecName: "kube-api-access-c88nw") pod "f39ce320-61bd-493c-ba44-e27d4e055036" (UID: "f39ce320-61bd-493c-ba44-e27d4e055036"). InnerVolumeSpecName "kube-api-access-c88nw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:16:42.236714 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.236680    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c88nw\" (UniqueName: \"kubernetes.io/projected/f39ce320-61bd-493c-ba44-e27d4e055036-kube-api-access-c88nw\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:16:42.769066 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.769030    2571 generic.go:356] "Generic (PLEG): container finished" podID="f39ce320-61bd-493c-ba44-e27d4e055036" containerID="342943c4c27da4b98e37e0de350d478340b7c1fd51c8d215e62941736ee5de78" exitCode=0
Jul 22 03:16:42.769066 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.769070    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cd8dfdc9f-8lmm2"
Jul 22 03:16:42.769530 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.769103    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cd8dfdc9f-8lmm2" event={"ID":"f39ce320-61bd-493c-ba44-e27d4e055036","Type":"ContainerDied","Data":"342943c4c27da4b98e37e0de350d478340b7c1fd51c8d215e62941736ee5de78"}
Jul 22 03:16:42.769530 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.769139    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cd8dfdc9f-8lmm2" event={"ID":"f39ce320-61bd-493c-ba44-e27d4e055036","Type":"ContainerDied","Data":"e0ba621b5806efc3563f55868f92d16e4477284f67a92570db011f6db9a442b9"}
Jul 22 03:16:42.769530 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.769156    2571 scope.go:117] "RemoveContainer" containerID="342943c4c27da4b98e37e0de350d478340b7c1fd51c8d215e62941736ee5de78"
Jul 22 03:16:42.778387 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.778367    2571 scope.go:117] "RemoveContainer" containerID="342943c4c27da4b98e37e0de350d478340b7c1fd51c8d215e62941736ee5de78"
Jul 22 03:16:42.778639 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:16:42.778622    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"342943c4c27da4b98e37e0de350d478340b7c1fd51c8d215e62941736ee5de78\": container with ID starting with 342943c4c27da4b98e37e0de350d478340b7c1fd51c8d215e62941736ee5de78 not found: ID does not exist" containerID="342943c4c27da4b98e37e0de350d478340b7c1fd51c8d215e62941736ee5de78"
Jul 22 03:16:42.778683 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.778647    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342943c4c27da4b98e37e0de350d478340b7c1fd51c8d215e62941736ee5de78"} err="failed to get container status \"342943c4c27da4b98e37e0de350d478340b7c1fd51c8d215e62941736ee5de78\": rpc error: code = NotFound desc = could not find container \"342943c4c27da4b98e37e0de350d478340b7c1fd51c8d215e62941736ee5de78\": container with ID starting with 342943c4c27da4b98e37e0de350d478340b7c1fd51c8d215e62941736ee5de78 not found: ID does not exist"
Jul 22 03:16:42.789765 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.789738    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cd8dfdc9f-8lmm2"]
Jul 22 03:16:42.793234 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:42.793212    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cd8dfdc9f-8lmm2"]
Jul 22 03:16:44.104390 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:16:44.104357    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f39ce320-61bd-493c-ba44-e27d4e055036" path="/var/lib/kubelet/pods/f39ce320-61bd-493c-ba44-e27d4e055036/volumes"
Jul 22 03:17:04.030113 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:04.030079    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:17:04.034361 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:04.034336    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:17:04.040754 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:04.040734    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:17:04.044642 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:04.044625    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:17:21.453745 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.453710    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-598zm"]
Jul 22 03:17:21.454211 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.454084    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39ce320-61bd-493c-ba44-e27d4e055036" containerName="authorino"
Jul 22 03:17:21.454211 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.454096    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39ce320-61bd-493c-ba44-e27d4e055036" containerName="authorino"
Jul 22 03:17:21.454211 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.454105    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b9dd5c2-8a49-43a7-962f-1e3db9b65234" containerName="authorino"
Jul 22 03:17:21.454211 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.454111    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b9dd5c2-8a49-43a7-962f-1e3db9b65234" containerName="authorino"
Jul 22 03:17:21.454211 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.454186    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f39ce320-61bd-493c-ba44-e27d4e055036" containerName="authorino"
Jul 22 03:17:21.454211 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.454196    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b9dd5c2-8a49-43a7-962f-1e3db9b65234" containerName="authorino"
Jul 22 03:17:21.458613 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.458593    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-598zm"
Jul 22 03:17:21.461164 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.461135    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 03:17:21.461278 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.461151    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-cdxp2\""
Jul 22 03:17:21.470817 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.470796    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-598zm"]
Jul 22 03:17:21.480847 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.480824    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5z5m\" (UniqueName: \"kubernetes.io/projected/3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431-kube-api-access-r5z5m\") pod \"payload-processing-5bf47cd988-598zm\" (UID: \"3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431\") " pod="openshift-ingress/payload-processing-5bf47cd988-598zm"
Jul 22 03:17:21.480963 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.480865    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431-plugins-config-volume\") pod \"payload-processing-5bf47cd988-598zm\" (UID: \"3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431\") " pod="openshift-ingress/payload-processing-5bf47cd988-598zm"
Jul 22 03:17:21.582259 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.582225    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5z5m\" (UniqueName: \"kubernetes.io/projected/3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431-kube-api-access-r5z5m\") pod \"payload-processing-5bf47cd988-598zm\" (UID: \"3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431\") " pod="openshift-ingress/payload-processing-5bf47cd988-598zm"
Jul 22 03:17:21.582420 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.582270    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431-plugins-config-volume\") pod \"payload-processing-5bf47cd988-598zm\" (UID: \"3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431\") " pod="openshift-ingress/payload-processing-5bf47cd988-598zm"
Jul 22 03:17:21.583016 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.582997    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431-plugins-config-volume\") pod \"payload-processing-5bf47cd988-598zm\" (UID: \"3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431\") " pod="openshift-ingress/payload-processing-5bf47cd988-598zm"
Jul 22 03:17:21.594367 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.594344    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5z5m\" (UniqueName: \"kubernetes.io/projected/3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431-kube-api-access-r5z5m\") pod \"payload-processing-5bf47cd988-598zm\" (UID: \"3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431\") " pod="openshift-ingress/payload-processing-5bf47cd988-598zm"
Jul 22 03:17:21.768694 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.768613    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-598zm"
Jul 22 03:17:21.900046 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.900012    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-598zm"]
Jul 22 03:17:21.902992 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:17:21.902965    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e6b6f11_3db0_48d7_b7e0_21ef8c6ba431.slice/crio-ba06a1f027657cf023f65ac8072cdd9a968bdbe10ed2f02bbb7fe0c6d9dc7f63 WatchSource:0}: Error finding container ba06a1f027657cf023f65ac8072cdd9a968bdbe10ed2f02bbb7fe0c6d9dc7f63: Status 404 returned error can't find the container with id ba06a1f027657cf023f65ac8072cdd9a968bdbe10ed2f02bbb7fe0c6d9dc7f63
Jul 22 03:17:21.961161 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:21.961126    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-598zm" event={"ID":"3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431","Type":"ContainerStarted","Data":"ba06a1f027657cf023f65ac8072cdd9a968bdbe10ed2f02bbb7fe0c6d9dc7f63"}
Jul 22 03:17:23.972573 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:23.972540    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-598zm" event={"ID":"3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431","Type":"ContainerStarted","Data":"8a554d3008424fb91558189d334ed7d6fd6652cf8c83699d6eeaea61fa5941ec"}
Jul 22 03:17:23.972989 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:23.972620    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-598zm"
Jul 22 03:17:23.988477 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:23.988411    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-598zm" podStartSLOduration=1.489882838 podStartE2EDuration="2.988393673s" totalImagesPullingTime="1.498510835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:17:23.987594945 +0000 UTC m=+620.354230751" watchObservedRunningTime="2026-07-22 03:17:23.988393673 +0000 UTC m=+620.355029480"
Jul 22 03:17:34.980167 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:17:34.980136    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-598zm"
Jul 22 03:18:11.540697 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.540662    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"]
Jul 22 03:18:11.544425 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.544403    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.548187 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.548166    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 22 03:18:11.548326 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.548182    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9dh47\""
Jul 22 03:18:11.548444 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.548428    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 03:18:11.548511 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.548480    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 03:18:11.556661 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.556638    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"]
Jul 22 03:18:11.626827 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.626790    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3249103-b215-41a1-a609-7cd389f62cbe-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.626827 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.626830    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97fm6\" (UniqueName: \"kubernetes.io/projected/e3249103-b215-41a1-a609-7cd389f62cbe-kube-api-access-97fm6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.627071 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.626869    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3249103-b215-41a1-a609-7cd389f62cbe-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.627071 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.626886    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3249103-b215-41a1-a609-7cd389f62cbe-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.627071 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.626994    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3249103-b215-41a1-a609-7cd389f62cbe-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.627071 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.627051    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3249103-b215-41a1-a609-7cd389f62cbe-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.727766 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.727727    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3249103-b215-41a1-a609-7cd389f62cbe-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.727970 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.727789    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3249103-b215-41a1-a609-7cd389f62cbe-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.727970 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.727839    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3249103-b215-41a1-a609-7cd389f62cbe-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.727970 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.727861    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97fm6\" (UniqueName: \"kubernetes.io/projected/e3249103-b215-41a1-a609-7cd389f62cbe-kube-api-access-97fm6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.727970 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.727897    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3249103-b215-41a1-a609-7cd389f62cbe-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.727970 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.727914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3249103-b215-41a1-a609-7cd389f62cbe-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.728218 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.728173    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e3249103-b215-41a1-a609-7cd389f62cbe-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.728278 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.728244    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3249103-b215-41a1-a609-7cd389f62cbe-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.728316 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.728286    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e3249103-b215-41a1-a609-7cd389f62cbe-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.730305 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.730283    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e3249103-b215-41a1-a609-7cd389f62cbe-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.730456 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.730438    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e3249103-b215-41a1-a609-7cd389f62cbe-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.735729 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.735696    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97fm6\" (UniqueName: \"kubernetes.io/projected/e3249103-b215-41a1-a609-7cd389f62cbe-kube-api-access-97fm6\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2d2gf\" (UID: \"e3249103-b215-41a1-a609-7cd389f62cbe\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.855334 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.855301    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:11.992973 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.992947    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"]
Jul 22 03:18:11.994945 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:18:11.994919    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3249103_b215_41a1_a609_7cd389f62cbe.slice/crio-8c890be0640e6220f27daf36371a75f8be6d9941327576ca77a9f87b77430aec WatchSource:0}: Error finding container 8c890be0640e6220f27daf36371a75f8be6d9941327576ca77a9f87b77430aec: Status 404 returned error can't find the container with id 8c890be0640e6220f27daf36371a75f8be6d9941327576ca77a9f87b77430aec
Jul 22 03:18:11.996414 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:11.996395    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:18:12.210636 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:12.210545    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf" event={"ID":"e3249103-b215-41a1-a609-7cd389f62cbe","Type":"ContainerStarted","Data":"8c890be0640e6220f27daf36371a75f8be6d9941327576ca77a9f87b77430aec"}
Jul 22 03:18:13.220380 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:13.220320    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf" event={"ID":"e3249103-b215-41a1-a609-7cd389f62cbe","Type":"ContainerStarted","Data":"6b8be48dc8b0ff853d43109e9729ca93726e9d97160481dc47b10f40b9e40887"}
Jul 22 03:18:13.240926 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:13.240844    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf" podStartSLOduration=1.156944054 podStartE2EDuration="2.240821518s" totalImagesPullingTime="1.083877464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:18:13.240283885 +0000 UTC m=+669.606919691" watchObservedRunningTime="2026-07-22 03:18:13.240821518 +0000 UTC m=+669.607457325"
Jul 22 03:18:21.855620 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:21.855586    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:21.856050 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:21.855653    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:21.868009 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:21.867979    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:22.273358 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:22.273278    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2d2gf"
Jul 22 03:18:52.134665 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.134624    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"]
Jul 22 03:18:52.139616 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.139592    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.141996 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.141975    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 22 03:18:52.149171 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.149145    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"]
Jul 22 03:18:52.196410 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.196367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z97gm\" (UniqueName: \"kubernetes.io/projected/c0fbcdb4-2185-4be0-9683-173dbbed12ab-kube-api-access-z97gm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.196606 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.196417    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0fbcdb4-2185-4be0-9683-173dbbed12ab-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.196606 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.196447    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0fbcdb4-2185-4be0-9683-173dbbed12ab-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.196606 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.196502    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0fbcdb4-2185-4be0-9683-173dbbed12ab-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.196606 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.196564    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0fbcdb4-2185-4be0-9683-173dbbed12ab-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.196606 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.196595    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0fbcdb4-2185-4be0-9683-173dbbed12ab-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.297854 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.297822    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0fbcdb4-2185-4be0-9683-173dbbed12ab-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.297854 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.297869    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0fbcdb4-2185-4be0-9683-173dbbed12ab-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.298109 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.297989    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z97gm\" (UniqueName: \"kubernetes.io/projected/c0fbcdb4-2185-4be0-9683-173dbbed12ab-kube-api-access-z97gm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.298109 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.298025    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0fbcdb4-2185-4be0-9683-173dbbed12ab-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.298109 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.298056    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0fbcdb4-2185-4be0-9683-173dbbed12ab-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.298109 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.298079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0fbcdb4-2185-4be0-9683-173dbbed12ab-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.298377 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.298352    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0fbcdb4-2185-4be0-9683-173dbbed12ab-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.298678 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.298440    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0fbcdb4-2185-4be0-9683-173dbbed12ab-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.298678 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.298472    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0fbcdb4-2185-4be0-9683-173dbbed12ab-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.300257 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.300232    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0fbcdb4-2185-4be0-9683-173dbbed12ab-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.300473 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.300454    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0fbcdb4-2185-4be0-9683-173dbbed12ab-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.305312 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.305292    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z97gm\" (UniqueName: \"kubernetes.io/projected/c0fbcdb4-2185-4be0-9683-173dbbed12ab-kube-api-access-z97gm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-z298n\" (UID: \"c0fbcdb4-2185-4be0-9683-173dbbed12ab\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.450212 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.450126    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:18:52.583578 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:52.583548    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"]
Jul 22 03:18:52.586617 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:18:52.586579    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0fbcdb4_2185_4be0_9683_173dbbed12ab.slice/crio-37125ad4552ca9c99b2ca4c6a4ee3154279ad6370877d885e758e468968a2570 WatchSource:0}: Error finding container 37125ad4552ca9c99b2ca4c6a4ee3154279ad6370877d885e758e468968a2570: Status 404 returned error can't find the container with id 37125ad4552ca9c99b2ca4c6a4ee3154279ad6370877d885e758e468968a2570
Jul 22 03:18:53.423257 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:53.423221    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n" event={"ID":"c0fbcdb4-2185-4be0-9683-173dbbed12ab","Type":"ContainerStarted","Data":"7b8a664f94ae8ff9d4e644d7e8b51757ed533347b4d2abb583c07e3facd757d0"}
Jul 22 03:18:53.423732 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:53.423267    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n" event={"ID":"c0fbcdb4-2185-4be0-9683-173dbbed12ab","Type":"ContainerStarted","Data":"37125ad4552ca9c99b2ca4c6a4ee3154279ad6370877d885e758e468968a2570"}
Jul 22 03:18:53.440988 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:18:53.440941    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n" podStartSLOduration=1.276384825 podStartE2EDuration="1.440927101s" totalImagesPullingTime="164.542276ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:18:53.439728145 +0000 UTC m=+709.806363963" watchObservedRunningTime="2026-07-22 03:18:53.440927101 +0000 UTC m=+709.807562907"
Jul 22 03:19:02.450581 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:02.450482    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:19:02.450581 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:02.450535    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:19:02.463455 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:02.463428    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:19:02.483058 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:02.483029    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-z298n"
Jul 22 03:19:58.357766 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:58.357729    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f845f886b-57xqp"]
Jul 22 03:19:58.361166 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:58.361150    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f845f886b-57xqp"
Jul 22 03:19:58.369057 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:58.369034    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f845f886b-57xqp"]
Jul 22 03:19:58.500172 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:58.500128    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8dls\" (UniqueName: \"kubernetes.io/projected/01aac06b-2a15-4db1-be3d-925766847709-kube-api-access-b8dls\") pod \"authorino-6f845f886b-57xqp\" (UID: \"01aac06b-2a15-4db1-be3d-925766847709\") " pod="kuadrant-system/authorino-6f845f886b-57xqp"
Jul 22 03:19:58.500374 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:58.500189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01aac06b-2a15-4db1-be3d-925766847709-tls-cert\") pod \"authorino-6f845f886b-57xqp\" (UID: \"01aac06b-2a15-4db1-be3d-925766847709\") " pod="kuadrant-system/authorino-6f845f886b-57xqp"
Jul 22 03:19:58.601510 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:58.601464    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8dls\" (UniqueName: \"kubernetes.io/projected/01aac06b-2a15-4db1-be3d-925766847709-kube-api-access-b8dls\") pod \"authorino-6f845f886b-57xqp\" (UID: \"01aac06b-2a15-4db1-be3d-925766847709\") " pod="kuadrant-system/authorino-6f845f886b-57xqp"
Jul 22 03:19:58.601698 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:58.601547    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01aac06b-2a15-4db1-be3d-925766847709-tls-cert\") pod \"authorino-6f845f886b-57xqp\" (UID: \"01aac06b-2a15-4db1-be3d-925766847709\") " pod="kuadrant-system/authorino-6f845f886b-57xqp"
Jul 22 03:19:58.604257 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:58.604236    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01aac06b-2a15-4db1-be3d-925766847709-tls-cert\") pod \"authorino-6f845f886b-57xqp\" (UID: \"01aac06b-2a15-4db1-be3d-925766847709\") " pod="kuadrant-system/authorino-6f845f886b-57xqp"
Jul 22 03:19:58.609384 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:58.609334    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8dls\" (UniqueName: \"kubernetes.io/projected/01aac06b-2a15-4db1-be3d-925766847709-kube-api-access-b8dls\") pod \"authorino-6f845f886b-57xqp\" (UID: \"01aac06b-2a15-4db1-be3d-925766847709\") " pod="kuadrant-system/authorino-6f845f886b-57xqp"
Jul 22 03:19:58.670891 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:58.670855    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f845f886b-57xqp"
Jul 22 03:19:58.810957 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:58.810925    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f845f886b-57xqp"]
Jul 22 03:19:58.814824 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:19:58.814787    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01aac06b_2a15_4db1_be3d_925766847709.slice/crio-ddebe2d9129d96b05118c244673c3013b64984d4aa7a6a918b50d53c1bb899e0 WatchSource:0}: Error finding container ddebe2d9129d96b05118c244673c3013b64984d4aa7a6a918b50d53c1bb899e0: Status 404 returned error can't find the container with id ddebe2d9129d96b05118c244673c3013b64984d4aa7a6a918b50d53c1bb899e0
Jul 22 03:19:59.753003 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:59.752966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f845f886b-57xqp" event={"ID":"01aac06b-2a15-4db1-be3d-925766847709","Type":"ContainerStarted","Data":"9429f29d62e35cf27ceccef0702c4443585d61cab65ac718404c362adf1a65c1"}
Jul 22 03:19:59.753003 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:59.753008    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f845f886b-57xqp" event={"ID":"01aac06b-2a15-4db1-be3d-925766847709","Type":"ContainerStarted","Data":"ddebe2d9129d96b05118c244673c3013b64984d4aa7a6a918b50d53c1bb899e0"}
Jul 22 03:19:59.769411 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:59.769346    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f845f886b-57xqp" podStartSLOduration=1.362168145 podStartE2EDuration="1.769323664s" totalImagesPullingTime="407.155519ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:19:59.769029208 +0000 UTC m=+776.135665028" watchObservedRunningTime="2026-07-22 03:19:59.769323664 +0000 UTC m=+776.135959471"
Jul 22 03:19:59.847512 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:59.847474    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-644ffd4dc5-76lrg"]
Jul 22 03:19:59.847680 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:19:59.847658    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-644ffd4dc5-76lrg" podUID="c5f15134-01ba-488a-847f-94ad668e138a" containerName="authorino" containerID="cri-o://1fc96b9d0bc8db1be43e7b27815cadf3442d445762bd59c2139b7c60ec6c4c2d" gracePeriod=30
Jul 22 03:20:00.121256 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.121227    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-644ffd4dc5-76lrg"
Jul 22 03:20:00.217224 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.217180    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b87tv\" (UniqueName: \"kubernetes.io/projected/c5f15134-01ba-488a-847f-94ad668e138a-kube-api-access-b87tv\") pod \"c5f15134-01ba-488a-847f-94ad668e138a\" (UID: \"c5f15134-01ba-488a-847f-94ad668e138a\") "
Jul 22 03:20:00.217380 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.217246    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5f15134-01ba-488a-847f-94ad668e138a-tls-cert\") pod \"c5f15134-01ba-488a-847f-94ad668e138a\" (UID: \"c5f15134-01ba-488a-847f-94ad668e138a\") "
Jul 22 03:20:00.219574 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.219542    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f15134-01ba-488a-847f-94ad668e138a-kube-api-access-b87tv" (OuterVolumeSpecName: "kube-api-access-b87tv") pod "c5f15134-01ba-488a-847f-94ad668e138a" (UID: "c5f15134-01ba-488a-847f-94ad668e138a"). InnerVolumeSpecName "kube-api-access-b87tv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:20:00.228423 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.228397    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5f15134-01ba-488a-847f-94ad668e138a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c5f15134-01ba-488a-847f-94ad668e138a" (UID: "c5f15134-01ba-488a-847f-94ad668e138a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:20:00.318809 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.318698    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b87tv\" (UniqueName: \"kubernetes.io/projected/c5f15134-01ba-488a-847f-94ad668e138a-kube-api-access-b87tv\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:20:00.318809 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.318740    2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c5f15134-01ba-488a-847f-94ad668e138a-tls-cert\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:20:00.759190 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.759151    2571 generic.go:356] "Generic (PLEG): container finished" podID="c5f15134-01ba-488a-847f-94ad668e138a" containerID="1fc96b9d0bc8db1be43e7b27815cadf3442d445762bd59c2139b7c60ec6c4c2d" exitCode=0
Jul 22 03:20:00.759678 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.759218    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-644ffd4dc5-76lrg"
Jul 22 03:20:00.759678 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.759253    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-644ffd4dc5-76lrg" event={"ID":"c5f15134-01ba-488a-847f-94ad668e138a","Type":"ContainerDied","Data":"1fc96b9d0bc8db1be43e7b27815cadf3442d445762bd59c2139b7c60ec6c4c2d"}
Jul 22 03:20:00.759678 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.759307    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-644ffd4dc5-76lrg" event={"ID":"c5f15134-01ba-488a-847f-94ad668e138a","Type":"ContainerDied","Data":"d2b3e0fa9fda795f5f93dfe43029edce861a052a5100c6646f8fa60ad279735d"}
Jul 22 03:20:00.759678 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.759331    2571 scope.go:117] "RemoveContainer" containerID="1fc96b9d0bc8db1be43e7b27815cadf3442d445762bd59c2139b7c60ec6c4c2d"
Jul 22 03:20:00.782336 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.782310    2571 scope.go:117] "RemoveContainer" containerID="1fc96b9d0bc8db1be43e7b27815cadf3442d445762bd59c2139b7c60ec6c4c2d"
Jul 22 03:20:00.782794 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:20:00.782744    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fc96b9d0bc8db1be43e7b27815cadf3442d445762bd59c2139b7c60ec6c4c2d\": container with ID starting with 1fc96b9d0bc8db1be43e7b27815cadf3442d445762bd59c2139b7c60ec6c4c2d not found: ID does not exist" containerID="1fc96b9d0bc8db1be43e7b27815cadf3442d445762bd59c2139b7c60ec6c4c2d"
Jul 22 03:20:00.782886 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.782801    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc96b9d0bc8db1be43e7b27815cadf3442d445762bd59c2139b7c60ec6c4c2d"} err="failed to get container status \"1fc96b9d0bc8db1be43e7b27815cadf3442d445762bd59c2139b7c60ec6c4c2d\": rpc error: code = NotFound desc = could not find container \"1fc96b9d0bc8db1be43e7b27815cadf3442d445762bd59c2139b7c60ec6c4c2d\": container with ID starting with 1fc96b9d0bc8db1be43e7b27815cadf3442d445762bd59c2139b7c60ec6c4c2d not found: ID does not exist"
Jul 22 03:20:00.795266 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.795174    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-644ffd4dc5-76lrg"]
Jul 22 03:20:00.805312 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:00.805282    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-644ffd4dc5-76lrg"]
Jul 22 03:20:02.104830 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:20:02.104799    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5f15134-01ba-488a-847f-94ad668e138a" path="/var/lib/kubelet/pods/c5f15134-01ba-488a-847f-94ad668e138a/volumes"
Jul 22 03:22:04.062436 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:22:04.062337    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:22:04.066867 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:22:04.066843    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:22:04.070096 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:22:04.070070    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:22:04.075025 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:22:04.074681    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:27:04.095120 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:27:04.095084    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:27:04.099658 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:27:04.099634    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:27:04.102049 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:27:04.102025    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:27:04.106878 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:27:04.106856    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:32:04.129992 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:32:04.129958    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:32:04.132892 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:32:04.132866    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:32:04.134844 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:32:04.134822    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:32:04.137165 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:32:04.137148    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:35:42.450230 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.450186    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642"]
Jul 22 03:35:42.450737 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.450711    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f15134-01ba-488a-847f-94ad668e138a" containerName="authorino"
Jul 22 03:35:42.450737 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.450732    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f15134-01ba-488a-847f-94ad668e138a" containerName="authorino"
Jul 22 03:35:42.450844 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.450830    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5f15134-01ba-488a-847f-94ad668e138a" containerName="authorino"
Jul 22 03:35:42.453868 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.453852    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642"
Jul 22 03:35:42.456522 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.456499    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:35:42.456650 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.456564    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:35:42.462498 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.462474    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642"]
Jul 22 03:35:42.534146 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.534102    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82cca04-3ba2-4583-bf53-8d9a72328d8f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6abd7a28-cg642\" (UID: \"f82cca04-3ba2-4583-bf53-8d9a72328d8f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642"
Jul 22 03:35:42.635699 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.635660    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82cca04-3ba2-4583-bf53-8d9a72328d8f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6abd7a28-cg642\" (UID: \"f82cca04-3ba2-4583-bf53-8d9a72328d8f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642"
Jul 22 03:35:42.636329 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.636306    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82cca04-3ba2-4583-bf53-8d9a72328d8f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-6abd7a28-cg642\" (UID: \"f82cca04-3ba2-4583-bf53-8d9a72328d8f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642"
Jul 22 03:35:42.767250 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.767151    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642"
Jul 22 03:35:42.903795 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.903757    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642"]
Jul 22 03:35:42.906120 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:35:42.906094    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82cca04_3ba2_4583_bf53_8d9a72328d8f.slice/crio-64a55e0ce1f5f0a28fed8c1a997f0cf2ad89cae65d99858f21470a6fb144b7bf WatchSource:0}: Error finding container 64a55e0ce1f5f0a28fed8c1a997f0cf2ad89cae65d99858f21470a6fb144b7bf: Status 404 returned error can't find the container with id 64a55e0ce1f5f0a28fed8c1a997f0cf2ad89cae65d99858f21470a6fb144b7bf
Jul 22 03:35:42.908110 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:42.908087    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:35:43.365157 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:43.365120    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642" event={"ID":"f82cca04-3ba2-4583-bf53-8d9a72328d8f","Type":"ContainerStarted","Data":"64a55e0ce1f5f0a28fed8c1a997f0cf2ad89cae65d99858f21470a6fb144b7bf"}
Jul 22 03:35:46.382323 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:46.382288    2571 generic.go:356] "Generic (PLEG): container finished" podID="f82cca04-3ba2-4583-bf53-8d9a72328d8f" containerID="2b9986f322188948219c8fbca1cf3518554756d64539842714c56236f95e2270" exitCode=0
Jul 22 03:35:46.382695 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:46.382370    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642" event={"ID":"f82cca04-3ba2-4583-bf53-8d9a72328d8f","Type":"ContainerDied","Data":"2b9986f322188948219c8fbca1cf3518554756d64539842714c56236f95e2270"}
Jul 22 03:35:47.535214 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:47.535189    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642"
Jul 22 03:35:47.683704 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:47.683618    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82cca04-3ba2-4583-bf53-8d9a72328d8f-maas-api-service-ca\") pod \"f82cca04-3ba2-4583-bf53-8d9a72328d8f\" (UID: \"f82cca04-3ba2-4583-bf53-8d9a72328d8f\") "
Jul 22 03:35:47.684011 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:47.683987    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f82cca04-3ba2-4583-bf53-8d9a72328d8f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f82cca04-3ba2-4583-bf53-8d9a72328d8f" (UID: "f82cca04-3ba2-4583-bf53-8d9a72328d8f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:35:47.784760 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:47.784726    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f82cca04-3ba2-4583-bf53-8d9a72328d8f-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:35:48.393905 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:48.393827    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642"
Jul 22 03:35:48.393905 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:48.393848    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642" event={"ID":"f82cca04-3ba2-4583-bf53-8d9a72328d8f","Type":"ContainerDied","Data":"64a55e0ce1f5f0a28fed8c1a997f0cf2ad89cae65d99858f21470a6fb144b7bf"}
Jul 22 03:35:48.393905 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:48.393900    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64a55e0ce1f5f0a28fed8c1a997f0cf2ad89cae65d99858f21470a6fb144b7bf"
Jul 22 03:35:57.522741 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:57.522698    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642"]
Jul 22 03:35:57.524629 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:57.524605    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-6abd7a28-cg642"]
Jul 22 03:35:58.105027 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:35:58.104992    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f82cca04-3ba2-4583-bf53-8d9a72328d8f" path="/var/lib/kubelet/pods/f82cca04-3ba2-4583-bf53-8d9a72328d8f/volumes"
Jul 22 03:37:04.173503 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:04.173462    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:37:04.173945 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:04.173558    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:37:04.177872 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:04.177849    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:37:04.178059 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:04.178043    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:37:54.599282 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:54.599250    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t"]
Jul 22 03:37:54.599748 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:54.599639    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f82cca04-3ba2-4583-bf53-8d9a72328d8f" containerName="revoke-keys"
Jul 22 03:37:54.599748 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:54.599650    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f82cca04-3ba2-4583-bf53-8d9a72328d8f" containerName="revoke-keys"
Jul 22 03:37:54.599748 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:54.599715    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f82cca04-3ba2-4583-bf53-8d9a72328d8f" containerName="revoke-keys"
Jul 22 03:37:54.602782 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:54.602755    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t"
Jul 22 03:37:54.605323 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:54.605299    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:37:54.605436 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:54.605326    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:37:54.609554 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:54.609378    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t"]
Jul 22 03:37:54.737686 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:54.737654    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/386731ce-9ffd-43ed-8844-d540cd2c2bc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1535280c-vnf9t\" (UID: \"386731ce-9ffd-43ed-8844-d540cd2c2bc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t"
Jul 22 03:37:54.838337 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:54.838300    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/386731ce-9ffd-43ed-8844-d540cd2c2bc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1535280c-vnf9t\" (UID: \"386731ce-9ffd-43ed-8844-d540cd2c2bc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t"
Jul 22 03:37:54.839022 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:54.838996    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/386731ce-9ffd-43ed-8844-d540cd2c2bc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1535280c-vnf9t\" (UID: \"386731ce-9ffd-43ed-8844-d540cd2c2bc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t"
Jul 22 03:37:54.914996 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:54.914907    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t"
Jul 22 03:37:55.049992 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:55.049915    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t"]
Jul 22 03:37:55.052355 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:37:55.052329    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386731ce_9ffd_43ed_8844_d540cd2c2bc8.slice/crio-cff8f7531b73654232b11e53f365a3d746a883722b0d20a2d399b9ead774ef97 WatchSource:0}: Error finding container cff8f7531b73654232b11e53f365a3d746a883722b0d20a2d399b9ead774ef97: Status 404 returned error can't find the container with id cff8f7531b73654232b11e53f365a3d746a883722b0d20a2d399b9ead774ef97
Jul 22 03:37:56.014509 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:56.014475    2571 generic.go:356] "Generic (PLEG): container finished" podID="386731ce-9ffd-43ed-8844-d540cd2c2bc8" containerID="ba74b7d29c4e6388b91dc0a5448e42c17185a154a95e1ac3db0c17fe207d8682" exitCode=0
Jul 22 03:37:56.014952 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:56.014527    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t" event={"ID":"386731ce-9ffd-43ed-8844-d540cd2c2bc8","Type":"ContainerDied","Data":"ba74b7d29c4e6388b91dc0a5448e42c17185a154a95e1ac3db0c17fe207d8682"}
Jul 22 03:37:56.014952 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:56.014568    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t" event={"ID":"386731ce-9ffd-43ed-8844-d540cd2c2bc8","Type":"ContainerStarted","Data":"cff8f7531b73654232b11e53f365a3d746a883722b0d20a2d399b9ead774ef97"}
Jul 22 03:37:57.154363 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:57.154337    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t"
Jul 22 03:37:57.260272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:57.260238    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/386731ce-9ffd-43ed-8844-d540cd2c2bc8-maas-api-service-ca\") pod \"386731ce-9ffd-43ed-8844-d540cd2c2bc8\" (UID: \"386731ce-9ffd-43ed-8844-d540cd2c2bc8\") "
Jul 22 03:37:57.260597 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:57.260573    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/386731ce-9ffd-43ed-8844-d540cd2c2bc8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "386731ce-9ffd-43ed-8844-d540cd2c2bc8" (UID: "386731ce-9ffd-43ed-8844-d540cd2c2bc8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:37:57.361370 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:57.361339    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/386731ce-9ffd-43ed-8844-d540cd2c2bc8-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:37:58.026982 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:58.026941    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t" event={"ID":"386731ce-9ffd-43ed-8844-d540cd2c2bc8","Type":"ContainerDied","Data":"cff8f7531b73654232b11e53f365a3d746a883722b0d20a2d399b9ead774ef97"}
Jul 22 03:37:58.026982 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:58.026967    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t"
Jul 22 03:37:58.027199 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:37:58.027001    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cff8f7531b73654232b11e53f365a3d746a883722b0d20a2d399b9ead774ef97"
Jul 22 03:38:09.699049 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:38:09.699010    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t"]
Jul 22 03:38:09.701500 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:38:09.701477    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1535280c-vnf9t"]
Jul 22 03:38:10.104272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:38:10.104237    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="386731ce-9ffd-43ed-8844-d540cd2c2bc8" path="/var/lib/kubelet/pods/386731ce-9ffd-43ed-8844-d540cd2c2bc8/volumes"
Jul 22 03:42:04.208406 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:42:04.208375    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:42:04.208994 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:42:04.208841    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:42:04.213332 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:42:04.213314    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:42:04.213468 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:42:04.213314    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:42:04.265691 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:42:04.265659    2571 scope.go:117] "RemoveContainer" containerID="2b9986f322188948219c8fbca1cf3518554756d64539842714c56236f95e2270"
Jul 22 03:44:04.292369 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:04.292331    2571 scope.go:117] "RemoveContainer" containerID="ba74b7d29c4e6388b91dc0a5448e42c17185a154a95e1ac3db0c17fe207d8682"
Jul 22 03:44:14.135433 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.135400    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"]
Jul 22 03:44:14.135983 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.135964    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="386731ce-9ffd-43ed-8844-d540cd2c2bc8" containerName="revoke-keys"
Jul 22 03:44:14.136060 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.135986    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="386731ce-9ffd-43ed-8844-d540cd2c2bc8" containerName="revoke-keys"
Jul 22 03:44:14.136122 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.136108    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="386731ce-9ffd-43ed-8844-d540cd2c2bc8" containerName="revoke-keys"
Jul 22 03:44:14.139279 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.139256    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.143251 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.143220    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-44f1c1\"/\"openshift-service-ca.crt\""
Jul 22 03:44:14.143251 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.143242    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-44f1c1\"/\"kube-root-ca.crt\""
Jul 22 03:44:14.143439 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.143218    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-44f1c1\"/\"default-dockercfg-8mg5l\""
Jul 22 03:44:14.143439 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.143219    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-44f1c1\"/\"test-model-44f1c1-kserve-self-signed-certs\""
Jul 22 03:44:14.148704 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.148677    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"]
Jul 22 03:44:14.283879 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.283848    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-tls-certs\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.284059 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.283908    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-model-cache\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.284059 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.283933    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knvg2\" (UniqueName: \"kubernetes.io/projected/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-kube-api-access-knvg2\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.284059 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.283960    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-home\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.284059 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.283977    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-dshm\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.284211 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.284069    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-tmp-dir\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.385384 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.385350    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-tls-certs\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.385564 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.385405    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-model-cache\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.385564 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.385421    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knvg2\" (UniqueName: \"kubernetes.io/projected/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-kube-api-access-knvg2\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.385564 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.385455    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-home\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.385564 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.385471    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-dshm\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.385564 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.385502    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-tmp-dir\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.385852 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.385800    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-model-cache\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.385910 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.385876    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-home\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.385971 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.385956    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-tmp-dir\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.387915 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.387888    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-dshm\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.388106 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.388091    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-tls-certs\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.395087 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.395066    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knvg2\" (UniqueName: \"kubernetes.io/projected/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-kube-api-access-knvg2\") pod \"test-model-44f1c1-kserve-8455466b99-5drh8\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") " pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.450202 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.450174    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:14.591366 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.591185    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"]
Jul 22 03:44:14.594161 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:44:14.594136    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9c8ba50_1ce4_4799_bd5a_460b6f02387c.slice/crio-68f0f07e2f06b542005580fe2aef92f0bbabdd9592d9c0f475b4b51ca1899a0f WatchSource:0}: Error finding container 68f0f07e2f06b542005580fe2aef92f0bbabdd9592d9c0f475b4b51ca1899a0f: Status 404 returned error can't find the container with id 68f0f07e2f06b542005580fe2aef92f0bbabdd9592d9c0f475b4b51ca1899a0f
Jul 22 03:44:14.884170 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.884133    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8" event={"ID":"b9c8ba50-1ce4-4799-bd5a-460b6f02387c","Type":"ContainerStarted","Data":"99fe2788a9596d82dc17810fda15a09b30f3c9856af6f2e07b5d2e470fb46e36"}
Jul 22 03:44:14.884170 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.884176    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8" event={"ID":"b9c8ba50-1ce4-4799-bd5a-460b6f02387c","Type":"ContainerStarted","Data":"68f0f07e2f06b542005580fe2aef92f0bbabdd9592d9c0f475b4b51ca1899a0f"}
Jul 22 03:44:14.904157 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:14.904064    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8" podStartSLOduration=0.904048167 podStartE2EDuration="904.048167ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:44:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:44:14.9031025 +0000 UTC m=+2231.269738306" watchObservedRunningTime="2026-07-22 03:44:14.904048167 +0000 UTC m=+2231.270683973"
Jul 22 03:44:24.451121 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:24.451067    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:24.451639 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:24.451140    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:24.467351 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:24.464820    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:24.950755 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:24.950724    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:44:35.819620 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.819578    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"]
Jul 22 03:44:35.823351 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.823331    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.827997 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.827969    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4c93e4\"/\"test-model-4c93e4-kserve-self-signed-certs\""
Jul 22 03:44:35.827997 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.827969    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4c93e4\"/\"kube-root-ca.crt\""
Jul 22 03:44:35.828232 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.828008    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-4c93e4\"/\"openshift-service-ca.crt\""
Jul 22 03:44:35.828691 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.828676    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-4c93e4\"/\"default-dockercfg-shjvk\""
Jul 22 03:44:35.866354 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.866314    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-home\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.866354 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.866354    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkck6\" (UniqueName: \"kubernetes.io/projected/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-kube-api-access-jkck6\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.866588 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.866444    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-tmp-dir\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.866588 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.866477    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-model-cache\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.866588 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.866498    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-dshm\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.866702 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.866590    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-tls-certs\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.917758 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.917710    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"]
Jul 22 03:44:35.967399 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.967362    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-tmp-dir\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.967604 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.967405    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-model-cache\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.967604 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.967434    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-dshm\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.967604 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.967482    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-tls-certs\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.967604 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.967556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-home\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.967604 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.967578    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkck6\" (UniqueName: \"kubernetes.io/projected/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-kube-api-access-jkck6\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.967928 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.967887    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-model-cache\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.968001 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.967979    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-tmp-dir\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.968100 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.968070    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-home\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.969982 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.969961    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-dshm\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.970141 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.970127    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-tls-certs\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:35.982426 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:35.982397    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkck6\" (UniqueName: \"kubernetes.io/projected/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-kube-api-access-jkck6\") pod \"test-model-4c93e4-kserve-5fc96fcdd5-6pztv\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") " pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:36.133455 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:36.133364    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:36.274331 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:36.274299    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"]
Jul 22 03:44:36.275950 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:44:36.275923    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfbf6b76_c9c2_4313_b768_61d5c26c38e9.slice/crio-7b9619f357f9bb8f8f966281feeb1d87aa11fd5d9f5f7fc85be85d89182c4760 WatchSource:0}: Error finding container 7b9619f357f9bb8f8f966281feeb1d87aa11fd5d9f5f7fc85be85d89182c4760: Status 404 returned error can't find the container with id 7b9619f357f9bb8f8f966281feeb1d87aa11fd5d9f5f7fc85be85d89182c4760
Jul 22 03:44:36.995265 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:36.995229    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv" event={"ID":"bfbf6b76-c9c2-4313-b768-61d5c26c38e9","Type":"ContainerStarted","Data":"e5596b7c51dea790a45c6364336de80beb5d5584d58908388b598df660110c69"}
Jul 22 03:44:36.995634 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:36.995274    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv" event={"ID":"bfbf6b76-c9c2-4313-b768-61d5c26c38e9","Type":"ContainerStarted","Data":"7b9619f357f9bb8f8f966281feeb1d87aa11fd5d9f5f7fc85be85d89182c4760"}
Jul 22 03:44:37.013460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:37.013410    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv" podStartSLOduration=2.013394091 podStartE2EDuration="2.013394091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:44:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:44:37.012239142 +0000 UTC m=+2253.378874963" watchObservedRunningTime="2026-07-22 03:44:37.013394091 +0000 UTC m=+2253.380029931"
Jul 22 03:44:46.133802 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:46.133744    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:46.133802 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:46.133810    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:46.146709 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:46.146684    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:44:47.055204 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:44:47.055174    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:45:19.629460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:19.629428    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"]
Jul 22 03:45:20.616823 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:20.616764    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"]
Jul 22 03:45:34.650637 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.650577    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8" podUID="b9c8ba50-1ce4-4799-bd5a-460b6f02387c" containerName="main" containerID="cri-o://99fe2788a9596d82dc17810fda15a09b30f3c9856af6f2e07b5d2e470fb46e36" gracePeriod=45
Jul 22 03:45:34.907394 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.907333    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:45:34.985669 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.985637    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-tls-certs\") pod \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") "
Jul 22 03:45:34.985912 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.985692    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-tmp-dir\") pod \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") "
Jul 22 03:45:34.985912 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.985735    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knvg2\" (UniqueName: \"kubernetes.io/projected/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-kube-api-access-knvg2\") pod \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") "
Jul 22 03:45:34.985912 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.985765    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-dshm\") pod \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") "
Jul 22 03:45:34.985912 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.985805    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-model-cache\") pod \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") "
Jul 22 03:45:34.985912 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.985850    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-home\") pod \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\" (UID: \"b9c8ba50-1ce4-4799-bd5a-460b6f02387c\") "
Jul 22 03:45:34.986198 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.986018    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b9c8ba50-1ce4-4799-bd5a-460b6f02387c" (UID: "b9c8ba50-1ce4-4799-bd5a-460b6f02387c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:45:34.986198 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.986179    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-home" (OuterVolumeSpecName: "home") pod "b9c8ba50-1ce4-4799-bd5a-460b6f02387c" (UID: "b9c8ba50-1ce4-4799-bd5a-460b6f02387c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:45:34.986198 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.986193    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-tmp-dir\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:45:34.986357 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.986290    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-model-cache" (OuterVolumeSpecName: "model-cache") pod "b9c8ba50-1ce4-4799-bd5a-460b6f02387c" (UID: "b9c8ba50-1ce4-4799-bd5a-460b6f02387c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:45:34.988159 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.988137    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-dshm" (OuterVolumeSpecName: "dshm") pod "b9c8ba50-1ce4-4799-bd5a-460b6f02387c" (UID: "b9c8ba50-1ce4-4799-bd5a-460b6f02387c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:45:34.988263 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.988162    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b9c8ba50-1ce4-4799-bd5a-460b6f02387c" (UID: "b9c8ba50-1ce4-4799-bd5a-460b6f02387c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:45:34.988263 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:34.988239    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-kube-api-access-knvg2" (OuterVolumeSpecName: "kube-api-access-knvg2") pod "b9c8ba50-1ce4-4799-bd5a-460b6f02387c" (UID: "b9c8ba50-1ce4-4799-bd5a-460b6f02387c"). InnerVolumeSpecName "kube-api-access-knvg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:45:35.086959 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.086921    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-home\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:45:35.086959 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.086949    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-tls-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:45:35.086959 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.086961    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knvg2\" (UniqueName: \"kubernetes.io/projected/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-kube-api-access-knvg2\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:45:35.086959 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.086969    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-dshm\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:45:35.087231 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.086979    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c8ba50-1ce4-4799-bd5a-460b6f02387c-model-cache\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:45:35.288845 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.288716    2571 generic.go:356] "Generic (PLEG): container finished" podID="b9c8ba50-1ce4-4799-bd5a-460b6f02387c" containerID="99fe2788a9596d82dc17810fda15a09b30f3c9856af6f2e07b5d2e470fb46e36" exitCode=0
Jul 22 03:45:35.288845 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.288762    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"
Jul 22 03:45:35.288845 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.288815    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8" event={"ID":"b9c8ba50-1ce4-4799-bd5a-460b6f02387c","Type":"ContainerDied","Data":"99fe2788a9596d82dc17810fda15a09b30f3c9856af6f2e07b5d2e470fb46e36"}
Jul 22 03:45:35.289082 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.288857    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8" event={"ID":"b9c8ba50-1ce4-4799-bd5a-460b6f02387c","Type":"ContainerDied","Data":"68f0f07e2f06b542005580fe2aef92f0bbabdd9592d9c0f475b4b51ca1899a0f"}
Jul 22 03:45:35.289082 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.288875    2571 scope.go:117] "RemoveContainer" containerID="99fe2788a9596d82dc17810fda15a09b30f3c9856af6f2e07b5d2e470fb46e36"
Jul 22 03:45:35.297873 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.297856    2571 scope.go:117] "RemoveContainer" containerID="99fe2788a9596d82dc17810fda15a09b30f3c9856af6f2e07b5d2e470fb46e36"
Jul 22 03:45:35.298153 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:45:35.298135    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99fe2788a9596d82dc17810fda15a09b30f3c9856af6f2e07b5d2e470fb46e36\": container with ID starting with 99fe2788a9596d82dc17810fda15a09b30f3c9856af6f2e07b5d2e470fb46e36 not found: ID does not exist" containerID="99fe2788a9596d82dc17810fda15a09b30f3c9856af6f2e07b5d2e470fb46e36"
Jul 22 03:45:35.298206 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.298163    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99fe2788a9596d82dc17810fda15a09b30f3c9856af6f2e07b5d2e470fb46e36"} err="failed to get container status \"99fe2788a9596d82dc17810fda15a09b30f3c9856af6f2e07b5d2e470fb46e36\": rpc error: code = NotFound desc = could not find container \"99fe2788a9596d82dc17810fda15a09b30f3c9856af6f2e07b5d2e470fb46e36\": container with ID starting with 99fe2788a9596d82dc17810fda15a09b30f3c9856af6f2e07b5d2e470fb46e36 not found: ID does not exist"
Jul 22 03:45:35.309617 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.309588    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"]
Jul 22 03:45:35.313708 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.313685    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-44f1c1/test-model-44f1c1-kserve-8455466b99-5drh8"]
Jul 22 03:45:35.637830 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.637790    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv" podUID="bfbf6b76-c9c2-4313-b768-61d5c26c38e9" containerName="main" containerID="cri-o://e5596b7c51dea790a45c6364336de80beb5d5584d58908388b598df660110c69" gracePeriod=45
Jul 22 03:45:35.896178 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.896105    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:45:35.993975 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.993944    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-model-cache\") pod \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") "
Jul 22 03:45:35.994152 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.993994    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-tmp-dir\") pod \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") "
Jul 22 03:45:35.994152 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.994055    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-home\") pod \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") "
Jul 22 03:45:35.994152 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.994092    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-dshm\") pod \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") "
Jul 22 03:45:35.994152 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.994127    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkck6\" (UniqueName: \"kubernetes.io/projected/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-kube-api-access-jkck6\") pod \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") "
Jul 22 03:45:35.994330 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.994195    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-tls-certs\") pod \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\" (UID: \"bfbf6b76-c9c2-4313-b768-61d5c26c38e9\") "
Jul 22 03:45:35.994330 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.994250    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-model-cache" (OuterVolumeSpecName: "model-cache") pod "bfbf6b76-c9c2-4313-b768-61d5c26c38e9" (UID: "bfbf6b76-c9c2-4313-b768-61d5c26c38e9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:45:35.994438 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.994344    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-home" (OuterVolumeSpecName: "home") pod "bfbf6b76-c9c2-4313-b768-61d5c26c38e9" (UID: "bfbf6b76-c9c2-4313-b768-61d5c26c38e9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:45:35.994438 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.994356    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bfbf6b76-c9c2-4313-b768-61d5c26c38e9" (UID: "bfbf6b76-c9c2-4313-b768-61d5c26c38e9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:45:35.994551 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.994524    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-home\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:45:35.994551 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.994539    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-model-cache\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:45:35.994551 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.994548    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-tmp-dir\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:45:35.996568 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.996540    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-dshm" (OuterVolumeSpecName: "dshm") pod "bfbf6b76-c9c2-4313-b768-61d5c26c38e9" (UID: "bfbf6b76-c9c2-4313-b768-61d5c26c38e9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:45:35.996683 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.996588    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bfbf6b76-c9c2-4313-b768-61d5c26c38e9" (UID: "bfbf6b76-c9c2-4313-b768-61d5c26c38e9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:45:35.996683 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:35.996597    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-kube-api-access-jkck6" (OuterVolumeSpecName: "kube-api-access-jkck6") pod "bfbf6b76-c9c2-4313-b768-61d5c26c38e9" (UID: "bfbf6b76-c9c2-4313-b768-61d5c26c38e9"). InnerVolumeSpecName "kube-api-access-jkck6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:45:36.095396 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:36.095359    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-tls-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:45:36.095396 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:36.095391    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-dshm\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:45:36.095396 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:36.095401    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkck6\" (UniqueName: \"kubernetes.io/projected/bfbf6b76-c9c2-4313-b768-61d5c26c38e9-kube-api-access-jkck6\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:45:36.104520 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:36.104487    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9c8ba50-1ce4-4799-bd5a-460b6f02387c" path="/var/lib/kubelet/pods/b9c8ba50-1ce4-4799-bd5a-460b6f02387c/volumes"
Jul 22 03:45:36.294702 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:36.294617    2571 generic.go:356] "Generic (PLEG): container finished" podID="bfbf6b76-c9c2-4313-b768-61d5c26c38e9" containerID="e5596b7c51dea790a45c6364336de80beb5d5584d58908388b598df660110c69" exitCode=0
Jul 22 03:45:36.294702 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:36.294658    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"
Jul 22 03:45:36.294924 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:36.294705    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv" event={"ID":"bfbf6b76-c9c2-4313-b768-61d5c26c38e9","Type":"ContainerDied","Data":"e5596b7c51dea790a45c6364336de80beb5d5584d58908388b598df660110c69"}
Jul 22 03:45:36.294924 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:36.294748    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv" event={"ID":"bfbf6b76-c9c2-4313-b768-61d5c26c38e9","Type":"ContainerDied","Data":"7b9619f357f9bb8f8f966281feeb1d87aa11fd5d9f5f7fc85be85d89182c4760"}
Jul 22 03:45:36.294924 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:36.294797    2571 scope.go:117] "RemoveContainer" containerID="e5596b7c51dea790a45c6364336de80beb5d5584d58908388b598df660110c69"
Jul 22 03:45:36.303646 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:36.303629    2571 scope.go:117] "RemoveContainer" containerID="e5596b7c51dea790a45c6364336de80beb5d5584d58908388b598df660110c69"
Jul 22 03:45:36.303911 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:45:36.303889    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5596b7c51dea790a45c6364336de80beb5d5584d58908388b598df660110c69\": container with ID starting with e5596b7c51dea790a45c6364336de80beb5d5584d58908388b598df660110c69 not found: ID does not exist" containerID="e5596b7c51dea790a45c6364336de80beb5d5584d58908388b598df660110c69"
Jul 22 03:45:36.304002 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:36.303916    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5596b7c51dea790a45c6364336de80beb5d5584d58908388b598df660110c69"} err="failed to get container status \"e5596b7c51dea790a45c6364336de80beb5d5584d58908388b598df660110c69\": rpc error: code = NotFound desc = could not find container \"e5596b7c51dea790a45c6364336de80beb5d5584d58908388b598df660110c69\": container with ID starting with e5596b7c51dea790a45c6364336de80beb5d5584d58908388b598df660110c69 not found: ID does not exist"
Jul 22 03:45:36.312011 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:36.311978    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"]
Jul 22 03:45:36.317312 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:36.317287    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-4c93e4/test-model-4c93e4-kserve-5fc96fcdd5-6pztv"]
Jul 22 03:45:38.107208 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:38.106617    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfbf6b76-c9c2-4313-b768-61d5c26c38e9" path="/var/lib/kubelet/pods/bfbf6b76-c9c2-4313-b768-61d5c26c38e9/volumes"
Jul 22 03:45:43.211653 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.211623    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485"]
Jul 22 03:45:43.212057 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.212024    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfbf6b76-c9c2-4313-b768-61d5c26c38e9" containerName="main"
Jul 22 03:45:43.212057 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.212035    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfbf6b76-c9c2-4313-b768-61d5c26c38e9" containerName="main"
Jul 22 03:45:43.212057 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.212045    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9c8ba50-1ce4-4799-bd5a-460b6f02387c" containerName="main"
Jul 22 03:45:43.212057 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.212051    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9c8ba50-1ce4-4799-bd5a-460b6f02387c" containerName="main"
Jul 22 03:45:43.212191 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.212117    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9c8ba50-1ce4-4799-bd5a-460b6f02387c" containerName="main"
Jul 22 03:45:43.212191 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.212125    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfbf6b76-c9c2-4313-b768-61d5c26c38e9" containerName="main"
Jul 22 03:45:43.215373 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.215352    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485"
Jul 22 03:45:43.218132 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.218109    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:45:43.218259 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.218135    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:45:43.222430 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.222371    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485"]
Jul 22 03:45:43.258805 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.258747    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efe08df1-c8d9-4353-99de-22687a886e63-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485\" (UID: \"efe08df1-c8d9-4353-99de-22687a886e63\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485"
Jul 22 03:45:43.360190 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.360159    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efe08df1-c8d9-4353-99de-22687a886e63-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485\" (UID: \"efe08df1-c8d9-4353-99de-22687a886e63\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485"
Jul 22 03:45:43.360825 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.360805    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efe08df1-c8d9-4353-99de-22687a886e63-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485\" (UID: \"efe08df1-c8d9-4353-99de-22687a886e63\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485"
Jul 22 03:45:43.528356 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.528276    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485"
Jul 22 03:45:43.667021 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:43.666999    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485"]
Jul 22 03:45:43.669243 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:45:43.669215    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe08df1_c8d9_4353_99de_22687a886e63.slice/crio-eedc06b73dd9ce45d1c6d6c3e4e0342eabddb2ff96e8d5fbd11389538f3a93b3 WatchSource:0}: Error finding container eedc06b73dd9ce45d1c6d6c3e4e0342eabddb2ff96e8d5fbd11389538f3a93b3: Status 404 returned error can't find the container with id eedc06b73dd9ce45d1c6d6c3e4e0342eabddb2ff96e8d5fbd11389538f3a93b3
Jul 22 03:45:44.336225 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:44.336198    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485" event={"ID":"efe08df1-c8d9-4353-99de-22687a886e63","Type":"ContainerStarted","Data":"2ef853f44f469b6e1db1a58ee47687a966c454b8f247e93f256c83511fa624ed"}
Jul 22 03:45:44.336595 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:44.336257    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485" event={"ID":"efe08df1-c8d9-4353-99de-22687a886e63","Type":"ContainerStarted","Data":"eedc06b73dd9ce45d1c6d6c3e4e0342eabddb2ff96e8d5fbd11389538f3a93b3"}
Jul 22 03:45:44.350838 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:44.350792    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485" podStartSLOduration=1.350759063 podStartE2EDuration="1.350759063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:45:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:45:44.349980137 +0000 UTC m=+2320.716615945" watchObservedRunningTime="2026-07-22 03:45:44.350759063 +0000 UTC m=+2320.717394869"
Jul 22 03:45:45.342476 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:45.342440    2571 generic.go:356] "Generic (PLEG): container finished" podID="efe08df1-c8d9-4353-99de-22687a886e63" containerID="2ef853f44f469b6e1db1a58ee47687a966c454b8f247e93f256c83511fa624ed" exitCode=0
Jul 22 03:45:45.342889 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:45.342526    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485" event={"ID":"efe08df1-c8d9-4353-99de-22687a886e63","Type":"ContainerDied","Data":"2ef853f44f469b6e1db1a58ee47687a966c454b8f247e93f256c83511fa624ed"}
Jul 22 03:45:46.484229 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:46.484203    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485"
Jul 22 03:45:46.590482 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:46.590441    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efe08df1-c8d9-4353-99de-22687a886e63-maas-api-service-ca\") pod \"efe08df1-c8d9-4353-99de-22687a886e63\" (UID: \"efe08df1-c8d9-4353-99de-22687a886e63\") "
Jul 22 03:45:46.590900 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:46.590879    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efe08df1-c8d9-4353-99de-22687a886e63-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "efe08df1-c8d9-4353-99de-22687a886e63" (UID: "efe08df1-c8d9-4353-99de-22687a886e63"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:45:46.691407 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:46.691318    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/efe08df1-c8d9-4353-99de-22687a886e63-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:45:47.354994 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:47.354965    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485"
Jul 22 03:45:47.354994 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:47.354982    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485" event={"ID":"efe08df1-c8d9-4353-99de-22687a886e63","Type":"ContainerDied","Data":"eedc06b73dd9ce45d1c6d6c3e4e0342eabddb2ff96e8d5fbd11389538f3a93b3"}
Jul 22 03:45:47.355231 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:47.355025    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eedc06b73dd9ce45d1c6d6c3e4e0342eabddb2ff96e8d5fbd11389538f3a93b3"
Jul 22 03:45:58.282795 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:58.282741    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485"]
Jul 22 03:45:58.285749 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:45:58.285711    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-4c93e4-xq485"]
Jul 22 03:46:00.104292 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:00.104260    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efe08df1-c8d9-4353-99de-22687a886e63" path="/var/lib/kubelet/pods/efe08df1-c8d9-4353-99de-22687a886e63/volumes"
Jul 22 03:46:29.591061 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:29.591027    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh"]
Jul 22 03:46:29.591567 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:29.591422    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efe08df1-c8d9-4353-99de-22687a886e63" containerName="revoke-keys"
Jul 22 03:46:29.591567 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:29.591434    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="efe08df1-c8d9-4353-99de-22687a886e63" containerName="revoke-keys"
Jul 22 03:46:29.591567 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:29.591494    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="efe08df1-c8d9-4353-99de-22687a886e63" containerName="revoke-keys"
Jul 22 03:46:29.594635 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:29.594618    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh"
Jul 22 03:46:29.597039 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:29.597017    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:46:29.597157 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:29.597115    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:46:29.601384 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:29.601364    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh"]
Jul 22 03:46:29.687602 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:29.687565    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f412a793-f8b9-43e5-8032-2224ef1204df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh\" (UID: \"f412a793-f8b9-43e5-8032-2224ef1204df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh"
Jul 22 03:46:29.788971 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:29.788934    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f412a793-f8b9-43e5-8032-2224ef1204df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh\" (UID: \"f412a793-f8b9-43e5-8032-2224ef1204df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh"
Jul 22 03:46:29.789604 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:29.789582    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f412a793-f8b9-43e5-8032-2224ef1204df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh\" (UID: \"f412a793-f8b9-43e5-8032-2224ef1204df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh"
Jul 22 03:46:29.906315 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:29.906220    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh"
Jul 22 03:46:30.048791 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:30.048744    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh"]
Jul 22 03:46:30.569487 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:30.569456    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh" event={"ID":"f412a793-f8b9-43e5-8032-2224ef1204df","Type":"ContainerStarted","Data":"59588fc4d7800600553cc71b232af3f9cd7debbf244ca70d5573bae0a7824877"}
Jul 22 03:46:30.569644 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:30.569508    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh" event={"ID":"f412a793-f8b9-43e5-8032-2224ef1204df","Type":"ContainerStarted","Data":"c7ddc93f596ed2df35534deeeab453ef2304ecd714e320caf34a6745998eed99"}
Jul 22 03:46:30.588627 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:30.588564    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh" podStartSLOduration=1.588546569 podStartE2EDuration="1.588546569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:46:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:46:30.586420283 +0000 UTC m=+2366.953056080" watchObservedRunningTime="2026-07-22 03:46:30.588546569 +0000 UTC m=+2366.955182375"
Jul 22 03:46:31.575884 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:31.575853    2571 generic.go:356] "Generic (PLEG): container finished" podID="f412a793-f8b9-43e5-8032-2224ef1204df" containerID="59588fc4d7800600553cc71b232af3f9cd7debbf244ca70d5573bae0a7824877" exitCode=0
Jul 22 03:46:31.576293 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:31.575934    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh" event={"ID":"f412a793-f8b9-43e5-8032-2224ef1204df","Type":"ContainerDied","Data":"59588fc4d7800600553cc71b232af3f9cd7debbf244ca70d5573bae0a7824877"}
Jul 22 03:46:32.716874 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:32.716848    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh"
Jul 22 03:46:32.814497 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:32.814462    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f412a793-f8b9-43e5-8032-2224ef1204df-maas-api-service-ca\") pod \"f412a793-f8b9-43e5-8032-2224ef1204df\" (UID: \"f412a793-f8b9-43e5-8032-2224ef1204df\") "
Jul 22 03:46:32.814894 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:32.814868    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f412a793-f8b9-43e5-8032-2224ef1204df-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f412a793-f8b9-43e5-8032-2224ef1204df" (UID: "f412a793-f8b9-43e5-8032-2224ef1204df"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:46:32.916121 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:32.916031    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f412a793-f8b9-43e5-8032-2224ef1204df-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:46:33.588503 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:33.588475    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh"
Jul 22 03:46:33.588503 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:33.588483    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh" event={"ID":"f412a793-f8b9-43e5-8032-2224ef1204df","Type":"ContainerDied","Data":"c7ddc93f596ed2df35534deeeab453ef2304ecd714e320caf34a6745998eed99"}
Jul 22 03:46:33.588714 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:33.588544    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7ddc93f596ed2df35534deeeab453ef2304ecd714e320caf34a6745998eed99"
Jul 22 03:46:49.662508 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:49.662468    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh"]
Jul 22 03:46:49.664796 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:49.664757    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-7a2eef-g2nmh"]
Jul 22 03:46:50.105002 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:46:50.104959    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f412a793-f8b9-43e5-8032-2224ef1204df" path="/var/lib/kubelet/pods/f412a793-f8b9-43e5-8032-2224ef1204df/volumes"
Jul 22 03:47:04.244163 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:04.244135    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:47:04.245187 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:04.245162    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:47:04.248587 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:04.248569    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:47:04.249450 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:04.249427    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:47:56.031617 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.031584    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"]
Jul 22 03:47:56.032240 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.032184    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f412a793-f8b9-43e5-8032-2224ef1204df" containerName="revoke-keys"
Jul 22 03:47:56.032240 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.032206    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f412a793-f8b9-43e5-8032-2224ef1204df" containerName="revoke-keys"
Jul 22 03:47:56.032366 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.032338    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f412a793-f8b9-43e5-8032-2224ef1204df" containerName="revoke-keys"
Jul 22 03:47:56.035479 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.035446    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.039470 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.039444    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c713ac\"/\"default-dockercfg-7v8hk\""
Jul 22 03:47:56.039618 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.039468    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c713ac\"/\"openshift-service-ca.crt\""
Jul 22 03:47:56.039618 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.039495    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c713ac\"/\"kube-root-ca.crt\""
Jul 22 03:47:56.039618 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.039444    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c713ac\"/\"auth-test-model-c713ac-kserve-self-signed-certs\""
Jul 22 03:47:56.044944 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.044910    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"]
Jul 22 03:47:56.077497 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.077463    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-dshm\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.077661 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.077519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-model-cache\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.077661 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.077537    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/549197fa-1acc-4368-b273-0636ef57a980-tls-certs\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.077661 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.077640    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-home\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.077828 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.077717    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-tmp-dir\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.077828 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.077746    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jwqt\" (UniqueName: \"kubernetes.io/projected/549197fa-1acc-4368-b273-0636ef57a980-kube-api-access-8jwqt\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.178432 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.178397    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-tmp-dir\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.178618 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.178440    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jwqt\" (UniqueName: \"kubernetes.io/projected/549197fa-1acc-4368-b273-0636ef57a980-kube-api-access-8jwqt\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.178618 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.178478    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-dshm\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.178618 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.178534    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-model-cache\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.178618 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.178557    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/549197fa-1acc-4368-b273-0636ef57a980-tls-certs\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.178618 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.178595    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-home\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.178929 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.178905    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-tmp-dir\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.178988 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.178932    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-model-cache\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.178988 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.178981    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-home\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.181014 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.180986    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-dshm\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.181262 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.181242    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/549197fa-1acc-4368-b273-0636ef57a980-tls-certs\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.187017 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.186999    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jwqt\" (UniqueName: \"kubernetes.io/projected/549197fa-1acc-4368-b273-0636ef57a980-kube-api-access-8jwqt\") pod \"auth-test-model-c713ac-kserve-bcb69bf9-6gx4z\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") " pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.347357 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.347322    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:47:56.486509 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.486484    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"]
Jul 22 03:47:56.488619 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:47:56.488587    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod549197fa_1acc_4368_b273_0636ef57a980.slice/crio-d8d17f53a66c4f5842ea638dfde3cd316c2c8973956f2ca4ce235baccb989551 WatchSource:0}: Error finding container d8d17f53a66c4f5842ea638dfde3cd316c2c8973956f2ca4ce235baccb989551: Status 404 returned error can't find the container with id d8d17f53a66c4f5842ea638dfde3cd316c2c8973956f2ca4ce235baccb989551
Jul 22 03:47:56.999602 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.999564    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z" event={"ID":"549197fa-1acc-4368-b273-0636ef57a980","Type":"ContainerStarted","Data":"5b15239f55428df6b2a0082981c7c0ddb4c294f27fc432435ac7debbe7b00ca2"}
Jul 22 03:47:56.999859 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:56.999617    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z" event={"ID":"549197fa-1acc-4368-b273-0636ef57a980","Type":"ContainerStarted","Data":"d8d17f53a66c4f5842ea638dfde3cd316c2c8973956f2ca4ce235baccb989551"}
Jul 22 03:47:57.018932 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:47:57.018875    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z" podStartSLOduration=1.018860503 podStartE2EDuration="1.018860503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:47:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:47:57.0177386 +0000 UTC m=+2453.384374408" watchObservedRunningTime="2026-07-22 03:47:57.018860503 +0000 UTC m=+2453.385496331"
Jul 22 03:48:06.348119 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:06.348076    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:48:06.348586 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:06.348144    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:48:06.361049 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:06.361019    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:48:07.061798 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:07.061751    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:48:18.042320 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.042283    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"]
Jul 22 03:48:18.045718 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.045701    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.052572 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.052553    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-be39c1\"/\"auth-test-model-be39c1-kserve-self-signed-certs\""
Jul 22 03:48:18.053646 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.053630    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-be39c1\"/\"openshift-service-ca.crt\""
Jul 22 03:48:18.053743 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.053649    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-be39c1\"/\"kube-root-ca.crt\""
Jul 22 03:48:18.053832 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.053739    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-be39c1\"/\"default-dockercfg-9p4h2\""
Jul 22 03:48:18.064304 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.064270    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"]
Jul 22 03:48:18.182588 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.182556    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-dshm\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.182588 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.182591    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-tls-certs\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.182835 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.182619    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-tmp-dir\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.182835 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.182641    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd9p2\" (UniqueName: \"kubernetes.io/projected/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-kube-api-access-sd9p2\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.182835 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.182755    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-home\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.182835 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.182831    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-model-cache\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.284184 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.284149    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-model-cache\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.284361 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.284217    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-dshm\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.284361 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.284237    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-tls-certs\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.284361 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.284271    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-tmp-dir\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.284361 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.284294    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd9p2\" (UniqueName: \"kubernetes.io/projected/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-kube-api-access-sd9p2\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.284361 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.284356    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-home\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.285080 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.285049    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-model-cache\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.285272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.285162    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-home\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.285371 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.285180    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-tmp-dir\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.288874 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.288846    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-tls-certs\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.293966 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.293903    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-dshm\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.296025 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.296003    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd9p2\" (UniqueName: \"kubernetes.io/projected/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-kube-api-access-sd9p2\") pod \"auth-test-model-be39c1-kserve-5dc8b479dc-94mtz\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") " pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.355166 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.355120    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:18.491754 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:18.491732    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"]
Jul 22 03:48:18.493879 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:48:18.493847    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f5cfa54_15fb_4b4b_8bfb_52366ae755fb.slice/crio-7dbb458f2f77fc3002b8621dbc3f10d4472972f6074200e8f58bd70b68c8a907 WatchSource:0}: Error finding container 7dbb458f2f77fc3002b8621dbc3f10d4472972f6074200e8f58bd70b68c8a907: Status 404 returned error can't find the container with id 7dbb458f2f77fc3002b8621dbc3f10d4472972f6074200e8f58bd70b68c8a907
Jul 22 03:48:19.112597 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:19.112560    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz" event={"ID":"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb","Type":"ContainerStarted","Data":"92597a3fc927f3e381a46207d501c47ca7ebda03c7cba171b549bcf246f1f647"}
Jul 22 03:48:19.112597 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:19.112600    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz" event={"ID":"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb","Type":"ContainerStarted","Data":"7dbb458f2f77fc3002b8621dbc3f10d4472972f6074200e8f58bd70b68c8a907"}
Jul 22 03:48:19.132676 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:19.132615    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz" podStartSLOduration=1.132598985 podStartE2EDuration="1.132598985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:48:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:48:19.13037347 +0000 UTC m=+2475.497009291" watchObservedRunningTime="2026-07-22 03:48:19.132598985 +0000 UTC m=+2475.499234791"
Jul 22 03:48:28.356155 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:28.356113    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:28.356653 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:28.356176    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:28.368537 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:28.368515    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:48:29.178311 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:48:29.178286    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:50:35.175026 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:35.174991    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"]
Jul 22 03:50:36.418081 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:36.418050    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"]
Jul 22 03:50:50.196420 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.196384    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z" podUID="549197fa-1acc-4368-b273-0636ef57a980" containerName="main" containerID="cri-o://5b15239f55428df6b2a0082981c7c0ddb4c294f27fc432435ac7debbe7b00ca2" gracePeriod=45
Jul 22 03:50:50.446916 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.446844    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:50:50.508306 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.508270    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/549197fa-1acc-4368-b273-0636ef57a980-tls-certs\") pod \"549197fa-1acc-4368-b273-0636ef57a980\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") "
Jul 22 03:50:50.508306 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.508305    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jwqt\" (UniqueName: \"kubernetes.io/projected/549197fa-1acc-4368-b273-0636ef57a980-kube-api-access-8jwqt\") pod \"549197fa-1acc-4368-b273-0636ef57a980\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") "
Jul 22 03:50:50.508550 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.508356    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-home\") pod \"549197fa-1acc-4368-b273-0636ef57a980\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") "
Jul 22 03:50:50.508550 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.508438    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-dshm\") pod \"549197fa-1acc-4368-b273-0636ef57a980\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") "
Jul 22 03:50:50.508550 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.508462    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-model-cache\") pod \"549197fa-1acc-4368-b273-0636ef57a980\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") "
Jul 22 03:50:50.508550 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.508478    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-tmp-dir\") pod \"549197fa-1acc-4368-b273-0636ef57a980\" (UID: \"549197fa-1acc-4368-b273-0636ef57a980\") "
Jul 22 03:50:50.508797 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.508641    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-home" (OuterVolumeSpecName: "home") pod "549197fa-1acc-4368-b273-0636ef57a980" (UID: "549197fa-1acc-4368-b273-0636ef57a980"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:50:50.508890 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.508865    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-model-cache" (OuterVolumeSpecName: "model-cache") pod "549197fa-1acc-4368-b273-0636ef57a980" (UID: "549197fa-1acc-4368-b273-0636ef57a980"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:50:50.508953 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.508904    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "549197fa-1acc-4368-b273-0636ef57a980" (UID: "549197fa-1acc-4368-b273-0636ef57a980"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:50:50.510751 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.510721    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/549197fa-1acc-4368-b273-0636ef57a980-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "549197fa-1acc-4368-b273-0636ef57a980" (UID: "549197fa-1acc-4368-b273-0636ef57a980"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:50:50.510751 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.510732    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/549197fa-1acc-4368-b273-0636ef57a980-kube-api-access-8jwqt" (OuterVolumeSpecName: "kube-api-access-8jwqt") pod "549197fa-1acc-4368-b273-0636ef57a980" (UID: "549197fa-1acc-4368-b273-0636ef57a980"). InnerVolumeSpecName "kube-api-access-8jwqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:50:50.510954 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.510840    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-dshm" (OuterVolumeSpecName: "dshm") pod "549197fa-1acc-4368-b273-0636ef57a980" (UID: "549197fa-1acc-4368-b273-0636ef57a980"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:50:50.609480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.609444    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-home\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:50:50.609480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.609474    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-dshm\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:50:50.609480 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.609485    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-model-cache\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:50:50.609692 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.609499    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/549197fa-1acc-4368-b273-0636ef57a980-tmp-dir\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:50:50.609692 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.609509    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/549197fa-1acc-4368-b273-0636ef57a980-tls-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:50:50.609692 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.609521    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jwqt\" (UniqueName: \"kubernetes.io/projected/549197fa-1acc-4368-b273-0636ef57a980-kube-api-access-8jwqt\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:50:50.895732 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.895694    2571 generic.go:356] "Generic (PLEG): container finished" podID="549197fa-1acc-4368-b273-0636ef57a980" containerID="5b15239f55428df6b2a0082981c7c0ddb4c294f27fc432435ac7debbe7b00ca2" exitCode=0
Jul 22 03:50:50.895930 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.895735    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"
Jul 22 03:50:50.895930 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.895738    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z" event={"ID":"549197fa-1acc-4368-b273-0636ef57a980","Type":"ContainerDied","Data":"5b15239f55428df6b2a0082981c7c0ddb4c294f27fc432435ac7debbe7b00ca2"}
Jul 22 03:50:50.895930 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.895860    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z" event={"ID":"549197fa-1acc-4368-b273-0636ef57a980","Type":"ContainerDied","Data":"d8d17f53a66c4f5842ea638dfde3cd316c2c8973956f2ca4ce235baccb989551"}
Jul 22 03:50:50.895930 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.895882    2571 scope.go:117] "RemoveContainer" containerID="5b15239f55428df6b2a0082981c7c0ddb4c294f27fc432435ac7debbe7b00ca2"
Jul 22 03:50:50.905142 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.905126    2571 scope.go:117] "RemoveContainer" containerID="5b15239f55428df6b2a0082981c7c0ddb4c294f27fc432435ac7debbe7b00ca2"
Jul 22 03:50:50.905394 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:50:50.905377    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b15239f55428df6b2a0082981c7c0ddb4c294f27fc432435ac7debbe7b00ca2\": container with ID starting with 5b15239f55428df6b2a0082981c7c0ddb4c294f27fc432435ac7debbe7b00ca2 not found: ID does not exist" containerID="5b15239f55428df6b2a0082981c7c0ddb4c294f27fc432435ac7debbe7b00ca2"
Jul 22 03:50:50.905460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.905400    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b15239f55428df6b2a0082981c7c0ddb4c294f27fc432435ac7debbe7b00ca2"} err="failed to get container status \"5b15239f55428df6b2a0082981c7c0ddb4c294f27fc432435ac7debbe7b00ca2\": rpc error: code = NotFound desc = could not find container \"5b15239f55428df6b2a0082981c7c0ddb4c294f27fc432435ac7debbe7b00ca2\": container with ID starting with 5b15239f55428df6b2a0082981c7c0ddb4c294f27fc432435ac7debbe7b00ca2 not found: ID does not exist"
Jul 22 03:50:50.920535 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.920503    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"]
Jul 22 03:50:50.922291 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:50.922273    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c713ac/auth-test-model-c713ac-kserve-bcb69bf9-6gx4z"]
Jul 22 03:50:51.438850 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.438806    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz" podUID="0f5cfa54-15fb-4b4b-8bfb-52366ae755fb" containerName="main" containerID="cri-o://92597a3fc927f3e381a46207d501c47ca7ebda03c7cba171b549bcf246f1f647" gracePeriod=45
Jul 22 03:50:51.692348 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.692291    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:50:51.718054 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.718030    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-tls-certs\") pod \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") "
Jul 22 03:50:51.718193 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.718100    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-dshm\") pod \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") "
Jul 22 03:50:51.718193 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.718131    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-home\") pod \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") "
Jul 22 03:50:51.718302 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.718227    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd9p2\" (UniqueName: \"kubernetes.io/projected/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-kube-api-access-sd9p2\") pod \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") "
Jul 22 03:50:51.718302 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.718252    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-model-cache\") pod \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") "
Jul 22 03:50:51.718411 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.718301    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-tmp-dir\") pod \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\" (UID: \"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb\") "
Jul 22 03:50:51.718466 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.718425    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-home" (OuterVolumeSpecName: "home") pod "0f5cfa54-15fb-4b4b-8bfb-52366ae755fb" (UID: "0f5cfa54-15fb-4b4b-8bfb-52366ae755fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:50:51.718533 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.718474    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-model-cache" (OuterVolumeSpecName: "model-cache") pod "0f5cfa54-15fb-4b4b-8bfb-52366ae755fb" (UID: "0f5cfa54-15fb-4b4b-8bfb-52366ae755fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:50:51.718628 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.718579    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-home\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:50:51.718707 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.718628    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-model-cache\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:50:51.718707 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.718658    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0f5cfa54-15fb-4b4b-8bfb-52366ae755fb" (UID: "0f5cfa54-15fb-4b4b-8bfb-52366ae755fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:50:51.720570 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.720545    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0f5cfa54-15fb-4b4b-8bfb-52366ae755fb" (UID: "0f5cfa54-15fb-4b4b-8bfb-52366ae755fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:50:51.720570 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.720562    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-kube-api-access-sd9p2" (OuterVolumeSpecName: "kube-api-access-sd9p2") pod "0f5cfa54-15fb-4b4b-8bfb-52366ae755fb" (UID: "0f5cfa54-15fb-4b4b-8bfb-52366ae755fb"). InnerVolumeSpecName "kube-api-access-sd9p2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:50:51.720708 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.720579    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-dshm" (OuterVolumeSpecName: "dshm") pod "0f5cfa54-15fb-4b4b-8bfb-52366ae755fb" (UID: "0f5cfa54-15fb-4b4b-8bfb-52366ae755fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:50:51.819503 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.819452    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-tmp-dir\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:50:51.819503 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.819495    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-tls-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:50:51.819503 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.819504    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-dshm\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:50:51.819503 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.819513    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd9p2\" (UniqueName: \"kubernetes.io/projected/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb-kube-api-access-sd9p2\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:50:51.903132 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.903095    2571 generic.go:356] "Generic (PLEG): container finished" podID="0f5cfa54-15fb-4b4b-8bfb-52366ae755fb" containerID="92597a3fc927f3e381a46207d501c47ca7ebda03c7cba171b549bcf246f1f647" exitCode=0
Jul 22 03:50:51.903339 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.903151    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"
Jul 22 03:50:51.903339 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.903185    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz" event={"ID":"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb","Type":"ContainerDied","Data":"92597a3fc927f3e381a46207d501c47ca7ebda03c7cba171b549bcf246f1f647"}
Jul 22 03:50:51.903339 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.903223    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz" event={"ID":"0f5cfa54-15fb-4b4b-8bfb-52366ae755fb","Type":"ContainerDied","Data":"7dbb458f2f77fc3002b8621dbc3f10d4472972f6074200e8f58bd70b68c8a907"}
Jul 22 03:50:51.903339 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.903249    2571 scope.go:117] "RemoveContainer" containerID="92597a3fc927f3e381a46207d501c47ca7ebda03c7cba171b549bcf246f1f647"
Jul 22 03:50:51.914676 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.914659    2571 scope.go:117] "RemoveContainer" containerID="92597a3fc927f3e381a46207d501c47ca7ebda03c7cba171b549bcf246f1f647"
Jul 22 03:50:51.915076 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:50:51.915053    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92597a3fc927f3e381a46207d501c47ca7ebda03c7cba171b549bcf246f1f647\": container with ID starting with 92597a3fc927f3e381a46207d501c47ca7ebda03c7cba171b549bcf246f1f647 not found: ID does not exist" containerID="92597a3fc927f3e381a46207d501c47ca7ebda03c7cba171b549bcf246f1f647"
Jul 22 03:50:51.915171 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.915084    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92597a3fc927f3e381a46207d501c47ca7ebda03c7cba171b549bcf246f1f647"} err="failed to get container status \"92597a3fc927f3e381a46207d501c47ca7ebda03c7cba171b549bcf246f1f647\": rpc error: code = NotFound desc = could not find container \"92597a3fc927f3e381a46207d501c47ca7ebda03c7cba171b549bcf246f1f647\": container with ID starting with 92597a3fc927f3e381a46207d501c47ca7ebda03c7cba171b549bcf246f1f647 not found: ID does not exist"
Jul 22 03:50:51.927041 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.927018    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"]
Jul 22 03:50:51.931103 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:51.931083    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/auth-test-model-be39c1-kserve-5dc8b479dc-94mtz"]
Jul 22 03:50:52.105663 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:52.105630    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f5cfa54-15fb-4b4b-8bfb-52366ae755fb" path="/var/lib/kubelet/pods/0f5cfa54-15fb-4b4b-8bfb-52366ae755fb/volumes"
Jul 22 03:50:52.106070 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:50:52.106056    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="549197fa-1acc-4368-b273-0636ef57a980" path="/var/lib/kubelet/pods/549197fa-1acc-4368-b273-0636ef57a980/volumes"
Jul 22 03:51:10.443157 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.443118    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"]
Jul 22 03:51:10.443647 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.443503    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f5cfa54-15fb-4b4b-8bfb-52366ae755fb" containerName="main"
Jul 22 03:51:10.443647 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.443514    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f5cfa54-15fb-4b4b-8bfb-52366ae755fb" containerName="main"
Jul 22 03:51:10.443647 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.443523    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="549197fa-1acc-4368-b273-0636ef57a980" containerName="main"
Jul 22 03:51:10.443647 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.443529    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="549197fa-1acc-4368-b273-0636ef57a980" containerName="main"
Jul 22 03:51:10.443647 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.443582    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f5cfa54-15fb-4b4b-8bfb-52366ae755fb" containerName="main"
Jul 22 03:51:10.443647 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.443593    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="549197fa-1acc-4368-b273-0636ef57a980" containerName="main"
Jul 22 03:51:10.446654 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.446636    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.451453 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.451425    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c713ac\"/\"openshift-service-ca.crt\""
Jul 22 03:51:10.451594 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.451550    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c713ac\"/\"kube-root-ca.crt\""
Jul 22 03:51:10.452811 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.452791    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c713ac\"/\"sub-test-model-c713ac-kserve-self-signed-certs\""
Jul 22 03:51:10.452940 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.452851    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c713ac\"/\"default-dockercfg-7v8hk\""
Jul 22 03:51:10.461935 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.461912    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"]
Jul 22 03:51:10.594315 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.594281    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-model-cache\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.594477 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.594325    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-home\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.594477 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.594345    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmcb9\" (UniqueName: \"kubernetes.io/projected/33b59e89-0c81-49d6-b439-da48a6de2487-kube-api-access-gmcb9\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.594477 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.594417    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-dshm\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.594477 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.594432    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-tmp-dir\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.594477 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.594447    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33b59e89-0c81-49d6-b439-da48a6de2487-tls-certs\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.695860 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.695756    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-home\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.695860 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.695814    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmcb9\" (UniqueName: \"kubernetes.io/projected/33b59e89-0c81-49d6-b439-da48a6de2487-kube-api-access-gmcb9\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.696061 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.695877    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-dshm\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.696061 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.695894    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-tmp-dir\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.696061 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.696030    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33b59e89-0c81-49d6-b439-da48a6de2487-tls-certs\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.696213 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.696147    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-model-cache\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.696213 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.696199    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-home\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.696314 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.696254    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-tmp-dir\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.696420 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.696401    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-model-cache\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.698252 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.698230    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-dshm\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.698488 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.698469    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33b59e89-0c81-49d6-b439-da48a6de2487-tls-certs\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.704676 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.704654    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmcb9\" (UniqueName: \"kubernetes.io/projected/33b59e89-0c81-49d6-b439-da48a6de2487-kube-api-access-gmcb9\") pod \"sub-test-model-c713ac-kserve-9d85d9659-vx2q9\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") " pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.756345 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.756313    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:10.893128 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.893097    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"]
Jul 22 03:51:10.896476 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:51:10.896447    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33b59e89_0c81_49d6_b439_da48a6de2487.slice/crio-e08912a95a4bb776278fad5870922e411b33f69b7261f960961542ebd221d95d WatchSource:0}: Error finding container e08912a95a4bb776278fad5870922e411b33f69b7261f960961542ebd221d95d: Status 404 returned error can't find the container with id e08912a95a4bb776278fad5870922e411b33f69b7261f960961542ebd221d95d
Jul 22 03:51:10.999023 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.998987    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9" event={"ID":"33b59e89-0c81-49d6-b439-da48a6de2487","Type":"ContainerStarted","Data":"9601c193d77f438417d7d2d6b5cfcf90c377e66c5437bd2c99e5b5b5b060da75"}
Jul 22 03:51:10.999023 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:10.999032    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9" event={"ID":"33b59e89-0c81-49d6-b439-da48a6de2487","Type":"ContainerStarted","Data":"e08912a95a4bb776278fad5870922e411b33f69b7261f960961542ebd221d95d"}
Jul 22 03:51:11.019109 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:11.018527    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9" podStartSLOduration=1.018502807 podStartE2EDuration="1.018502807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:51:11.016836044 +0000 UTC m=+2647.383471855" watchObservedRunningTime="2026-07-22 03:51:11.018502807 +0000 UTC m=+2647.385138643"
Jul 22 03:51:20.756570 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:20.756535    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:20.756996 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:20.756583    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:20.768834 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:20.768810    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:21.057273 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:21.057195    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:51:30.448375 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.448347    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"]
Jul 22 03:51:30.452035 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.452014    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.454719 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.454692    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-be39c1\"/\"kube-root-ca.crt\""
Jul 22 03:51:30.455752 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.455734    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-be39c1\"/\"default-dockercfg-9p4h2\""
Jul 22 03:51:30.455941 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.455920    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-be39c1\"/\"openshift-service-ca.crt\""
Jul 22 03:51:30.456005 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.455928    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-be39c1\"/\"sub-test-model-be39c1-kserve-self-signed-certs\""
Jul 22 03:51:30.464412 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.464390    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"]
Jul 22 03:51:30.563877 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.563845    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-dshm\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.564038 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.563890    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-tmp-dir\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.564038 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.563921    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttrsl\" (UniqueName: \"kubernetes.io/projected/c0c6c175-2e07-4c3b-9864-3d26b6e553df-kube-api-access-ttrsl\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.564038 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.563994    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0c6c175-2e07-4c3b-9864-3d26b6e553df-tls-certs\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.564165 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.564039    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-model-cache\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.564165 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.564062    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-home\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.665247 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.665211    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-home\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.665388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.665266    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-dshm\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.665388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.665303    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-tmp-dir\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.665388 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.665339    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttrsl\" (UniqueName: \"kubernetes.io/projected/c0c6c175-2e07-4c3b-9864-3d26b6e553df-kube-api-access-ttrsl\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.665534 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.665408    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0c6c175-2e07-4c3b-9864-3d26b6e553df-tls-certs\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.665534 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.665450    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-model-cache\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.665711 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.665690    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-home\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.665865 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.665734    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-tmp-dir\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.665865 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.665766    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-model-cache\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.667784 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.667748    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-dshm\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.668036 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.668017    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0c6c175-2e07-4c3b-9864-3d26b6e553df-tls-certs\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.675051 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.675030    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttrsl\" (UniqueName: \"kubernetes.io/projected/c0c6c175-2e07-4c3b-9864-3d26b6e553df-kube-api-access-ttrsl\") pod \"sub-test-model-be39c1-kserve-7777c4895c-8459n\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") " pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.762553 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.762457    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:30.899585 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:30.899562    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"]
Jul 22 03:51:31.095650 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:31.095616    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n" event={"ID":"c0c6c175-2e07-4c3b-9864-3d26b6e553df","Type":"ContainerStarted","Data":"c20001915974f297183cc3f7f04e8e1691f70d0435f7377bf98c003d38c8924c"}
Jul 22 03:51:31.095858 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:31.095662    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n" event={"ID":"c0c6c175-2e07-4c3b-9864-3d26b6e553df","Type":"ContainerStarted","Data":"02edbfd8bb001afc70ba3e3f93be19a6a471094918d0b5f6e75c23cda5f7a8e8"}
Jul 22 03:51:31.115218 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:31.115173    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n" podStartSLOduration=1.115155542 podStartE2EDuration="1.115155542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:51:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:51:31.114646624 +0000 UTC m=+2667.481282433" watchObservedRunningTime="2026-07-22 03:51:31.115155542 +0000 UTC m=+2667.481791326"
Jul 22 03:51:40.763526 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:40.763480    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:40.763997 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:40.763540    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:40.777503 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:40.777478    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:51:41.156007 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:51:41.155981    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:52:04.275038 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:04.274969    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:52:04.277032 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:04.277010    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:52:04.279460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:04.279441    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:52:04.281410 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:04.281392    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q7ns8_11a8a2c5-aadd-489a-be61-667345f173aa/ovn-acl-logging/0.log"
Jul 22 03:52:04.381436 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:04.381399    2571 scope.go:117] "RemoveContainer" containerID="2ef853f44f469b6e1db1a58ee47687a966c454b8f247e93f256c83511fa624ed"
Jul 22 03:52:07.295934 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:07.295903    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"]
Jul 22 03:52:08.221111 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:08.221081    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"]
Jul 22 03:52:22.316048 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.316005    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9" podUID="33b59e89-0c81-49d6-b439-da48a6de2487" containerName="main" containerID="cri-o://9601c193d77f438417d7d2d6b5cfcf90c377e66c5437bd2c99e5b5b5b060da75" gracePeriod=45
Jul 22 03:52:22.581214 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.581185    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:52:22.639113 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.639079    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmcb9\" (UniqueName: \"kubernetes.io/projected/33b59e89-0c81-49d6-b439-da48a6de2487-kube-api-access-gmcb9\") pod \"33b59e89-0c81-49d6-b439-da48a6de2487\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") "
Jul 22 03:52:22.639113 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.639117    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-tmp-dir\") pod \"33b59e89-0c81-49d6-b439-da48a6de2487\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") "
Jul 22 03:52:22.639332 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.639167    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-model-cache\") pod \"33b59e89-0c81-49d6-b439-da48a6de2487\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") "
Jul 22 03:52:22.639332 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.639253    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33b59e89-0c81-49d6-b439-da48a6de2487-tls-certs\") pod \"33b59e89-0c81-49d6-b439-da48a6de2487\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") "
Jul 22 03:52:22.639332 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.639302    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-dshm\") pod \"33b59e89-0c81-49d6-b439-da48a6de2487\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") "
Jul 22 03:52:22.639495 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.639353    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-home\") pod \"33b59e89-0c81-49d6-b439-da48a6de2487\" (UID: \"33b59e89-0c81-49d6-b439-da48a6de2487\") "
Jul 22 03:52:22.639495 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.639375    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-model-cache" (OuterVolumeSpecName: "model-cache") pod "33b59e89-0c81-49d6-b439-da48a6de2487" (UID: "33b59e89-0c81-49d6-b439-da48a6de2487"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:52:22.639495 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.639399    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "33b59e89-0c81-49d6-b439-da48a6de2487" (UID: "33b59e89-0c81-49d6-b439-da48a6de2487"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:52:22.639674 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.639655    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-home" (OuterVolumeSpecName: "home") pod "33b59e89-0c81-49d6-b439-da48a6de2487" (UID: "33b59e89-0c81-49d6-b439-da48a6de2487"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:52:22.639714 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.639669    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-tmp-dir\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:52:22.639714 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.639688    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-model-cache\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:52:22.641499 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.641476    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-dshm" (OuterVolumeSpecName: "dshm") pod "33b59e89-0c81-49d6-b439-da48a6de2487" (UID: "33b59e89-0c81-49d6-b439-da48a6de2487"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:52:22.641960 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.641940    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33b59e89-0c81-49d6-b439-da48a6de2487-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "33b59e89-0c81-49d6-b439-da48a6de2487" (UID: "33b59e89-0c81-49d6-b439-da48a6de2487"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:52:22.642021 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.641944    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33b59e89-0c81-49d6-b439-da48a6de2487-kube-api-access-gmcb9" (OuterVolumeSpecName: "kube-api-access-gmcb9") pod "33b59e89-0c81-49d6-b439-da48a6de2487" (UID: "33b59e89-0c81-49d6-b439-da48a6de2487"). InnerVolumeSpecName "kube-api-access-gmcb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:52:22.740466 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.740432    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmcb9\" (UniqueName: \"kubernetes.io/projected/33b59e89-0c81-49d6-b439-da48a6de2487-kube-api-access-gmcb9\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:52:22.740466 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.740459    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33b59e89-0c81-49d6-b439-da48a6de2487-tls-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:52:22.740466 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.740470    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-dshm\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:52:22.740466 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:22.740479    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33b59e89-0c81-49d6-b439-da48a6de2487-home\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:52:23.242028 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.241987    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n" podUID="c0c6c175-2e07-4c3b-9864-3d26b6e553df" containerName="main" containerID="cri-o://c20001915974f297183cc3f7f04e8e1691f70d0435f7377bf98c003d38c8924c" gracePeriod=45
Jul 22 03:52:23.362932 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.362901    2571 generic.go:356] "Generic (PLEG): container finished" podID="33b59e89-0c81-49d6-b439-da48a6de2487" containerID="9601c193d77f438417d7d2d6b5cfcf90c377e66c5437bd2c99e5b5b5b060da75" exitCode=0
Jul 22 03:52:23.363328 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.362977    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"
Jul 22 03:52:23.363328 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.362990    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9" event={"ID":"33b59e89-0c81-49d6-b439-da48a6de2487","Type":"ContainerDied","Data":"9601c193d77f438417d7d2d6b5cfcf90c377e66c5437bd2c99e5b5b5b060da75"}
Jul 22 03:52:23.363328 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.363042    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9" event={"ID":"33b59e89-0c81-49d6-b439-da48a6de2487","Type":"ContainerDied","Data":"e08912a95a4bb776278fad5870922e411b33f69b7261f960961542ebd221d95d"}
Jul 22 03:52:23.363328 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.363066    2571 scope.go:117] "RemoveContainer" containerID="9601c193d77f438417d7d2d6b5cfcf90c377e66c5437bd2c99e5b5b5b060da75"
Jul 22 03:52:23.365125 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.365104    2571 generic.go:356] "Generic (PLEG): container finished" podID="c0c6c175-2e07-4c3b-9864-3d26b6e553df" containerID="c20001915974f297183cc3f7f04e8e1691f70d0435f7377bf98c003d38c8924c" exitCode=0
Jul 22 03:52:23.365236 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.365161    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n" event={"ID":"c0c6c175-2e07-4c3b-9864-3d26b6e553df","Type":"ContainerDied","Data":"c20001915974f297183cc3f7f04e8e1691f70d0435f7377bf98c003d38c8924c"}
Jul 22 03:52:23.372747 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.372730    2571 scope.go:117] "RemoveContainer" containerID="9601c193d77f438417d7d2d6b5cfcf90c377e66c5437bd2c99e5b5b5b060da75"
Jul 22 03:52:23.373066 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:52:23.373047    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9601c193d77f438417d7d2d6b5cfcf90c377e66c5437bd2c99e5b5b5b060da75\": container with ID starting with 9601c193d77f438417d7d2d6b5cfcf90c377e66c5437bd2c99e5b5b5b060da75 not found: ID does not exist" containerID="9601c193d77f438417d7d2d6b5cfcf90c377e66c5437bd2c99e5b5b5b060da75"
Jul 22 03:52:23.373166 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.373076    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9601c193d77f438417d7d2d6b5cfcf90c377e66c5437bd2c99e5b5b5b060da75"} err="failed to get container status \"9601c193d77f438417d7d2d6b5cfcf90c377e66c5437bd2c99e5b5b5b060da75\": rpc error: code = NotFound desc = could not find container \"9601c193d77f438417d7d2d6b5cfcf90c377e66c5437bd2c99e5b5b5b060da75\": container with ID starting with 9601c193d77f438417d7d2d6b5cfcf90c377e66c5437bd2c99e5b5b5b060da75 not found: ID does not exist"
Jul 22 03:52:23.387514 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.387487    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"]
Jul 22 03:52:23.392093 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.392070    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c713ac/sub-test-model-c713ac-kserve-9d85d9659-vx2q9"]
Jul 22 03:52:23.496504 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.496452    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:52:23.547519 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.547489    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-home\") pod \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") "
Jul 22 03:52:23.547704 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.547539    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-tmp-dir\") pod \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") "
Jul 22 03:52:23.547704 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.547571    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttrsl\" (UniqueName: \"kubernetes.io/projected/c0c6c175-2e07-4c3b-9864-3d26b6e553df-kube-api-access-ttrsl\") pod \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") "
Jul 22 03:52:23.547704 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.547590    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0c6c175-2e07-4c3b-9864-3d26b6e553df-tls-certs\") pod \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") "
Jul 22 03:52:23.547704 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.547651    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-dshm\") pod \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") "
Jul 22 03:52:23.547704 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.547696    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-model-cache\") pod \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\" (UID: \"c0c6c175-2e07-4c3b-9864-3d26b6e553df\") "
Jul 22 03:52:23.547994 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.547759    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-home" (OuterVolumeSpecName: "home") pod "c0c6c175-2e07-4c3b-9864-3d26b6e553df" (UID: "c0c6c175-2e07-4c3b-9864-3d26b6e553df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:52:23.547994 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.547903    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c0c6c175-2e07-4c3b-9864-3d26b6e553df" (UID: "c0c6c175-2e07-4c3b-9864-3d26b6e553df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:52:23.548097 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.548014    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-model-cache" (OuterVolumeSpecName: "model-cache") pod "c0c6c175-2e07-4c3b-9864-3d26b6e553df" (UID: "c0c6c175-2e07-4c3b-9864-3d26b6e553df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:52:23.548097 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.548071    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-home\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:52:23.548097 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.548087    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-tmp-dir\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:52:23.549989 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.549963    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0c6c175-2e07-4c3b-9864-3d26b6e553df-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c0c6c175-2e07-4c3b-9864-3d26b6e553df" (UID: "c0c6c175-2e07-4c3b-9864-3d26b6e553df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:52:23.549989 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.549963    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-dshm" (OuterVolumeSpecName: "dshm") pod "c0c6c175-2e07-4c3b-9864-3d26b6e553df" (UID: "c0c6c175-2e07-4c3b-9864-3d26b6e553df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:52:23.549989 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.549984    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0c6c175-2e07-4c3b-9864-3d26b6e553df-kube-api-access-ttrsl" (OuterVolumeSpecName: "kube-api-access-ttrsl") pod "c0c6c175-2e07-4c3b-9864-3d26b6e553df" (UID: "c0c6c175-2e07-4c3b-9864-3d26b6e553df"). InnerVolumeSpecName "kube-api-access-ttrsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:52:23.648700 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.648667    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-dshm\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:52:23.648700 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.648694    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c0c6c175-2e07-4c3b-9864-3d26b6e553df-model-cache\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:52:23.648700 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.648704    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttrsl\" (UniqueName: \"kubernetes.io/projected/c0c6c175-2e07-4c3b-9864-3d26b6e553df-kube-api-access-ttrsl\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:52:23.648956 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:23.648714    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0c6c175-2e07-4c3b-9864-3d26b6e553df-tls-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:52:24.105330 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:24.105296    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33b59e89-0c81-49d6-b439-da48a6de2487" path="/var/lib/kubelet/pods/33b59e89-0c81-49d6-b439-da48a6de2487/volumes"
Jul 22 03:52:24.372406 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:24.372314    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n" event={"ID":"c0c6c175-2e07-4c3b-9864-3d26b6e553df","Type":"ContainerDied","Data":"02edbfd8bb001afc70ba3e3f93be19a6a471094918d0b5f6e75c23cda5f7a8e8"}
Jul 22 03:52:24.372406 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:24.372348    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"
Jul 22 03:52:24.372406 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:24.372370    2571 scope.go:117] "RemoveContainer" containerID="c20001915974f297183cc3f7f04e8e1691f70d0435f7377bf98c003d38c8924c"
Jul 22 03:52:24.389534 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:24.389508    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"]
Jul 22 03:52:24.394842 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:24.394819    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/sub-test-model-be39c1-kserve-7777c4895c-8459n"]
Jul 22 03:52:26.104878 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:26.104849    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0c6c175-2e07-4c3b-9864-3d26b6e553df" path="/var/lib/kubelet/pods/c0c6c175-2e07-4c3b-9864-3d26b6e553df/volumes"
Jul 22 03:52:29.531297 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.531269    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"]
Jul 22 03:52:29.531813 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.531647    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0c6c175-2e07-4c3b-9864-3d26b6e553df" containerName="main"
Jul 22 03:52:29.531813 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.531659    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0c6c175-2e07-4c3b-9864-3d26b6e553df" containerName="main"
Jul 22 03:52:29.531813 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.531678    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b59e89-0c81-49d6-b439-da48a6de2487" containerName="main"
Jul 22 03:52:29.531813 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.531682    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b59e89-0c81-49d6-b439-da48a6de2487" containerName="main"
Jul 22 03:52:29.531813 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.531750    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="33b59e89-0c81-49d6-b439-da48a6de2487" containerName="main"
Jul 22 03:52:29.531813 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.531759    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0c6c175-2e07-4c3b-9864-3d26b6e553df" containerName="main"
Jul 22 03:52:29.536146 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.536126    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.538991 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.538969    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-be39c1\"/\"openshift-service-ca.crt\""
Jul 22 03:52:29.540050 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.540021    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-be39c1\"/\"kube-root-ca.crt\""
Jul 22 03:52:29.540050 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.540040    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-be39c1\"/\"default-dockercfg-9p4h2\""
Jul 22 03:52:29.540249 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.540050    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-be39c1\"/\"rate-test-model-be39c1-kserve-self-signed-certs\""
Jul 22 03:52:29.550157 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.550124    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"]
Jul 22 03:52:29.606096 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.606066    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-tmp-dir\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.606247 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.606132    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64eaed53-4bdf-4f8a-9d80-9afc32048c11-tls-certs\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.606247 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.606188    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-dshm\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.606348 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.606255    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmc5q\" (UniqueName: \"kubernetes.io/projected/64eaed53-4bdf-4f8a-9d80-9afc32048c11-kube-api-access-nmc5q\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.606348 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.606286    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-model-cache\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.606348 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.606303    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-home\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.707668 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.707634    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-tmp-dir\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.707893 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.707688    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64eaed53-4bdf-4f8a-9d80-9afc32048c11-tls-certs\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.707893 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.707722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-dshm\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.707893 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.707747    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmc5q\" (UniqueName: \"kubernetes.io/projected/64eaed53-4bdf-4f8a-9d80-9afc32048c11-kube-api-access-nmc5q\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.707893 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.707765    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-model-cache\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.707893 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.707807    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-home\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.708165 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.708117    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-home\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.708165 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.708121    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-tmp-dir\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.708239 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.708220    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-model-cache\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.710137 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.710115    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-dshm\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.710387 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.710368    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64eaed53-4bdf-4f8a-9d80-9afc32048c11-tls-certs\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.717494 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.717471    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmc5q\" (UniqueName: \"kubernetes.io/projected/64eaed53-4bdf-4f8a-9d80-9afc32048c11-kube-api-access-nmc5q\") pod \"rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") " pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.846950 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.846922    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:29.986501 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:29.986465    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"]
Jul 22 03:52:29.989840 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:52:29.989806    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64eaed53_4bdf_4f8a_9d80_9afc32048c11.slice/crio-49a89425c9b9fd86cff1748bb2f5dd9aad43d9752814c88376a3c7370e6790d7 WatchSource:0}: Error finding container 49a89425c9b9fd86cff1748bb2f5dd9aad43d9752814c88376a3c7370e6790d7: Status 404 returned error can't find the container with id 49a89425c9b9fd86cff1748bb2f5dd9aad43d9752814c88376a3c7370e6790d7
Jul 22 03:52:30.403686 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:30.403638    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm" event={"ID":"64eaed53-4bdf-4f8a-9d80-9afc32048c11","Type":"ContainerStarted","Data":"119d432a4d5f234e9d813398e567e826334734cafddc8f0369020ca1fca7807f"}
Jul 22 03:52:30.403686 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:30.403692    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm" event={"ID":"64eaed53-4bdf-4f8a-9d80-9afc32048c11","Type":"ContainerStarted","Data":"49a89425c9b9fd86cff1748bb2f5dd9aad43d9752814c88376a3c7370e6790d7"}
Jul 22 03:52:30.420753 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:30.420705    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm" podStartSLOduration=1.420688393 podStartE2EDuration="1.420688393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:52:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:52:30.420317614 +0000 UTC m=+2726.786953432" watchObservedRunningTime="2026-07-22 03:52:30.420688393 +0000 UTC m=+2726.787324199"
Jul 22 03:52:39.847308 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:39.847275    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:39.847694 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:39.847488    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:39.860051 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:39.860020    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:52:40.464729 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:52:40.464694    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:53:04.400349 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:04.400317    2571 scope.go:117] "RemoveContainer" containerID="59588fc4d7800600553cc71b232af3f9cd7debbf244ca70d5573bae0a7824877"
Jul 22 03:53:25.215876 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:25.215756    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"]
Jul 22 03:53:26.149675 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:26.149644    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7600-140660586665136"]
Jul 22 03:53:26.153248 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:26.153233    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586665136"
Jul 22 03:53:26.155924 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:26.155907    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hx456\""
Jul 22 03:53:26.161698 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:26.161671    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-140660586665136"]
Jul 22 03:53:26.330104 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:26.330073    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2k2f\" (UniqueName: \"kubernetes.io/projected/65750a0e-4217-4ab0-909a-e3b88f6d15ac-kube-api-access-w2k2f\") pod \"test-curl-7600-140660586665136\" (UID: \"65750a0e-4217-4ab0-909a-e3b88f6d15ac\") " pod="opendatahub/test-curl-7600-140660586665136"
Jul 22 03:53:26.430810 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:26.430690    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2k2f\" (UniqueName: \"kubernetes.io/projected/65750a0e-4217-4ab0-909a-e3b88f6d15ac-kube-api-access-w2k2f\") pod \"test-curl-7600-140660586665136\" (UID: \"65750a0e-4217-4ab0-909a-e3b88f6d15ac\") " pod="opendatahub/test-curl-7600-140660586665136"
Jul 22 03:53:26.443600 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:26.443572    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2k2f\" (UniqueName: \"kubernetes.io/projected/65750a0e-4217-4ab0-909a-e3b88f6d15ac-kube-api-access-w2k2f\") pod \"test-curl-7600-140660586665136\" (UID: \"65750a0e-4217-4ab0-909a-e3b88f6d15ac\") " pod="opendatahub/test-curl-7600-140660586665136"
Jul 22 03:53:26.463630 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:26.463605    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586665136"
Jul 22 03:53:26.601008 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:26.600979    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-140660586665136"]
Jul 22 03:53:26.603873 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:53:26.603831    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65750a0e_4217_4ab0_909a_e3b88f6d15ac.slice/crio-2828e180111ff56f3ae56232365ad83c773288bc4cd921cb3507aa9a6e31939c WatchSource:0}: Error finding container 2828e180111ff56f3ae56232365ad83c773288bc4cd921cb3507aa9a6e31939c: Status 404 returned error can't find the container with id 2828e180111ff56f3ae56232365ad83c773288bc4cd921cb3507aa9a6e31939c
Jul 22 03:53:26.605150 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:26.605129    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:53:26.674728 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:26.674699    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-140660586665136" event={"ID":"65750a0e-4217-4ab0-909a-e3b88f6d15ac","Type":"ContainerStarted","Data":"2828e180111ff56f3ae56232365ad83c773288bc4cd921cb3507aa9a6e31939c"}
Jul 22 03:53:27.681283 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:27.681244    2571 generic.go:356] "Generic (PLEG): container finished" podID="65750a0e-4217-4ab0-909a-e3b88f6d15ac" containerID="f57bce46d88a81ccbe3cf51dec39282574dc4c2dbe58115f809c6eb52b779e47" exitCode=0
Jul 22 03:53:27.681735 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:27.681293    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-140660586665136" event={"ID":"65750a0e-4217-4ab0-909a-e3b88f6d15ac","Type":"ContainerDied","Data":"f57bce46d88a81ccbe3cf51dec39282574dc4c2dbe58115f809c6eb52b779e47"}
Jul 22 03:53:28.819572 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:28.819549    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586665136"
Jul 22 03:53:28.855657 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:28.855621    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7600-140660586665136_65750a0e-4217-4ab0-909a-e3b88f6d15ac/test-curl-7600-140660586665136/0.log"
Jul 22 03:53:28.876535 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:28.876491    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7600-140660586665136"]
Jul 22 03:53:28.880451 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:28.880430    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7600-140660586665136"]
Jul 22 03:53:28.956409 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:28.956319    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2k2f\" (UniqueName: \"kubernetes.io/projected/65750a0e-4217-4ab0-909a-e3b88f6d15ac-kube-api-access-w2k2f\") pod \"65750a0e-4217-4ab0-909a-e3b88f6d15ac\" (UID: \"65750a0e-4217-4ab0-909a-e3b88f6d15ac\") "
Jul 22 03:53:28.958615 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:28.958584    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65750a0e-4217-4ab0-909a-e3b88f6d15ac-kube-api-access-w2k2f" (OuterVolumeSpecName: "kube-api-access-w2k2f") pod "65750a0e-4217-4ab0-909a-e3b88f6d15ac" (UID: "65750a0e-4217-4ab0-909a-e3b88f6d15ac"). InnerVolumeSpecName "kube-api-access-w2k2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:53:28.994220 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:28.994189    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7600-140660586664368"]
Jul 22 03:53:28.994627 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:28.994610    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65750a0e-4217-4ab0-909a-e3b88f6d15ac" containerName="test-curl-7600-140660586665136"
Jul 22 03:53:28.994719 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:28.994630    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="65750a0e-4217-4ab0-909a-e3b88f6d15ac" containerName="test-curl-7600-140660586665136"
Jul 22 03:53:28.994813 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:28.994727    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="65750a0e-4217-4ab0-909a-e3b88f6d15ac" containerName="test-curl-7600-140660586665136"
Jul 22 03:53:28.997879 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:28.997857    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586664368"
Jul 22 03:53:29.003841 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:29.003819    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-140660586664368"]
Jul 22 03:53:29.057961 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:29.057931    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2k2f\" (UniqueName: \"kubernetes.io/projected/65750a0e-4217-4ab0-909a-e3b88f6d15ac-kube-api-access-w2k2f\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:53:29.158829 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:29.158766    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69rsz\" (UniqueName: \"kubernetes.io/projected/657fcabf-ca8f-4962-b915-6bf70c091f85-kube-api-access-69rsz\") pod \"test-curl-7600-140660586664368\" (UID: \"657fcabf-ca8f-4962-b915-6bf70c091f85\") " pod="opendatahub/test-curl-7600-140660586664368"
Jul 22 03:53:29.259873 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:29.259749    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69rsz\" (UniqueName: \"kubernetes.io/projected/657fcabf-ca8f-4962-b915-6bf70c091f85-kube-api-access-69rsz\") pod \"test-curl-7600-140660586664368\" (UID: \"657fcabf-ca8f-4962-b915-6bf70c091f85\") " pod="opendatahub/test-curl-7600-140660586664368"
Jul 22 03:53:29.267926 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:29.267899    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69rsz\" (UniqueName: \"kubernetes.io/projected/657fcabf-ca8f-4962-b915-6bf70c091f85-kube-api-access-69rsz\") pod \"test-curl-7600-140660586664368\" (UID: \"657fcabf-ca8f-4962-b915-6bf70c091f85\") " pod="opendatahub/test-curl-7600-140660586664368"
Jul 22 03:53:29.308274 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:29.308246    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586664368"
Jul 22 03:53:29.441170 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:29.441142    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-140660586664368"]
Jul 22 03:53:29.442924 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:53:29.442896    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod657fcabf_ca8f_4962_b915_6bf70c091f85.slice/crio-dafec72edfdac93153a544a3351d2f2542156d4143b56b50cbc72a1d782e877a WatchSource:0}: Error finding container dafec72edfdac93153a544a3351d2f2542156d4143b56b50cbc72a1d782e877a: Status 404 returned error can't find the container with id dafec72edfdac93153a544a3351d2f2542156d4143b56b50cbc72a1d782e877a
Jul 22 03:53:29.691667 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:29.691630    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-140660586664368" event={"ID":"657fcabf-ca8f-4962-b915-6bf70c091f85","Type":"ContainerStarted","Data":"dafec72edfdac93153a544a3351d2f2542156d4143b56b50cbc72a1d782e877a"}
Jul 22 03:53:29.692926 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:29.692909    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2828e180111ff56f3ae56232365ad83c773288bc4cd921cb3507aa9a6e31939c"
Jul 22 03:53:29.693041 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:29.692943    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586665136"
Jul 22 03:53:29.703437 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:53:29.703410    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7600-140660586665136\" is forbidden: User \"system:node:ip-10-0-142-230.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-230.ec2.internal' and this object" podUID="65750a0e-4217-4ab0-909a-e3b88f6d15ac" pod="opendatahub/test-curl-7600-140660586665136"
Jul 22 03:53:30.104266 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:30.104230    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65750a0e-4217-4ab0-909a-e3b88f6d15ac" path="/var/lib/kubelet/pods/65750a0e-4217-4ab0-909a-e3b88f6d15ac/volumes"
Jul 22 03:53:30.701909 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:30.701880    2571 generic.go:356] "Generic (PLEG): container finished" podID="657fcabf-ca8f-4962-b915-6bf70c091f85" containerID="0f929ee708ea80844aa83948b5f08d26a95601fdf379fd7b7f31c68b28e20763" exitCode=0
Jul 22 03:53:30.702124 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:30.701977    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-140660586664368" event={"ID":"657fcabf-ca8f-4962-b915-6bf70c091f85","Type":"ContainerDied","Data":"0f929ee708ea80844aa83948b5f08d26a95601fdf379fd7b7f31c68b28e20763"}
Jul 22 03:53:31.845429 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:31.845403    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586664368"
Jul 22 03:53:31.866387 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:31.866337    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7600-140660586664368_657fcabf-ca8f-4962-b915-6bf70c091f85/test-curl-7600-140660586664368/0.log"
Jul 22 03:53:31.893401 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:31.893367    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7600-140660586664368"]
Jul 22 03:53:31.897569 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:31.897541    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7600-140660586664368"]
Jul 22 03:53:31.985288 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:31.985197    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69rsz\" (UniqueName: \"kubernetes.io/projected/657fcabf-ca8f-4962-b915-6bf70c091f85-kube-api-access-69rsz\") pod \"657fcabf-ca8f-4962-b915-6bf70c091f85\" (UID: \"657fcabf-ca8f-4962-b915-6bf70c091f85\") "
Jul 22 03:53:31.987438 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:31.987413    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/657fcabf-ca8f-4962-b915-6bf70c091f85-kube-api-access-69rsz" (OuterVolumeSpecName: "kube-api-access-69rsz") pod "657fcabf-ca8f-4962-b915-6bf70c091f85" (UID: "657fcabf-ca8f-4962-b915-6bf70c091f85"). InnerVolumeSpecName "kube-api-access-69rsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:53:32.049987 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.049956    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7600-140660586537152"]
Jul 22 03:53:32.050335 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.050323    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="657fcabf-ca8f-4962-b915-6bf70c091f85" containerName="test-curl-7600-140660586664368"
Jul 22 03:53:32.050379 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.050337    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="657fcabf-ca8f-4962-b915-6bf70c091f85" containerName="test-curl-7600-140660586664368"
Jul 22 03:53:32.050421 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.050412    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="657fcabf-ca8f-4962-b915-6bf70c091f85" containerName="test-curl-7600-140660586664368"
Jul 22 03:53:32.053298 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.053283    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:32.060730 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.060706    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-140660586537152"]
Jul 22 03:53:32.086535 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.086506    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69rsz\" (UniqueName: \"kubernetes.io/projected/657fcabf-ca8f-4962-b915-6bf70c091f85-kube-api-access-69rsz\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:53:32.104593 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.104558    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="657fcabf-ca8f-4962-b915-6bf70c091f85" path="/var/lib/kubelet/pods/657fcabf-ca8f-4962-b915-6bf70c091f85/volumes"
Jul 22 03:53:32.187248 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.187212    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkd9t\" (UniqueName: \"kubernetes.io/projected/8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca-kube-api-access-bkd9t\") pod \"test-curl-7600-140660586537152\" (UID: \"8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca\") " pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:32.288040 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.287957    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkd9t\" (UniqueName: \"kubernetes.io/projected/8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca-kube-api-access-bkd9t\") pod \"test-curl-7600-140660586537152\" (UID: \"8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca\") " pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:32.296911 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.296882    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkd9t\" (UniqueName: \"kubernetes.io/projected/8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca-kube-api-access-bkd9t\") pod \"test-curl-7600-140660586537152\" (UID: \"8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca\") " pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:32.363085 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.363051    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:32.509275 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.509249    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-140660586537152"]
Jul 22 03:53:32.510646 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:53:32.510619    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cd6d69c_48f0_4ed4_bcf8_b4ac0a0abdca.slice/crio-606bd1a20b5a7c918819cb342ff43f5f72d19fd63676eab63025fc114866e447 WatchSource:0}: Error finding container 606bd1a20b5a7c918819cb342ff43f5f72d19fd63676eab63025fc114866e447: Status 404 returned error can't find the container with id 606bd1a20b5a7c918819cb342ff43f5f72d19fd63676eab63025fc114866e447
Jul 22 03:53:32.714593 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.714555    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-140660586537152" event={"ID":"8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca","Type":"ContainerStarted","Data":"606bd1a20b5a7c918819cb342ff43f5f72d19fd63676eab63025fc114866e447"}
Jul 22 03:53:32.715809 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.715762    2571 scope.go:117] "RemoveContainer" containerID="0f929ee708ea80844aa83948b5f08d26a95601fdf379fd7b7f31c68b28e20763"
Jul 22 03:53:32.715951 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:32.715786    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586664368"
Jul 22 03:53:33.724070 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:33.724040    2571 generic.go:356] "Generic (PLEG): container finished" podID="8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca" containerID="5343f72dadad641b4b87ecd4e41c03179110c2b751c4c241dc6b592d3880c0d1" exitCode=0
Jul 22 03:53:33.724470 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:33.724079    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-140660586537152" event={"ID":"8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca","Type":"ContainerDied","Data":"5343f72dadad641b4b87ecd4e41c03179110c2b751c4c241dc6b592d3880c0d1"}
Jul 22 03:53:34.878481 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:34.878450    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:34.908710 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:34.908679    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7600-140660586537152_8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca/test-curl-7600-140660586537152/0.log"
Jul 22 03:53:34.945260 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:34.945226    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7600-140660586537152"]
Jul 22 03:53:34.951028 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:34.950997    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7600-140660586537152"]
Jul 22 03:53:35.014888 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.014800    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkd9t\" (UniqueName: \"kubernetes.io/projected/8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca-kube-api-access-bkd9t\") pod \"8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca\" (UID: \"8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca\") "
Jul 22 03:53:35.017034 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.017001    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca-kube-api-access-bkd9t" (OuterVolumeSpecName: "kube-api-access-bkd9t") pod "8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca" (UID: "8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca"). InnerVolumeSpecName "kube-api-access-bkd9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:53:35.071598 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.071564    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7600-140660586537152"]
Jul 22 03:53:35.071976 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.071961    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca" containerName="test-curl-7600-140660586537152"
Jul 22 03:53:35.072023 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.071977    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca" containerName="test-curl-7600-140660586537152"
Jul 22 03:53:35.072055 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.072044    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca" containerName="test-curl-7600-140660586537152"
Jul 22 03:53:35.074998 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.074983    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:35.083333 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.083304    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-140660586537152"]
Jul 22 03:53:35.115877 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.115841    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkd9t\" (UniqueName: \"kubernetes.io/projected/8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca-kube-api-access-bkd9t\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:53:35.216383 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.216349    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psbkq\" (UniqueName: \"kubernetes.io/projected/22eea7c0-d3b1-481f-9e35-3bea16295ec8-kube-api-access-psbkq\") pod \"test-curl-7600-140660586537152\" (UID: \"22eea7c0-d3b1-481f-9e35-3bea16295ec8\") " pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:35.317424 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.317332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psbkq\" (UniqueName: \"kubernetes.io/projected/22eea7c0-d3b1-481f-9e35-3bea16295ec8-kube-api-access-psbkq\") pod \"test-curl-7600-140660586537152\" (UID: \"22eea7c0-d3b1-481f-9e35-3bea16295ec8\") " pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:35.326102 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.326073    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psbkq\" (UniqueName: \"kubernetes.io/projected/22eea7c0-d3b1-481f-9e35-3bea16295ec8-kube-api-access-psbkq\") pod \"test-curl-7600-140660586537152\" (UID: \"22eea7c0-d3b1-481f-9e35-3bea16295ec8\") " pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:35.385112 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.385074    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:35.520281 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.520250    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-140660586537152"]
Jul 22 03:53:35.523519 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:53:35.523498    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22eea7c0_d3b1_481f_9e35_3bea16295ec8.slice/crio-15cea72b45ebb3aa0294139c3ad7fc897511045165a9723b969b32365c1a9edf WatchSource:0}: Error finding container 15cea72b45ebb3aa0294139c3ad7fc897511045165a9723b969b32365c1a9edf: Status 404 returned error can't find the container with id 15cea72b45ebb3aa0294139c3ad7fc897511045165a9723b969b32365c1a9edf
Jul 22 03:53:35.735370 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.735337    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-140660586537152" event={"ID":"22eea7c0-d3b1-481f-9e35-3bea16295ec8","Type":"ContainerStarted","Data":"15cea72b45ebb3aa0294139c3ad7fc897511045165a9723b969b32365c1a9edf"}
Jul 22 03:53:35.736691 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.736664    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:35.736831 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.736716    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="606bd1a20b5a7c918819cb342ff43f5f72d19fd63676eab63025fc114866e447"
Jul 22 03:53:35.749053 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:35.749016    2571 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7600-140660586537152" oldPodUID="8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca" podUID="22eea7c0-d3b1-481f-9e35-3bea16295ec8"
Jul 22 03:53:36.104638 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:36.104606    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca" path="/var/lib/kubelet/pods/8cd6d69c-48f0-4ed4-bcf8-b4ac0a0abdca/volumes"
Jul 22 03:53:36.742895 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:36.742861    2571 generic.go:356] "Generic (PLEG): container finished" podID="22eea7c0-d3b1-481f-9e35-3bea16295ec8" containerID="9a8793d061814d7cfa0a4c9ffef078aa0f9ca2f98c4f878266dd065d269850dd" exitCode=0
Jul 22 03:53:36.743069 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:36.742910    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-140660586537152" event={"ID":"22eea7c0-d3b1-481f-9e35-3bea16295ec8","Type":"ContainerDied","Data":"9a8793d061814d7cfa0a4c9ffef078aa0f9ca2f98c4f878266dd065d269850dd"}
Jul 22 03:53:37.885080 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:37.885049    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:37.906308 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:37.906282    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7600-140660586537152_22eea7c0-d3b1-481f-9e35-3bea16295ec8/test-curl-7600-140660586537152/0.log"
Jul 22 03:53:37.927737 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:37.927708    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7600-140660586537152"]
Jul 22 03:53:37.930909 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:37.930887    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7600-140660586537152"]
Jul 22 03:53:37.944340 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:37.944316    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psbkq\" (UniqueName: \"kubernetes.io/projected/22eea7c0-d3b1-481f-9e35-3bea16295ec8-kube-api-access-psbkq\") pod \"22eea7c0-d3b1-481f-9e35-3bea16295ec8\" (UID: \"22eea7c0-d3b1-481f-9e35-3bea16295ec8\") "
Jul 22 03:53:37.946409 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:37.946388    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22eea7c0-d3b1-481f-9e35-3bea16295ec8-kube-api-access-psbkq" (OuterVolumeSpecName: "kube-api-access-psbkq") pod "22eea7c0-d3b1-481f-9e35-3bea16295ec8" (UID: "22eea7c0-d3b1-481f-9e35-3bea16295ec8"). InnerVolumeSpecName "kube-api-access-psbkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:53:38.045456 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.045369    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psbkq\" (UniqueName: \"kubernetes.io/projected/22eea7c0-d3b1-481f-9e35-3bea16295ec8-kube-api-access-psbkq\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:53:38.047094 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.047074    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7600-140660586578976"]
Jul 22 03:53:38.047458 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.047445    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22eea7c0-d3b1-481f-9e35-3bea16295ec8" containerName="test-curl-7600-140660586537152"
Jul 22 03:53:38.047501 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.047460    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="22eea7c0-d3b1-481f-9e35-3bea16295ec8" containerName="test-curl-7600-140660586537152"
Jul 22 03:53:38.047538 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.047527    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="22eea7c0-d3b1-481f-9e35-3bea16295ec8" containerName="test-curl-7600-140660586537152"
Jul 22 03:53:38.050367 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.050352    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:38.058237 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.058215    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-140660586578976"]
Jul 22 03:53:38.104603 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.104573    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22eea7c0-d3b1-481f-9e35-3bea16295ec8" path="/var/lib/kubelet/pods/22eea7c0-d3b1-481f-9e35-3bea16295ec8/volumes"
Jul 22 03:53:38.145906 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.145878    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv6pr\" (UniqueName: \"kubernetes.io/projected/bcb9269f-5c0c-43a2-a34a-baf77be03426-kube-api-access-qv6pr\") pod \"test-curl-7600-140660586578976\" (UID: \"bcb9269f-5c0c-43a2-a34a-baf77be03426\") " pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:38.246402 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.246352    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv6pr\" (UniqueName: \"kubernetes.io/projected/bcb9269f-5c0c-43a2-a34a-baf77be03426-kube-api-access-qv6pr\") pod \"test-curl-7600-140660586578976\" (UID: \"bcb9269f-5c0c-43a2-a34a-baf77be03426\") " pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:38.256250 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.256225    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv6pr\" (UniqueName: \"kubernetes.io/projected/bcb9269f-5c0c-43a2-a34a-baf77be03426-kube-api-access-qv6pr\") pod \"test-curl-7600-140660586578976\" (UID: \"bcb9269f-5c0c-43a2-a34a-baf77be03426\") " pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:38.360311 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.360281    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:38.494976 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.494939    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-140660586578976"]
Jul 22 03:53:38.497949 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:53:38.497918    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcb9269f_5c0c_43a2_a34a_baf77be03426.slice/crio-741401f2e3af11d42708befd0e20c69a073f734add353f00c2b642d40fe95de4 WatchSource:0}: Error finding container 741401f2e3af11d42708befd0e20c69a073f734add353f00c2b642d40fe95de4: Status 404 returned error can't find the container with id 741401f2e3af11d42708befd0e20c69a073f734add353f00c2b642d40fe95de4
Jul 22 03:53:38.753633 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.753543    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586537152"
Jul 22 03:53:38.753633 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.753562    2571 scope.go:117] "RemoveContainer" containerID="9a8793d061814d7cfa0a4c9ffef078aa0f9ca2f98c4f878266dd065d269850dd"
Jul 22 03:53:38.754908 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:38.754815    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-140660586578976" event={"ID":"bcb9269f-5c0c-43a2-a34a-baf77be03426","Type":"ContainerStarted","Data":"741401f2e3af11d42708befd0e20c69a073f734add353f00c2b642d40fe95de4"}
Jul 22 03:53:39.761596 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:39.761565    2571 generic.go:356] "Generic (PLEG): container finished" podID="bcb9269f-5c0c-43a2-a34a-baf77be03426" containerID="b2a404d27cf08e48380f29d3ce58e4e87c9c397c894e8b0f897d894e829781c7" exitCode=0
Jul 22 03:53:39.762108 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:39.761657    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-140660586578976" event={"ID":"bcb9269f-5c0c-43a2-a34a-baf77be03426","Type":"ContainerDied","Data":"b2a404d27cf08e48380f29d3ce58e4e87c9c397c894e8b0f897d894e829781c7"}
Jul 22 03:53:40.236153 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.236119    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm" podUID="64eaed53-4bdf-4f8a-9d80-9afc32048c11" containerName="main" containerID="cri-o://119d432a4d5f234e9d813398e567e826334734cafddc8f0369020ca1fca7807f" gracePeriod=45
Jul 22 03:53:40.502506 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.502444    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:53:40.563037 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.563008    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-home\") pod \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") "
Jul 22 03:53:40.563221 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.563053    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-model-cache\") pod \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") "
Jul 22 03:53:40.563221 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.563101    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-tmp-dir\") pod \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") "
Jul 22 03:53:40.563221 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.563123    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64eaed53-4bdf-4f8a-9d80-9afc32048c11-tls-certs\") pod \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") "
Jul 22 03:53:40.563221 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.563150    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmc5q\" (UniqueName: \"kubernetes.io/projected/64eaed53-4bdf-4f8a-9d80-9afc32048c11-kube-api-access-nmc5q\") pod \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") "
Jul 22 03:53:40.563221 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.563193    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-dshm\") pod \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\" (UID: \"64eaed53-4bdf-4f8a-9d80-9afc32048c11\") "
Jul 22 03:53:40.563468 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.563326    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-home" (OuterVolumeSpecName: "home") pod "64eaed53-4bdf-4f8a-9d80-9afc32048c11" (UID: "64eaed53-4bdf-4f8a-9d80-9afc32048c11"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:53:40.563468 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.563387    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "64eaed53-4bdf-4f8a-9d80-9afc32048c11" (UID: "64eaed53-4bdf-4f8a-9d80-9afc32048c11"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:53:40.563468 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.563406    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-model-cache" (OuterVolumeSpecName: "model-cache") pod "64eaed53-4bdf-4f8a-9d80-9afc32048c11" (UID: "64eaed53-4bdf-4f8a-9d80-9afc32048c11"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:53:40.563598 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.563584    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-home\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:53:40.563663 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.563601    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-model-cache\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:53:40.563663 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.563612    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-tmp-dir\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:53:40.565446 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.565416    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-dshm" (OuterVolumeSpecName: "dshm") pod "64eaed53-4bdf-4f8a-9d80-9afc32048c11" (UID: "64eaed53-4bdf-4f8a-9d80-9afc32048c11"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:53:40.565546 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.565463    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64eaed53-4bdf-4f8a-9d80-9afc32048c11-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "64eaed53-4bdf-4f8a-9d80-9afc32048c11" (UID: "64eaed53-4bdf-4f8a-9d80-9afc32048c11"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:53:40.565546 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.565472    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64eaed53-4bdf-4f8a-9d80-9afc32048c11-kube-api-access-nmc5q" (OuterVolumeSpecName: "kube-api-access-nmc5q") pod "64eaed53-4bdf-4f8a-9d80-9afc32048c11" (UID: "64eaed53-4bdf-4f8a-9d80-9afc32048c11"). InnerVolumeSpecName "kube-api-access-nmc5q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:53:40.664472 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.664440    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64eaed53-4bdf-4f8a-9d80-9afc32048c11-tls-certs\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:53:40.664472 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.664467    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmc5q\" (UniqueName: \"kubernetes.io/projected/64eaed53-4bdf-4f8a-9d80-9afc32048c11-kube-api-access-nmc5q\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:53:40.664472 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.664477    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64eaed53-4bdf-4f8a-9d80-9afc32048c11-dshm\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:53:40.769051 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.768971    2571 generic.go:356] "Generic (PLEG): container finished" podID="64eaed53-4bdf-4f8a-9d80-9afc32048c11" containerID="119d432a4d5f234e9d813398e567e826334734cafddc8f0369020ca1fca7807f" exitCode=0
Jul 22 03:53:40.769051 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.769013    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"
Jul 22 03:53:40.769547 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.769061    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm" event={"ID":"64eaed53-4bdf-4f8a-9d80-9afc32048c11","Type":"ContainerDied","Data":"119d432a4d5f234e9d813398e567e826334734cafddc8f0369020ca1fca7807f"}
Jul 22 03:53:40.769547 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.769104    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm" event={"ID":"64eaed53-4bdf-4f8a-9d80-9afc32048c11","Type":"ContainerDied","Data":"49a89425c9b9fd86cff1748bb2f5dd9aad43d9752814c88376a3c7370e6790d7"}
Jul 22 03:53:40.769547 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.769128    2571 scope.go:117] "RemoveContainer" containerID="119d432a4d5f234e9d813398e567e826334734cafddc8f0369020ca1fca7807f"
Jul 22 03:53:40.779330 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.779307    2571 scope.go:117] "RemoveContainer" containerID="119d432a4d5f234e9d813398e567e826334734cafddc8f0369020ca1fca7807f"
Jul 22 03:53:40.779635 ip-10-0-142-230 kubenswrapper[2571]: E0722 03:53:40.779616    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"119d432a4d5f234e9d813398e567e826334734cafddc8f0369020ca1fca7807f\": container with ID starting with 119d432a4d5f234e9d813398e567e826334734cafddc8f0369020ca1fca7807f not found: ID does not exist" containerID="119d432a4d5f234e9d813398e567e826334734cafddc8f0369020ca1fca7807f"
Jul 22 03:53:40.779684 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.779647    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"119d432a4d5f234e9d813398e567e826334734cafddc8f0369020ca1fca7807f"} err="failed to get container status \"119d432a4d5f234e9d813398e567e826334734cafddc8f0369020ca1fca7807f\": rpc error: code = NotFound desc = could not find container \"119d432a4d5f234e9d813398e567e826334734cafddc8f0369020ca1fca7807f\": container with ID starting with 119d432a4d5f234e9d813398e567e826334734cafddc8f0369020ca1fca7807f not found: ID does not exist"
Jul 22 03:53:40.791138 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.791109    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"]
Jul 22 03:53:40.796760 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.796731    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm"]
Jul 22 03:53:40.894080 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.894055    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:40.913842 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.913808    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7600-140660586578976_bcb9269f-5c0c-43a2-a34a-baf77be03426/test-curl-7600-140660586578976/0.log"
Jul 22 03:53:40.937272 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.937242    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7600-140660586578976"]
Jul 22 03:53:40.941177 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.941156    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7600-140660586578976"]
Jul 22 03:53:40.966638 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.966616    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv6pr\" (UniqueName: \"kubernetes.io/projected/bcb9269f-5c0c-43a2-a34a-baf77be03426-kube-api-access-qv6pr\") pod \"bcb9269f-5c0c-43a2-a34a-baf77be03426\" (UID: \"bcb9269f-5c0c-43a2-a34a-baf77be03426\") "
Jul 22 03:53:40.968814 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:40.968786    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcb9269f-5c0c-43a2-a34a-baf77be03426-kube-api-access-qv6pr" (OuterVolumeSpecName: "kube-api-access-qv6pr") pod "bcb9269f-5c0c-43a2-a34a-baf77be03426" (UID: "bcb9269f-5c0c-43a2-a34a-baf77be03426"). InnerVolumeSpecName "kube-api-access-qv6pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:53:41.060457 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.060371    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7600-140660586578976"]
Jul 22 03:53:41.061467 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.061442    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64eaed53-4bdf-4f8a-9d80-9afc32048c11" containerName="main"
Jul 22 03:53:41.061596 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.061585    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="64eaed53-4bdf-4f8a-9d80-9afc32048c11" containerName="main"
Jul 22 03:53:41.061695 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.061684    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcb9269f-5c0c-43a2-a34a-baf77be03426" containerName="test-curl-7600-140660586578976"
Jul 22 03:53:41.061765 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.061757    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcb9269f-5c0c-43a2-a34a-baf77be03426" containerName="test-curl-7600-140660586578976"
Jul 22 03:53:41.062116 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.062098    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="64eaed53-4bdf-4f8a-9d80-9afc32048c11" containerName="main"
Jul 22 03:53:41.062211 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.062201    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcb9269f-5c0c-43a2-a34a-baf77be03426" containerName="test-curl-7600-140660586578976"
Jul 22 03:53:41.066312 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.066290    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:41.067193 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.067163    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w2jg\" (UniqueName: \"kubernetes.io/projected/97c48da1-26f7-42e4-9a44-17dac340d7e0-kube-api-access-9w2jg\") pod \"test-curl-7600-140660586578976\" (UID: \"97c48da1-26f7-42e4-9a44-17dac340d7e0\") " pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:41.067305 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.067291    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv6pr\" (UniqueName: \"kubernetes.io/projected/bcb9269f-5c0c-43a2-a34a-baf77be03426-kube-api-access-qv6pr\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:53:41.068703 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.068680    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-140660586578976"]
Jul 22 03:53:41.167835 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.167768    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w2jg\" (UniqueName: \"kubernetes.io/projected/97c48da1-26f7-42e4-9a44-17dac340d7e0-kube-api-access-9w2jg\") pod \"test-curl-7600-140660586578976\" (UID: \"97c48da1-26f7-42e4-9a44-17dac340d7e0\") " pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:41.176640 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.176617    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w2jg\" (UniqueName: \"kubernetes.io/projected/97c48da1-26f7-42e4-9a44-17dac340d7e0-kube-api-access-9w2jg\") pod \"test-curl-7600-140660586578976\" (UID: \"97c48da1-26f7-42e4-9a44-17dac340d7e0\") " pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:41.376366 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.376332    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:41.508971 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.508942    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7600-140660586578976"]
Jul 22 03:53:41.510975 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:53:41.510947    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97c48da1_26f7_42e4_9a44_17dac340d7e0.slice/crio-39a57621e148ae6c7c5fb1d4a2820971bbda59642337f43ac52b6e4fc20d207a WatchSource:0}: Error finding container 39a57621e148ae6c7c5fb1d4a2820971bbda59642337f43ac52b6e4fc20d207a: Status 404 returned error can't find the container with id 39a57621e148ae6c7c5fb1d4a2820971bbda59642337f43ac52b6e4fc20d207a
Jul 22 03:53:41.775694 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.775601    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-140660586578976" event={"ID":"97c48da1-26f7-42e4-9a44-17dac340d7e0","Type":"ContainerStarted","Data":"39a57621e148ae6c7c5fb1d4a2820971bbda59642337f43ac52b6e4fc20d207a"}
Jul 22 03:53:41.776832 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.776811    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="741401f2e3af11d42708befd0e20c69a073f734add353f00c2b642d40fe95de4"
Jul 22 03:53:41.776952 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.776876    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:41.791551 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:41.791525    2571 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7600-140660586578976" oldPodUID="bcb9269f-5c0c-43a2-a34a-baf77be03426" podUID="97c48da1-26f7-42e4-9a44-17dac340d7e0"
Jul 22 03:53:42.104655 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:42.104624    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64eaed53-4bdf-4f8a-9d80-9afc32048c11" path="/var/lib/kubelet/pods/64eaed53-4bdf-4f8a-9d80-9afc32048c11/volumes"
Jul 22 03:53:42.104979 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:42.104966    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcb9269f-5c0c-43a2-a34a-baf77be03426" path="/var/lib/kubelet/pods/bcb9269f-5c0c-43a2-a34a-baf77be03426/volumes"
Jul 22 03:53:42.783131 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:42.783096    2571 generic.go:356] "Generic (PLEG): container finished" podID="97c48da1-26f7-42e4-9a44-17dac340d7e0" containerID="6be76db9f1acd13ce0590a9535ff27fb424f0798cfc0e75a12a8c0eef95b848b" exitCode=0
Jul 22 03:53:42.783516 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:42.783182    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7600-140660586578976" event={"ID":"97c48da1-26f7-42e4-9a44-17dac340d7e0","Type":"ContainerDied","Data":"6be76db9f1acd13ce0590a9535ff27fb424f0798cfc0e75a12a8c0eef95b848b"}
Jul 22 03:53:43.924747 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:43.924719    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:43.949127 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:43.949101    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7600-140660586578976_97c48da1-26f7-42e4-9a44-17dac340d7e0/test-curl-7600-140660586578976/0.log"
Jul 22 03:53:43.975914 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:43.975890    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7600-140660586578976"]
Jul 22 03:53:43.984723 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:43.984701    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w2jg\" (UniqueName: \"kubernetes.io/projected/97c48da1-26f7-42e4-9a44-17dac340d7e0-kube-api-access-9w2jg\") pod \"97c48da1-26f7-42e4-9a44-17dac340d7e0\" (UID: \"97c48da1-26f7-42e4-9a44-17dac340d7e0\") "
Jul 22 03:53:43.986895 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:43.986872    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97c48da1-26f7-42e4-9a44-17dac340d7e0-kube-api-access-9w2jg" (OuterVolumeSpecName: "kube-api-access-9w2jg") pod "97c48da1-26f7-42e4-9a44-17dac340d7e0" (UID: "97c48da1-26f7-42e4-9a44-17dac340d7e0"). InnerVolumeSpecName "kube-api-access-9w2jg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:53:43.989740 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:43.989715    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7600-140660586578976"]
Jul 22 03:53:44.085303 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.085279    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w2jg\" (UniqueName: \"kubernetes.io/projected/97c48da1-26f7-42e4-9a44-17dac340d7e0-kube-api-access-9w2jg\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:53:44.105260 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.105233    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97c48da1-26f7-42e4-9a44-17dac340d7e0" path="/var/lib/kubelet/pods/97c48da1-26f7-42e4-9a44-17dac340d7e0/volumes"
Jul 22 03:53:44.199592 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.199559    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b"]
Jul 22 03:53:44.199983 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.199969    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c48da1-26f7-42e4-9a44-17dac340d7e0" containerName="test-curl-7600-140660586578976"
Jul 22 03:53:44.200034 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.199986    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c48da1-26f7-42e4-9a44-17dac340d7e0" containerName="test-curl-7600-140660586578976"
Jul 22 03:53:44.200077 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.200068    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c48da1-26f7-42e4-9a44-17dac340d7e0" containerName="test-curl-7600-140660586578976"
Jul 22 03:53:44.203198 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.203184    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b"
Jul 22 03:53:44.205888 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.205865    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:53:44.205991 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.205896    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:53:44.211332 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.211312    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b"]
Jul 22 03:53:44.286864 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.286832    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/640730b4-cbe2-46e1-a63d-7a66458c4515-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b\" (UID: \"640730b4-cbe2-46e1-a63d-7a66458c4515\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b"
Jul 22 03:53:44.388015 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.387938    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/640730b4-cbe2-46e1-a63d-7a66458c4515-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b\" (UID: \"640730b4-cbe2-46e1-a63d-7a66458c4515\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b"
Jul 22 03:53:44.388539 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.388521    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/640730b4-cbe2-46e1-a63d-7a66458c4515-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b\" (UID: \"640730b4-cbe2-46e1-a63d-7a66458c4515\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b"
Jul 22 03:53:44.515518 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.515488    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b"
Jul 22 03:53:44.794788 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.794689    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7600-140660586578976"
Jul 22 03:53:44.794788 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.794745    2571 scope.go:117] "RemoveContainer" containerID="6be76db9f1acd13ce0590a9535ff27fb424f0798cfc0e75a12a8c0eef95b848b"
Jul 22 03:53:44.859179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:44.859155    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b"]
Jul 22 03:53:44.860676 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:53:44.860653    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640730b4_cbe2_46e1_a63d_7a66458c4515.slice/crio-3c9fac92b92d3035ba035232f0cc5743f61ab2573506a0d48a7f4264bab61eda WatchSource:0}: Error finding container 3c9fac92b92d3035ba035232f0cc5743f61ab2573506a0d48a7f4264bab61eda: Status 404 returned error can't find the container with id 3c9fac92b92d3035ba035232f0cc5743f61ab2573506a0d48a7f4264bab61eda
Jul 22 03:53:45.454740 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:45.454637    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-be39c1/rate-test-model-be39c1-kserve-6b9ccbc59-8vfwm" podUID="64eaed53-4bdf-4f8a-9d80-9afc32048c11" containerName="main" probeResult="failure" output="Get \"https://10.132.0.52:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 22 03:53:45.801537 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:45.801441    2571 generic.go:356] "Generic (PLEG): container finished" podID="640730b4-cbe2-46e1-a63d-7a66458c4515" containerID="d8118a657c4cdcf32bea6b1e7f61a73213d7a099d89f19819a225e05d65e46dc" exitCode=0
Jul 22 03:53:45.801692 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:45.801539    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b" event={"ID":"640730b4-cbe2-46e1-a63d-7a66458c4515","Type":"ContainerDied","Data":"d8118a657c4cdcf32bea6b1e7f61a73213d7a099d89f19819a225e05d65e46dc"}
Jul 22 03:53:45.801692 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:45.801594    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b" event={"ID":"640730b4-cbe2-46e1-a63d-7a66458c4515","Type":"ContainerStarted","Data":"3c9fac92b92d3035ba035232f0cc5743f61ab2573506a0d48a7f4264bab61eda"}
Jul 22 03:53:46.943838 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:46.943816    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b"
Jul 22 03:53:47.015416 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:47.015385    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/640730b4-cbe2-46e1-a63d-7a66458c4515-maas-api-service-ca\") pod \"640730b4-cbe2-46e1-a63d-7a66458c4515\" (UID: \"640730b4-cbe2-46e1-a63d-7a66458c4515\") "
Jul 22 03:53:47.015722 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:47.015701    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/640730b4-cbe2-46e1-a63d-7a66458c4515-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "640730b4-cbe2-46e1-a63d-7a66458c4515" (UID: "640730b4-cbe2-46e1-a63d-7a66458c4515"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:53:47.116213 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:47.116186    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/640730b4-cbe2-46e1-a63d-7a66458c4515-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:53:47.814742 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:47.814705    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b" event={"ID":"640730b4-cbe2-46e1-a63d-7a66458c4515","Type":"ContainerDied","Data":"3c9fac92b92d3035ba035232f0cc5743f61ab2573506a0d48a7f4264bab61eda"}
Jul 22 03:53:47.814742 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:47.814740    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b"
Jul 22 03:53:47.814972 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:47.814761    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c9fac92b92d3035ba035232f0cc5743f61ab2573506a0d48a7f4264bab61eda"
Jul 22 03:53:59.277117 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:59.277079    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b"]
Jul 22 03:53:59.281295 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:53:59.281269    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-c713ac-qgs2b"]
Jul 22 03:54:00.104315 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:00.104275    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="640730b4-cbe2-46e1-a63d-7a66458c4515" path="/var/lib/kubelet/pods/640730b4-cbe2-46e1-a63d-7a66458c4515/volumes"
Jul 22 03:54:06.204504 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.204467    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc"]
Jul 22 03:54:06.204989 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.204855    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="640730b4-cbe2-46e1-a63d-7a66458c4515" containerName="revoke-keys"
Jul 22 03:54:06.204989 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.204866    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="640730b4-cbe2-46e1-a63d-7a66458c4515" containerName="revoke-keys"
Jul 22 03:54:06.204989 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.204928    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="640730b4-cbe2-46e1-a63d-7a66458c4515" containerName="revoke-keys"
Jul 22 03:54:06.209879 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.209856    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc"
Jul 22 03:54:06.212546 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.212520    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-xvl7w\""
Jul 22 03:54:06.212546 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.212535    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:54:06.216598 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.216569    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc"]
Jul 22 03:54:06.302931 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.302896    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd879a92-515a-419d-98e5-5f03a75419a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-be39c1-twczc\" (UID: \"fd879a92-515a-419d-98e5-5f03a75419a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc"
Jul 22 03:54:06.403514 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.403481    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd879a92-515a-419d-98e5-5f03a75419a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-be39c1-twczc\" (UID: \"fd879a92-515a-419d-98e5-5f03a75419a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc"
Jul 22 03:54:06.404167 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.404143    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd879a92-515a-419d-98e5-5f03a75419a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-be39c1-twczc\" (UID: \"fd879a92-515a-419d-98e5-5f03a75419a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc"
Jul 22 03:54:06.521657 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.521563    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc"
Jul 22 03:54:06.669147 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.669118    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc"]
Jul 22 03:54:06.673049 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:54:06.673023    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd879a92_515a_419d_98e5_5f03a75419a9.slice/crio-68ed0cd3eded28aeb57c3f20a889f5daf47f6bfed3dd32d5610196d987fb270d WatchSource:0}: Error finding container 68ed0cd3eded28aeb57c3f20a889f5daf47f6bfed3dd32d5610196d987fb270d: Status 404 returned error can't find the container with id 68ed0cd3eded28aeb57c3f20a889f5daf47f6bfed3dd32d5610196d987fb270d
Jul 22 03:54:06.924416 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:06.924388    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc" event={"ID":"fd879a92-515a-419d-98e5-5f03a75419a9","Type":"ContainerStarted","Data":"68ed0cd3eded28aeb57c3f20a889f5daf47f6bfed3dd32d5610196d987fb270d"}
Jul 22 03:54:07.931070 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:07.931036    2571 generic.go:356] "Generic (PLEG): container finished" podID="fd879a92-515a-419d-98e5-5f03a75419a9" containerID="be2d8289caf5db64a5c77f5c91033d1e4aa510816b59991c2bf2f7dcae9cf5f5" exitCode=0
Jul 22 03:54:07.931468 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:07.931104    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc" event={"ID":"fd879a92-515a-419d-98e5-5f03a75419a9","Type":"ContainerDied","Data":"be2d8289caf5db64a5c77f5c91033d1e4aa510816b59991c2bf2f7dcae9cf5f5"}
Jul 22 03:54:09.081881 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:09.081852    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc"
Jul 22 03:54:09.228014 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:09.227938    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd879a92-515a-419d-98e5-5f03a75419a9-maas-api-service-ca\") pod \"fd879a92-515a-419d-98e5-5f03a75419a9\" (UID: \"fd879a92-515a-419d-98e5-5f03a75419a9\") "
Jul 22 03:54:09.228267 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:09.228244    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd879a92-515a-419d-98e5-5f03a75419a9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fd879a92-515a-419d-98e5-5f03a75419a9" (UID: "fd879a92-515a-419d-98e5-5f03a75419a9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:54:09.329259 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:09.329225    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd879a92-515a-419d-98e5-5f03a75419a9-maas-api-service-ca\") on node \"ip-10-0-142-230.ec2.internal\" DevicePath \"\""
Jul 22 03:54:09.943039 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:09.943009    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc"
Jul 22 03:54:09.943226 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:09.943007    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc" event={"ID":"fd879a92-515a-419d-98e5-5f03a75419a9","Type":"ContainerDied","Data":"68ed0cd3eded28aeb57c3f20a889f5daf47f6bfed3dd32d5610196d987fb270d"}
Jul 22 03:54:09.943226 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:09.943155    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68ed0cd3eded28aeb57c3f20a889f5daf47f6bfed3dd32d5610196d987fb270d"
Jul 22 03:54:21.280382 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:21.280340    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc"]
Jul 22 03:54:21.283511 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:21.283482    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-be39c1-twczc"]
Jul 22 03:54:22.105001 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:22.104968    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd879a92-515a-419d-98e5-5f03a75419a9" path="/var/lib/kubelet/pods/fd879a92-515a-419d-98e5-5f03a75419a9/volumes"
Jul 22 03:54:28.705921 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:28.705880    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f845f886b-57xqp_01aac06b-2a15-4db1-be3d-925766847709/authorino/0.log"
Jul 22 03:54:34.239990 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:34.239962    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-h8xnw_2ed7d733-d08e-48f9-bd9e-0a1246525b69/server/0.log"
Jul 22 03:54:34.359614 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:34.359585    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-g7gbq_dfa09bc1-7028-4848-b7ee-d4a6caf43e44/manager/0.log"
Jul 22 03:54:34.599234 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:34.599207    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fb7f869bf-jr644_486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514/copy-manifests/0.log"
Jul 22 03:54:34.607195 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:34.607162    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fb7f869bf-jr644_486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514/manager/0.log"
Jul 22 03:54:36.680223 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:36.680190    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f845f886b-57xqp_01aac06b-2a15-4db1-be3d-925766847709/authorino/0.log"
Jul 22 03:54:37.023064 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:37.022979    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8qf2c_830a11f9-2890-44e4-a366-58619ae60c73/kuadrant-console-plugin/0.log"
Jul 22 03:54:38.145158 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:38.145124    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59676447d6-rhd9p_7bd5ed64-0553-479d-acce-98988406c7f5/kube-auth-proxy/0.log"
Jul 22 03:54:38.494991 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:38.494900    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-598zm_3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431/payload-processing/0.log"
Jul 22 03:54:38.623697 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:38.623665    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67f469f5c4-f25v7_eeed144b-f174-4605-b794-37eca9426475/router/0.log"
Jul 22 03:54:39.182650 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:39.182618    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2d2gf_e3249103-b215-41a1-a609-7cd389f62cbe/main/0.log"
Jul 22 03:54:39.511815 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:39.511712    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-z298n_c0fbcdb4-2185-4be0-9683-173dbbed12ab/main/0.log"
Jul 22 03:54:47.778004 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:47.777974    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-64nk5_ca554050-1a54-4d4a-86ac-fe03455e9bef/global-pull-secret-syncer/0.log"
Jul 22 03:54:47.964825 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:47.964790    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fzscs_a2003ad5-56cf-4f9d-ba75-6942465b7515/konnectivity-agent/0.log"
Jul 22 03:54:48.076095 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:48.076066    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-230.ec2.internal_5c889aaddab9faf6ffb9b70fddbe250d/haproxy/0.log"
Jul 22 03:54:53.271963 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:53.271925    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f845f886b-57xqp_01aac06b-2a15-4db1-be3d-925766847709/authorino/0.log"
Jul 22 03:54:53.360289 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:53.360263    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-8qf2c_830a11f9-2890-44e4-a366-58619ae60c73/kuadrant-console-plugin/0.log"
Jul 22 03:54:55.245067 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.245037    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4573da65-d60e-4639-81cf-476725196fcb/alertmanager/0.log"
Jul 22 03:54:55.270235 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.270129    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4573da65-d60e-4639-81cf-476725196fcb/config-reloader/0.log"
Jul 22 03:54:55.291468 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.291429    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4573da65-d60e-4639-81cf-476725196fcb/kube-rbac-proxy-web/0.log"
Jul 22 03:54:55.316662 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.316637    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4573da65-d60e-4639-81cf-476725196fcb/kube-rbac-proxy/0.log"
Jul 22 03:54:55.339010 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.338988    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4573da65-d60e-4639-81cf-476725196fcb/kube-rbac-proxy-metric/0.log"
Jul 22 03:54:55.367647 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.367623    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4573da65-d60e-4639-81cf-476725196fcb/prom-label-proxy/0.log"
Jul 22 03:54:55.390051 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.390030    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4573da65-d60e-4639-81cf-476725196fcb/init-config-reloader/0.log"
Jul 22 03:54:55.445070 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.445043    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-xstqz_2b78099e-aa06-419a-b007-3e026982ee8e/cluster-monitoring-operator/0.log"
Jul 22 03:54:55.553651 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.553567    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-86987f9f59-wxrcd_5043de74-e6dc-4076-8880-18310933e647/metrics-server/0.log"
Jul 22 03:54:55.699963 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.699931    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4pqtr_cef933de-f1fb-40bc-b9fe-34e45bcb0bb7/node-exporter/0.log"
Jul 22 03:54:55.723540 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.723512    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4pqtr_cef933de-f1fb-40bc-b9fe-34e45bcb0bb7/kube-rbac-proxy/0.log"
Jul 22 03:54:55.761759 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.761728    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4pqtr_cef933de-f1fb-40bc-b9fe-34e45bcb0bb7/init-textfile/0.log"
Jul 22 03:54:55.971309 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.971268    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-6ffjx_5d7d958b-af45-4329-8099-667f2963ae42/kube-rbac-proxy-main/0.log"
Jul 22 03:54:55.993813 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:55.993768    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-6ffjx_5d7d958b-af45-4329-8099-667f2963ae42/kube-rbac-proxy-self/0.log"
Jul 22 03:54:56.020278 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:56.020247    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-6ffjx_5d7d958b-af45-4329-8099-667f2963ae42/openshift-state-metrics/0.log"
Jul 22 03:54:56.315223 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:56.315131    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7586fffd47-n2vpc_7123f453-da4c-467c-be3e-f1245d11dbbf/telemeter-client/0.log"
Jul 22 03:54:56.355232 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:56.355202    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7586fffd47-n2vpc_7123f453-da4c-467c-be3e-f1245d11dbbf/reload/0.log"
Jul 22 03:54:56.386243 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:56.386210    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7586fffd47-n2vpc_7123f453-da4c-467c-be3e-f1245d11dbbf/kube-rbac-proxy/0.log"
Jul 22 03:54:57.484528 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.484498    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"]
Jul 22 03:54:57.484946 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.484883    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd879a92-515a-419d-98e5-5f03a75419a9" containerName="revoke-keys"
Jul 22 03:54:57.484946 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.484895    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd879a92-515a-419d-98e5-5f03a75419a9" containerName="revoke-keys"
Jul 22 03:54:57.485024 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.484961    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd879a92-515a-419d-98e5-5f03a75419a9" containerName="revoke-keys"
Jul 22 03:54:57.488154 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.488137    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.491017 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.490989    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8cvpq\"/\"openshift-service-ca.crt\""
Jul 22 03:54:57.491017 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.491009    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8cvpq\"/\"default-dockercfg-c29st\""
Jul 22 03:54:57.491869 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.491855    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8cvpq\"/\"kube-root-ca.crt\""
Jul 22 03:54:57.497568 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.497546    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"]
Jul 22 03:54:57.644204 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.644167    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3db1bc99-061b-4da6-845b-d979f0b2fc2a-proc\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.644385 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.644244    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3db1bc99-061b-4da6-845b-d979f0b2fc2a-podres\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.644385 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.644294    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3db1bc99-061b-4da6-845b-d979f0b2fc2a-sys\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.644385 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.644326    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zs22\" (UniqueName: \"kubernetes.io/projected/3db1bc99-061b-4da6-845b-d979f0b2fc2a-kube-api-access-4zs22\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.644385 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.644345    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3db1bc99-061b-4da6-845b-d979f0b2fc2a-lib-modules\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.745179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.745078    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3db1bc99-061b-4da6-845b-d979f0b2fc2a-proc\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.745179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.745153    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3db1bc99-061b-4da6-845b-d979f0b2fc2a-podres\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.745179 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.745174    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3db1bc99-061b-4da6-845b-d979f0b2fc2a-sys\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.745460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.745194    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zs22\" (UniqueName: \"kubernetes.io/projected/3db1bc99-061b-4da6-845b-d979f0b2fc2a-kube-api-access-4zs22\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.745460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.745212    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3db1bc99-061b-4da6-845b-d979f0b2fc2a-lib-modules\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.745460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.745209    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3db1bc99-061b-4da6-845b-d979f0b2fc2a-proc\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.745460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.745280    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3db1bc99-061b-4da6-845b-d979f0b2fc2a-sys\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.745460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.745350    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3db1bc99-061b-4da6-845b-d979f0b2fc2a-podres\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.745460 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.745350    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3db1bc99-061b-4da6-845b-d979f0b2fc2a-lib-modules\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.753551 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.753522    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zs22\" (UniqueName: \"kubernetes.io/projected/3db1bc99-061b-4da6-845b-d979f0b2fc2a-kube-api-access-4zs22\") pod \"perf-node-gather-daemonset-d7vqg\" (UID: \"3db1bc99-061b-4da6-845b-d979f0b2fc2a\") " pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.799330 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.799296    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:57.934386 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:57.934362    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"]
Jul 22 03:54:57.936618 ip-10-0-142-230 kubenswrapper[2571]: W0722 03:54:57.936591    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3db1bc99_061b_4da6_845b_d979f0b2fc2a.slice/crio-a1fec731552dab273deb6fd1f959244676900400b3baa54b42b6c6bff810f518 WatchSource:0}: Error finding container a1fec731552dab273deb6fd1f959244676900400b3baa54b42b6c6bff810f518: Status 404 returned error can't find the container with id a1fec731552dab273deb6fd1f959244676900400b3baa54b42b6c6bff810f518
Jul 22 03:54:58.187762 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:58.187726    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg" event={"ID":"3db1bc99-061b-4da6-845b-d979f0b2fc2a","Type":"ContainerStarted","Data":"0e7c2bd263f52d684dd7b8c4dba6f1d53b942fc5dc04b4bcdbddfaedad8e5c74"}
Jul 22 03:54:58.187966 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:58.187951    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:54:58.188017 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:58.187990    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg" event={"ID":"3db1bc99-061b-4da6-845b-d979f0b2fc2a","Type":"ContainerStarted","Data":"a1fec731552dab273deb6fd1f959244676900400b3baa54b42b6c6bff810f518"}
Jul 22 03:54:58.204860 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:58.204811    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg" podStartSLOduration=1.20479656 podStartE2EDuration="1.20479656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:54:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:54:58.202718295 +0000 UTC m=+2874.569354102" watchObservedRunningTime="2026-07-22 03:54:58.20479656 +0000 UTC m=+2874.571432360"
Jul 22 03:54:58.412658 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:58.412574    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/2.log"
Jul 22 03:54:58.420810 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:58.420760    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-9s5pk_fb53639c-5549-446f-9cef-c864401e6ffc/console-operator/3.log"
Jul 22 03:54:58.963868 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:58.963838    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-q4ldm_bd3635ba-2568-454c-9fae-7d7e3fc14013/download-server/0.log"
Jul 22 03:54:59.510519 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:54:59.510493    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-bqh8z_47df5352-da28-4ef7-8227-20b03259cb10/volume-data-source-validator/0.log"
Jul 22 03:55:00.606646 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:00.606609    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hd9wg_7f097a0c-dc21-428a-a935-83a59b8e74a5/dns/0.log"
Jul 22 03:55:00.627675 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:00.627638    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hd9wg_7f097a0c-dc21-428a-a935-83a59b8e74a5/kube-rbac-proxy/0.log"
Jul 22 03:55:00.676644 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:00.676605    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nkwt5_d09ef900-140e-47ef-91a0-5e325001248c/dns-node-resolver/0.log"
Jul 22 03:55:01.296561 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:01.296514    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nnsvz_1a6d5075-10f2-4d3b-9462-0d22b9c76bae/node-ca/0.log"
Jul 22 03:55:02.516504 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:02.516476    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59676447d6-rhd9p_7bd5ed64-0553-479d-acce-98988406c7f5/kube-auth-proxy/0.log"
Jul 22 03:55:02.679141 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:02.679108    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-598zm_3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431/payload-processing/0.log"
Jul 22 03:55:02.711562 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:02.711529    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67f469f5c4-f25v7_eeed144b-f174-4605-b794-37eca9426475/router/0.log"
Jul 22 03:55:03.444896 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:03.444859    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4nq2g_add3a796-07cf-480d-b349-30636ae15b19/serve-healthcheck-canary/0.log"
Jul 22 03:55:03.994261 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:03.994223    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-hwtzz_23911fb3-ab85-424c-bddc-377af8b7f57b/insights-operator/0.log"
Jul 22 03:55:03.995250 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:03.995228    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-hwtzz_23911fb3-ab85-424c-bddc-377af8b7f57b/insights-operator/1.log"
Jul 22 03:55:04.018923 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:04.018887    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7w8wg_1cca486d-9cf2-45cb-8556-24146b4f0805/kube-rbac-proxy/0.log"
Jul 22 03:55:04.044597 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:04.044572    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7w8wg_1cca486d-9cf2-45cb-8556-24146b4f0805/exporter/0.log"
Jul 22 03:55:04.086246 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:04.086214    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7w8wg_1cca486d-9cf2-45cb-8556-24146b4f0805/extractor/0.log"
Jul 22 03:55:04.204987 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:04.204959    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8cvpq/perf-node-gather-daemonset-d7vqg"
Jul 22 03:55:07.065837 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:07.065805    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-h8xnw_2ed7d733-d08e-48f9-bd9e-0a1246525b69/server/0.log"
Jul 22 03:55:07.180683 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:07.180649    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-g7gbq_dfa09bc1-7028-4848-b7ee-d4a6caf43e44/manager/0.log"
Jul 22 03:55:07.334859 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:07.334829    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fb7f869bf-jr644_486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514/manager/0.log"
Jul 22 03:55:07.358083 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:07.358038    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fb7f869bf-jr644_486a0fbe-f8c2-4fd3-9c6a-5e471cfc3514/copy-manifests/0.log"
Jul 22 03:55:07.971043 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:07.970959    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59676447d6-rhd9p_7bd5ed64-0553-479d-acce-98988406c7f5/kube-auth-proxy/0.log"
Jul 22 03:55:08.083654 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:08.083618    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-598zm_3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431/payload-processing/0.log"
Jul 22 03:55:08.098171 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:08.098145    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67f469f5c4-f25v7_eeed144b-f174-4605-b794-37eca9426475/router/0.log"
Jul 22 03:55:08.734323 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:08.734296    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8587dbf975-zww8t_b316f64f-e462-4d49-8080-6942526569b4/manager/0.log"
Jul 22 03:55:09.362756 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:09.362726    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59676447d6-rhd9p_7bd5ed64-0553-479d-acce-98988406c7f5/kube-auth-proxy/0.log"
Jul 22 03:55:09.479849 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:09.479816    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-598zm_3e6b6f11-3db0-48d7-b7e0-21ef8c6ba431/payload-processing/0.log"
Jul 22 03:55:09.494055 ip-10-0-142-230 kubenswrapper[2571]: I0722 03:55:09.494024    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67f469f5c4-f25v7_eeed144b-f174-4605-b794-37eca9426475/router/0.log"