Jul 24 13:38:24.515569 ip-10-0-139-47 systemd[1]: Starting Kubernetes Kubelet...
Jul 24 13:38:24.925708 ip-10-0-139-47 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 13:38:24.925708 ip-10-0-139-47 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 24 13:38:24.925708 ip-10-0-139-47 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 13:38:24.925708 ip-10-0-139-47 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 24 13:38:24.925708 ip-10-0-139-47 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 24 13:38:24.926696 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.926609    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 24 13:38:24.930326 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930303    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:38:24.930326 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930321    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:38:24.930326 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930326    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:38:24.930326 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930330    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:38:24.930326 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930334    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930340    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930344    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930348    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930352    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930356    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930360    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930363    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930367    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930370    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930374    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930378    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930382    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930386    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930390    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930401    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930406    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930409    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930414    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930417    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:38:24.930611 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930421    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930425    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930430    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930434    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930438    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930442    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930449    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930455    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930461    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930466    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930470    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930475    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930480    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930484    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930491    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930496    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930501    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930509    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930515    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:38:24.931467 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930520    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930524    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930529    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930533    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930537    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930542    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930546    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930550    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930555    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930559    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930563    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930567    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930572    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930576    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930581    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930586    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930590    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930594    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930598    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:38:24.932252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930603    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930607    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930611    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930615    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930621    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930626    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930630    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930634    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930639    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930645    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930650    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930654    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930658    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930662    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930666    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930670    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930674    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930679    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930684    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930688    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:38:24.933070 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930692    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930696    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930700    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930705    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930709    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930713    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930717    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930721    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930726    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930729    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930734    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930741    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930745    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930750    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930755    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930760    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.930764    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.931932    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.931942    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.931947    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:38:24.933895 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.931953    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.931957    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.931965    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.931972    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.931977    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.931982    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.931986    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.931991    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.931996    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932000    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932004    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932009    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932013    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932017    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932022    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932026    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932030    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932035    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932039    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932044    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:38:24.934594 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932048    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932053    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932057    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932062    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932066    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932070    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932077    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932083    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932087    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932091    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932095    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932100    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932105    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932109    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932113    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932118    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932122    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932127    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932130    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:38:24.935109 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932135    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932139    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932143    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932147    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932151    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932156    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932160    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932164    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932168    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932172    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932176    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932181    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932185    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932189    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932193    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932197    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932201    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932206    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932210    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:38:24.935581 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932214    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932218    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932222    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932226    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932230    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932235    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932240    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932244    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932248    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932252    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932256    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932260    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932264    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932268    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932272    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932276    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932280    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932284    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932289    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932294    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:38:24.936044 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932298    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932302    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932306    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932310    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932315    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932319    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932323    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932327    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932331    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932335    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932339    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932345    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932350    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932355    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932360    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932365    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932369    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932373    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932977    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:38:24.936536 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932985    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932990    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.932995    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933000    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933004    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933009    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933016    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933022    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933027    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933031    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933036    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933041    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933046    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933050    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933055    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933059    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933063    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933067    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933071    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933075    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:38:24.937017 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933079    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933083    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933087    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933091    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933095    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933099    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933103    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933108    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933113    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933117    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933122    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933127    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933131    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933136    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933140    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933144    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933149    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933154    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933158    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933162    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:38:24.937479 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933167    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933171    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933175    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933179    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933183    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933188    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933192    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933198    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933202    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933206    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933210    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933214    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933219    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933223    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933227    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933231    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933235    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933239    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933243    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933247    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:38:24.937970 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933254    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933258    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933263    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933267    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933272    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933276    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933280    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933285    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933289    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933294    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933298    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933302    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933307    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933311    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933317    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933321    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933325    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933329    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933333    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:38:24.938439 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933337    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933341    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933346    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933350    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933354    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933358    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933362    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933366    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933373    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933377    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933382    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933386    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933390    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933399    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933404    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933409    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933413    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933419    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.933425    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933532    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 24 13:38:24.938911 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933548    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933558    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933565    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933573    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933579    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933586    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933593    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933598    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933603    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933609    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933614    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933620    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933624    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933630    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933634    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933639    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933644    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933650    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933655    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933660    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933667    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933672    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933678    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 24 13:38:24.939375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933683    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933688    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933696    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933701    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933706    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933711    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933715    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933720    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933726    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933732    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933737    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933741    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933746    2559 flags.go:64] FLAG: --enable-server="true"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933752    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933759    2559 flags.go:64] FLAG: --event-burst="100"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933764    2559 flags.go:64] FLAG: --event-qps="50"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933768    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933774    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933779    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933785    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933790    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933795    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933800    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933805    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933810    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 24 13:38:24.939919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933815    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933819    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933824    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933829    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933836    2559 flags.go:64] FLAG: --feature-gates=""
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933842    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933848    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933869    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933874    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933881    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933886    2559 flags.go:64] FLAG: --help="false"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933891    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-139-47.ec2.internal"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933896    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933901    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933906    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933911    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933917    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933921    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933925    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933930    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933935    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933941    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933947    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933951    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 24 13:38:24.940525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933956    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933961    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933966    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933970    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933974    2559 flags.go:64] FLAG: --lock-file=""
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933979    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933984    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933989    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.933999    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934003    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934008    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934012    2559 flags.go:64] FLAG: --logging-format="text"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934021    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934027    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934031    2559 flags.go:64] FLAG: --manifest-url=""
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934036    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934043    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934049    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934056    2559 flags.go:64] FLAG: --max-pods="110"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934061    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934066    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934071    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934076    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934080    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934085    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 24 13:38:24.941131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934090    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934101    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934106    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934111    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934116    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934121    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934129    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934134    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934139    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934144    2559 flags.go:64] FLAG: --port="10250"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934149    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934153    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e10436eec292fbda"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934158    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934163    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934168    2559 flags.go:64] FLAG: --register-node="true"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934173    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934179    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934184    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934189    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934193    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934201    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934206    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934211    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934216    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934223    2559 flags.go:64] FLAG: --runonce="false"
Jul 24 13:38:24.941735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934228    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934233    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934238    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934243    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934247    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934252    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934257    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934263    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934268    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934272    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934277    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934282    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934287    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934293    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934298    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934330    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934351    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934356    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934363    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934367    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934370    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934373    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934377    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934380    2559 flags.go:64] FLAG: --v="2"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934386    2559 flags.go:64] FLAG: --version="false"
Jul 24 13:38:24.942351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934390    2559 flags.go:64] FLAG: --vmodule=""
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934394    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.934398    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934524    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934528    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934531    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934534    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934537    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934540    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934543    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934546    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934549    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934552    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934555    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934558    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934561    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934564    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934567    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934570    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934574    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:38:24.943162 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934579    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934583    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934587    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934591    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934594    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934598    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934601    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934604    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934606    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934609    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934612    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934615    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934617    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934620    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934622    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934625    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934628    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934631    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934633    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934636    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:38:24.944034 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934639    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934641    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934645    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934647    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934650    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934652    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934655    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934658    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934660    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934663    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934665    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934668    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934670    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934673    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934675    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934679    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934682    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934686    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934690    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:38:24.944565 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934693    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934696    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934699    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934701    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934704    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934707    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934709    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934712    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934715    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934717    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934720    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934722    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934724    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934727    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934730    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934732    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934735    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934737    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934740    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934742    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:38:24.945074 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934745    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934747    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934750    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934752    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934755    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934757    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934760    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934762    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934769    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934772    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934775    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934777    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934780    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934783    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934785    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934788    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934791    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934794    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934796    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934798    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:38:24.945569 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934801    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934804    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.934806    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.935517    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.942677    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.942759    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.943845    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.943877    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944133    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944145    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944149    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944152    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944155    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944158    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:38:24.946066 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944161    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944164    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944167    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944169    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944172    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944174    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944177    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944180    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944183    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944185    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944188    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944191    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944193    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944196    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944199    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944202    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944204    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944207    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944209    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944212    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:38:24.946422 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944214    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944217    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944221    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944225    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944228    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944236    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944239    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944242    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944245    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944248    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944251    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944253    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944256    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944259    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944261    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944264    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944267    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944270    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944272    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:38:24.946908 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944275    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944278    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944280    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944283    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944286    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944288    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944291    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944293    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944296    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944298    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944301    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944303    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944306    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944308    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944311    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944313    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944316    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944319    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944323    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944327    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:38:24.947403 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944330    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944333    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944336    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944339    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944342    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944345    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944347    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944350    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944353    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944355    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944358    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944368    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944372    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944377    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944381    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944385    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944389    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944398    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944402    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:38:24.948002 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944404    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944407    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944410    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944413    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944416    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944418    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944421    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944423    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944426    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944429    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944433    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944436    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944438    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944441    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944443    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:38:24.948468 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.944449    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944561    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944565    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944568    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944571    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944575    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944578    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944581    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944584    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944587    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944590    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944593    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944596    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944599    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944602    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944605    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944608    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944610    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944613    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 24 13:38:24.948964 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944617    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944622    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944625    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944628    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944631    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944633    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944636    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944639    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944641    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944644    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944646    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944649    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944652    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944654    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944656    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944659    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944662    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944665    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944667    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944669    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 24 13:38:24.949419 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944672    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944674    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944677    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944679    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944682    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944686    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944689    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944693    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944696    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944700    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944702    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944705    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944707    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944710    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944713    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944715    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944718    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944721    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944724    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 24 13:38:24.950001 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944735    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944738    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944741    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944743    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944746    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944749    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944752    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944755    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944757    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944760    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944762    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944765    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944768    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944771    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944774    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944776    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944779    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944782    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944785    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944787    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 24 13:38:24.950490 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944790    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944793    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944796    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944798    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944801    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944804    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944806    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944809    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944812    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944814    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944817    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944820    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944822    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944825    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944827    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944830    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944832    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944835    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944837    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944840    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 24 13:38:24.951195 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944843    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 24 13:38:24.951681 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:24.944846    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 24 13:38:24.951681 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.944851    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 24 13:38:24.951681 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.945004    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 24 13:38:24.951681 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.947034    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 24 13:38:24.951681 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.948471    2559 server.go:1019] "Starting client certificate rotation"
Jul 24 13:38:24.951681 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.948585    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 13:38:24.951681 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.948632    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 24 13:38:24.951974 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.951826    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 13:38:24.953658 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.953639    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 24 13:38:24.965061 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.965042    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 24 13:38:24.967268 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.967254    2559 log.go:25] "Validated CRI v1 image API"
Jul 24 13:38:24.968084 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.968070    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 24 13:38:24.970783 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.970758    2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8207549e-6a9c-4687-9234-0e9102477976:/dev/nvme0n1p3 98276434-5647-4867-a2a1-0679f9a9ea18:/dev/nvme0n1p4]
Jul 24 13:38:24.970827 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.970783    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 24 13:38:24.976227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.976118    2559 manager.go:216] Machine: {Timestamp:2026-07-24 13:38:24.974703915 +0000 UTC m=+0.336077208 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097676 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec286d7983a6fe0bf58c12df72ad3461 SystemUUID:ec286d79-83a6-fe0b-f58c-12df72ad3461 BootID:a7dabfec-4349-491a-bf97-99651f4f017b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fa:a4:cf:33:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fa:a4:cf:33:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:f8:bb:98:a0:3c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 24 13:38:24.976227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.976219    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 24 13:38:24.976349 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.976334    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 24 13:38:24.977391 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.977364    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 24 13:38:24.977551 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.977392    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-47.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 24 13:38:24.978166 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.978156    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 24 13:38:24.978166 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.978168    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 24 13:38:24.978783 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.978773    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 13:38:24.979568 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.979551    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 13:38:24.980221 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.980209    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 24 13:38:24.981162 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.981153    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 24 13:38:24.983013 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.983001    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 13:38:24.983120 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.983111    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 24 13:38:24.983157 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.983140    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 24 13:38:24.983157 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.983150    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 24 13:38:24.983207 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.983159    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 24 13:38:24.983207 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.983168    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 24 13:38:24.983207 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.983181    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 24 13:38:24.984060 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.983729    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 13:38:24.984060 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.983766    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 24 13:38:24.987751 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.987727    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 24 13:38:24.990647 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.990625    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 24 13:38:24.990734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.990669    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 24 13:38:24.992414 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.992398    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 24 13:38:24.992489 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.992419    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 24 13:38:24.992489 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.992429    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 24 13:38:24.992489 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.992439    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 24 13:38:24.992489 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.992452    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 24 13:38:24.992489 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.992462    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 24 13:38:24.992489 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.992474    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 24 13:38:24.992489 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.992483    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 24 13:38:24.992733 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.992494    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 24 13:38:24.992733 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.992504    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 24 13:38:24.992733 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.992517    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 24 13:38:24.992733 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.992526    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 24 13:38:24.993329 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.993307    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 24 13:38:24.993329 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.993326    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 24 13:38:24.995746 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.995727    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-47.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 24 13:38:24.995806 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:24.995735    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 24 13:38:24.995841 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:24.995805    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 24 13:38:24.996721 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.996708    2559 server.go:1268] "Started kubelet"
Jul 24 13:38:24.996818 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.996772    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 24 13:38:24.996901 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.996807    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 24 13:38:24.996901 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.996889    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 24 13:38:24.997620 ip-10-0-139-47 systemd[1]: Started Kubernetes Kubelet.
Jul 24 13:38:24.998811 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.998708    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 24 13:38:24.999347 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:24.999334    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 24 13:38:25.001214 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.001194    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mvgpn"
Jul 24 13:38:25.003256 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.003229    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 24 13:38:25.004070 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.002910    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-47.ec2.internal.18c53d5eded0390c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-47.ec2.internal,UID:ip-10-0-139-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-47.ec2.internal,},FirstTimestamp:2026-07-24 13:38:24.9966779 +0000 UTC m=+0.358051197,LastTimestamp:2026-07-24 13:38:24.9966779 +0000 UTC m=+0.358051197,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-47.ec2.internal,}"
Jul 24 13:38:25.007543 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.007525    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 24 13:38:25.007543 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.007540    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 24 13:38:25.007655 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.007627    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:25.008268 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.008251    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 24 13:38:25.008268 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.008253    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 24 13:38:25.008423 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.008280    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 24 13:38:25.008423 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.008281    2559 factory.go:55] Registering systemd factory
Jul 24 13:38:25.008423 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.008312    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 24 13:38:25.008423 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.008417    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 24 13:38:25.008423 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.008426    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 24 13:38:25.008634 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.008565    2559 factory.go:153] Registering CRI-O factory
Jul 24 13:38:25.008634 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.008577    2559 factory.go:223] Registration of the crio container factory successfully
Jul 24 13:38:25.008634 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.008628    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 24 13:38:25.008823 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.008658    2559 factory.go:103] Registering Raw factory
Jul 24 13:38:25.008823 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.008680    2559 manager.go:1196] Started watching for new ooms in manager
Jul 24 13:38:25.010148 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.009097    2559 manager.go:349] Starting recovery of all containers
Jul 24 13:38:25.010148 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.010006    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mvgpn"
Jul 24 13:38:25.011706 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.011677    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 24 13:38:25.011825 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.011777    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 24 13:38:25.020603 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.020447    2559 manager.go:354] Recovery completed
Jul 24 13:38:25.025752 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.025737    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:38:25.027668 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.027649    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:38:25.027739 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.027682    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:38:25.027739 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.027696    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:38:25.028267 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.028254    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 24 13:38:25.028267 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.028266    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 24 13:38:25.028380 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.028287    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 24 13:38:25.028380 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.028269    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:38:25.029019 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.028999    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:38:25.029095 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.029034    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:38:25.029095 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.029050    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:38:25.030223 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.030210    2559 policy_none.go:49] "None policy: Start"
Jul 24 13:38:25.030260 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.030227    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 24 13:38:25.030260 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.030238    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 24 13:38:25.031943 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.031921    2559 policy_none.go:47] "Start"
Jul 24 13:38:25.070720 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.070584    2559 manager.go:337] "Starting Device Plugin manager"
Jul 24 13:38:25.070823 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.070744    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 24 13:38:25.070823 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.070758    2559 server.go:87] "Starting device plugin registration server"
Jul 24 13:38:25.070991 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.070978    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 24 13:38:25.071041 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.070991    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 24 13:38:25.071144 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.071121    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 24 13:38:25.071238 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.071223    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 24 13:38:25.071238 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.071237    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 24 13:38:25.071733 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.071708    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 24 13:38:25.071808 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.071765    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:25.173692 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.173666    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:38:25.175299 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.175282    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:38:25.175385 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.175314    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:38:25.175385 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.175324    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:38:25.175385 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.175359    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.186618 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.186572    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.186618 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.186594    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-47.ec2.internal\": node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:25.186974 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.186949    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 24 13:38:25.188175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.188158    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 24 13:38:25.188236 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.188198    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 24 13:38:25.188236 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.188222    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 24 13:38:25.188305 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.188257    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 24 13:38:25.191125 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.191108    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:38:25.223723 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.223692    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:25.289129 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.289080    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal"]
Jul 24 13:38:25.289270 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.289176    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:38:25.290211 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.290193    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:38:25.290319 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.290232    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:38:25.290319 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.290247    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:38:25.291623 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.291607    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:38:25.291737 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.291719    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.291792 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.291772    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:38:25.292438 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.292420    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:38:25.292523 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.292450    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:38:25.292523 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.292467    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:38:25.292523 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.292481    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:38:25.292523 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.292503    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:38:25.292523 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.292513    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:38:25.293832 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.293813    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.293919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.293841    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 24 13:38:25.294562 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.294542    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 24 13:38:25.294654 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.294572    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 24 13:38:25.294654 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.294583    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeHasSufficientPID"
Jul 24 13:38:25.310235 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.310209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/95c76765087f6aafd2072f10ac7a2292-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal\" (UID: \"95c76765087f6aafd2072f10ac7a2292\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.310235 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.310237    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95c76765087f6aafd2072f10ac7a2292-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal\" (UID: \"95c76765087f6aafd2072f10ac7a2292\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.310388 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.310254    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7597d384bc0b2108c01c0cc49001edde-config\") pod \"kube-apiserver-proxy-ip-10-0-139-47.ec2.internal\" (UID: \"7597d384bc0b2108c01c0cc49001edde\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.319912 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.319871    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-47.ec2.internal\" not found" node="ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.323573 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.323557    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-47.ec2.internal\" not found" node="ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.324555 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.324537    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:25.410520 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.410496    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/95c76765087f6aafd2072f10ac7a2292-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal\" (UID: \"95c76765087f6aafd2072f10ac7a2292\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.410652 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.410529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95c76765087f6aafd2072f10ac7a2292-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal\" (UID: \"95c76765087f6aafd2072f10ac7a2292\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.410652 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.410548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7597d384bc0b2108c01c0cc49001edde-config\") pod \"kube-apiserver-proxy-ip-10-0-139-47.ec2.internal\" (UID: \"7597d384bc0b2108c01c0cc49001edde\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.410652 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.410589    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7597d384bc0b2108c01c0cc49001edde-config\") pod \"kube-apiserver-proxy-ip-10-0-139-47.ec2.internal\" (UID: \"7597d384bc0b2108c01c0cc49001edde\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.410652 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.410609    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95c76765087f6aafd2072f10ac7a2292-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal\" (UID: \"95c76765087f6aafd2072f10ac7a2292\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.410652 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.410589    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/95c76765087f6aafd2072f10ac7a2292-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal\" (UID: \"95c76765087f6aafd2072f10ac7a2292\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.425010 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.424974    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:25.525128 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.525045    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:25.622710 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.622673    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.625179 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.625160    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:25.627367 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.626888    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:25.726045 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.726010    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:25.827021 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.826940    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:25.927892 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:25.927842    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:25.948540 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.948507    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 24 13:38:25.948685 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:25.948668    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 24 13:38:26.015763 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.015728    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 13:33:25 +0000 UTC" deadline="2028-01-16 14:39:38.279917118 +0000 UTC"
Jul 24 13:38:26.015763 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.015757    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12985h1m12.264163888s"
Jul 24 13:38:26.028588 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:26.028552    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:26.029785 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.029765    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:38:26.129008 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:26.128921    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:26.147925 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:26.147883    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c76765087f6aafd2072f10ac7a2292.slice/crio-10158281ab5a97298c2587132a1051e74bdfd76b9a49b153116eb11362962341 WatchSource:0}: Error finding container 10158281ab5a97298c2587132a1051e74bdfd76b9a49b153116eb11362962341: Status 404 returned error can't find the container with id 10158281ab5a97298c2587132a1051e74bdfd76b9a49b153116eb11362962341
Jul 24 13:38:26.148168 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:26.148143    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7597d384bc0b2108c01c0cc49001edde.slice/crio-1ae4ca283bd89540a73465ca4715d6a301158587160bdce60df2d45a9411c4f1 WatchSource:0}: Error finding container 1ae4ca283bd89540a73465ca4715d6a301158587160bdce60df2d45a9411c4f1: Status 404 returned error can't find the container with id 1ae4ca283bd89540a73465ca4715d6a301158587160bdce60df2d45a9411c4f1
Jul 24 13:38:26.154198 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.154177    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 13:38:26.191836 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.191778    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" event={"ID":"95c76765087f6aafd2072f10ac7a2292","Type":"ContainerStarted","Data":"10158281ab5a97298c2587132a1051e74bdfd76b9a49b153116eb11362962341"}
Jul 24 13:38:26.192981 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.192954    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal" event={"ID":"7597d384bc0b2108c01c0cc49001edde","Type":"ContainerStarted","Data":"1ae4ca283bd89540a73465ca4715d6a301158587160bdce60df2d45a9411c4f1"}
Jul 24 13:38:26.229291 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:26.229258    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:26.329690 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:26.329656    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:26.366322 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.366293    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:38:26.430475 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:26.430417    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:26.531641 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:26.531605    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-47.ec2.internal\" not found"
Jul 24 13:38:26.577483 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.577461    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:38:26.608436 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.608406    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:26.620074 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.620044    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 13:38:26.621168 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.621149    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal"
Jul 24 13:38:26.630587 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.630569    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 24 13:38:26.984686 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.984646    2559 apiserver.go:52] "Watching apiserver"
Jul 24 13:38:26.991484 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.991462    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 24 13:38:26.992618 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.992586    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6","openshift-cluster-node-tuning-operator/tuned-mmgdr","openshift-dns/node-resolver-dlfwk","openshift-image-registry/node-ca-fwzrj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal","openshift-multus/multus-additional-cni-plugins-2c8sd","openshift-multus/network-metrics-daemon-d5zgw","kube-system/konnectivity-agent-vlwcz","kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal","openshift-multus/multus-v26dd","openshift-network-diagnostics/network-check-target-hl7sr","openshift-network-operator/iptables-alerter-d7htw","openshift-ovn-kubernetes/ovnkube-node-dvrjm","kube-system/global-pull-secret-syncer-djnpp"]
Jul 24 13:38:26.994291 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.994271    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:26.994417 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:26.994361    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:26.995607 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.995585    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:26.995760 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:26.995726    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:26.996740 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.996717    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dlfwk"
Jul 24 13:38:26.997967 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.997945    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fwzrj"
Jul 24 13:38:26.999309 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.999283    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jpd7w\""
Jul 24 13:38:26.999408 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.999342    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 24 13:38:26.999554 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.999535    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 24 13:38:26.999724 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:26.999709    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:26.999796 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:26.999768    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:27.000859 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.000458    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 24 13:38:27.000859 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.000463    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 24 13:38:27.000859 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.000516    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 24 13:38:27.000859 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.000537    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9z29k\""
Jul 24 13:38:27.000859 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.000553    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.002052 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.001990    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vlwcz"
Jul 24 13:38:27.003350 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.003317    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 24 13:38:27.003654 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.003636    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 24 13:38:27.003855 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.003837    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2nk7k\""
Jul 24 13:38:27.004285 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.004267    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 24 13:38:27.004720 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.004699    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 24 13:38:27.004969 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.004949    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 24 13:38:27.005071 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.005054    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.005150 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.004958    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 24 13:38:27.005240 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.005221    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.005877 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.005301    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ngqml\""
Jul 24 13:38:27.005877 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.005797    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 24 13:38:27.007980 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.007906    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.007980 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.007922    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 24 13:38:27.010084 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.009580    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.011135 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.011113    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d7htw"
Jul 24 13:38:27.011748 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.011536    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 24 13:38:27.013007 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.012986    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 24 13:38:27.013318 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.013302    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 24 13:38:27.015417 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.015393    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:38:27.015513 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.015416    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 24 13:38:27.015513 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.015485    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7b7ts\""
Jul 24 13:38:27.015513 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.015496    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 24 13:38:27.015674 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.015638    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 24 13:38:27.017544 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.017125    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 24 13:38:27.017544 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.017149    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 24 13:38:27.017544 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.017161    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 24 13:38:27.017544 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.017292    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 24 13:38:27.018777 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.018159    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-578fx\""
Jul 24 13:38:27.018777 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.018472    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 24 13:38:27.018777 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.018482    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 24 13:38:27.019000 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.018984    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:38:27.019985 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.019131    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2gdlg\""
Jul 24 13:38:27.019985 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.019336    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ppwbc\""
Jul 24 13:38:27.019985 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.019726    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vqtwv\""
Jul 24 13:38:27.019985 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.019787    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4vnc\" (UniqueName: \"kubernetes.io/projected/14b5655b-a1c3-4bdd-849a-cefc61ab8147-kube-api-access-k4vnc\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.019985 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.019827    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-system-cni-dir\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.019985 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.019858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz68x\" (UniqueName: \"kubernetes.io/projected/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-kube-api-access-jz68x\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.019985 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.019909    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-slash\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.019985 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.019940    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-run-netns\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.019985 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.019966    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-sysctl-conf\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.020432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.019997    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b362245-96fb-41e0-a9ff-166250461bb7-etc-tuned\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.020432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020038    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcndh\" (UniqueName: \"kubernetes.io/projected/6fc9b45b-0545-43b7-8054-c134b3145ab3-kube-api-access-jcndh\") pod \"node-resolver-dlfwk\" (UID: \"6fc9b45b-0545-43b7-8054-c134b3145ab3\") " pod="openshift-dns/node-resolver-dlfwk"
Jul 24 13:38:27.020432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020075    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.020432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020139    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-multus-socket-dir-parent\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.020432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020151    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 24 13:38:27.020432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs\") pod \"network-metrics-daemon-d5zgw\" (UID: \"694de45f-b515-47c3-a8a7-5f0f1889c685\") " pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:27.020432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020207    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-kubelet-config\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:27.020432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-sys\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.020432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.020432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020319    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b3224c7-2679-4a70-a014-1db9085c4982-konnectivity-ca\") pod \"konnectivity-agent-vlwcz\" (UID: \"5b3224c7-2679-4a70-a014-1db9085c4982\") " pod="kube-system/konnectivity-agent-vlwcz"
Jul 24 13:38:27.020432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020350    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffda80ba-ef82-40c2-94d3-02488c43b1b4-cni-binary-copy\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.020432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020376    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-var-lib-cni-bin\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.020432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020413    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-var-lib-kubelet\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.021043 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020452    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwtkt\" (UniqueName: \"kubernetes.io/projected/694de45f-b515-47c3-a8a7-5f0f1889c685-kube-api-access-rwtkt\") pod \"network-metrics-daemon-d5zgw\" (UID: \"694de45f-b515-47c3-a8a7-5f0f1889c685\") " pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:27.021043 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020487    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-cni-bin\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.021043 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020515    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.021043 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-etc-kubernetes\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.021043 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020579    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-sys-fs\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.021043 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bc58137-000f-4dc7-8ced-06ec20f72052-host\") pod \"node-ca-fwzrj\" (UID: \"1bc58137-000f-4dc7-8ced-06ec20f72052\") " pod="openshift-image-registry/node-ca-fwzrj"
Jul 24 13:38:27.021043 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-etc-openvswitch\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.021043 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-cni-netd\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.021043 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020749    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-run-k8s-cni-cncf-io\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.021043 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020828    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-run-ovn\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.021043 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020906    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-sysctl-d\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.021043 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020951    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-systemd\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.021043 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.020999    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b3224c7-2679-4a70-a014-1db9085c4982-agent-certs\") pod \"konnectivity-agent-vlwcz\" (UID: \"5b3224c7-2679-4a70-a014-1db9085c4982\") " pod="kube-system/konnectivity-agent-vlwcz"
Jul 24 13:38:27.021639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021049    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-os-release\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.021639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021091    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ffda80ba-ef82-40c2-94d3-02488c43b1b4-multus-daemon-config\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.021639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021121    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-socket-dir\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.021639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-registration-dir\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.021639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021186    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:27.021639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021228    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-system-cni-dir\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.021639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-var-lib-cni-multus\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.021639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021342    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.021639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021383    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv649\" (UniqueName: \"kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649\") pod \"network-check-target-hl7sr\" (UID: \"4bf6ccb9-124c-49cf-94ca-b58ea317f2ae\") " pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:27.021639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-run-openvswitch\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.021639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021550    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-kubelet\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.022175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021870    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-sysconfig\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.022175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-run\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.022175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021931    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-lib-modules\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.022175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021954    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fc9b45b-0545-43b7-8054-c134b3145ab3-tmp-dir\") pod \"node-resolver-dlfwk\" (UID: \"6fc9b45b-0545-43b7-8054-c134b3145ab3\") " pod="openshift-dns/node-resolver-dlfwk"
Jul 24 13:38:27.022175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.021977    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.022175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022028    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14b5655b-a1c3-4bdd-849a-cefc61ab8147-ovn-node-metrics-cert\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.022175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022053    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-cnibin\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.022175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022110    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1bc58137-000f-4dc7-8ced-06ec20f72052-serviceca\") pod \"node-ca-fwzrj\" (UID: \"1bc58137-000f-4dc7-8ced-06ec20f72052\") " pod="openshift-image-registry/node-ca-fwzrj"
Jul 24 13:38:27.022175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022136    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-systemd-units\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.022175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14b5655b-a1c3-4bdd-849a-cefc61ab8147-ovnkube-script-lib\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022186    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-modprobe-d\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022225    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-hostroot\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022257    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-multus-conf-dir\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ft9n\" (UniqueName: \"kubernetes.io/projected/1bc58137-000f-4dc7-8ced-06ec20f72052-kube-api-access-7ft9n\") pod \"node-ca-fwzrj\" (UID: \"1bc58137-000f-4dc7-8ced-06ec20f72052\") " pod="openshift-image-registry/node-ca-fwzrj"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022310    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-multus-cni-dir\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022331    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-device-dir\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022354    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14b5655b-a1c3-4bdd-849a-cefc61ab8147-env-overrides\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-host\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022399    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-cnibin\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-os-release\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022448    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022472    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx48j\" (UniqueName: \"kubernetes.io/projected/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-kube-api-access-kx48j\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022496    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6rzw\" (UniqueName: \"kubernetes.io/projected/ffda80ba-ef82-40c2-94d3-02488c43b1b4-kube-api-access-b6rzw\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022521    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-dbus\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022545    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-run-ovn-kubernetes\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.022640 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-kubernetes\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.023488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022590    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-run-multus-certs\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.023488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022615    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14b5655b-a1c3-4bdd-849a-cefc61ab8147-ovnkube-config\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.023488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022639    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-run-systemd\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.023488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022735    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-var-lib-openvswitch\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.023488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-node-log\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.023488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022784    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.023488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022809    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhlx2\" (UniqueName: \"kubernetes.io/projected/9b362245-96fb-41e0-a9ff-166250461bb7-kube-api-access-qhlx2\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.023488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022826    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-run-netns\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.023488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022841    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-log-socket\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.023488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022863    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-var-lib-kubelet\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.023488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022924    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b362245-96fb-41e0-a9ff-166250461bb7-tmp\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.023488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.022940    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6fc9b45b-0545-43b7-8054-c134b3145ab3-hosts-file\") pod \"node-resolver-dlfwk\" (UID: \"6fc9b45b-0545-43b7-8054-c134b3145ab3\") " pod="openshift-dns/node-resolver-dlfwk"
Jul 24 13:38:27.034495 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.034465    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 24 13:38:27.064142 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.064118    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gs84q"
Jul 24 13:38:27.073613 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.073587    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gs84q"
Jul 24 13:38:27.084272 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.084252    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 24 13:38:27.109364 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.109336    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 24 13:38:27.123299 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-kubelet\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.123299 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123295    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-sysconfig\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123313    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-run\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-lib-modules\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123343    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fc9b45b-0545-43b7-8054-c134b3145ab3-tmp-dir\") pod \"node-resolver-dlfwk\" (UID: \"6fc9b45b-0545-43b7-8054-c134b3145ab3\") " pod="openshift-dns/node-resolver-dlfwk"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123361    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14b5655b-a1c3-4bdd-849a-cefc61ab8147-ovn-node-metrics-cert\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123404    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-cnibin\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123410    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-kubelet\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123429    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-sysconfig\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123429    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7-iptables-alerter-script\") pod \"iptables-alerter-d7htw\" (UID: \"015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7\") " pod="openshift-network-operator/iptables-alerter-d7htw"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123475    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123486    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1bc58137-000f-4dc7-8ced-06ec20f72052-serviceca\") pod \"node-ca-fwzrj\" (UID: \"1bc58137-000f-4dc7-8ced-06ec20f72052\") " pod="openshift-image-registry/node-ca-fwzrj"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123497    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-run\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123497    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-lib-modules\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.123516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123517    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-cnibin\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123625    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-systemd-units\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14b5655b-a1c3-4bdd-849a-cefc61ab8147-ovnkube-script-lib\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123729    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fc9b45b-0545-43b7-8054-c134b3145ab3-tmp-dir\") pod \"node-resolver-dlfwk\" (UID: \"6fc9b45b-0545-43b7-8054-c134b3145ab3\") " pod="openshift-dns/node-resolver-dlfwk"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123744    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-modprobe-d\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123798    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-hostroot\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123811    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-systemd-units\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123824    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-multus-conf-dir\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123840    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123885    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-hostroot\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123890    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ft9n\" (UniqueName: \"kubernetes.io/projected/1bc58137-000f-4dc7-8ced-06ec20f72052-kube-api-access-7ft9n\") pod \"node-ca-fwzrj\" (UID: \"1bc58137-000f-4dc7-8ced-06ec20f72052\") " pod="openshift-image-registry/node-ca-fwzrj"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123920    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-multus-conf-dir\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-multus-cni-dir\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123947    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-device-dir\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123983    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14b5655b-a1c3-4bdd-849a-cefc61ab8147-env-overrides\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124001    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-modprobe-d\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.123999    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1bc58137-000f-4dc7-8ced-06ec20f72052-serviceca\") pod \"node-ca-fwzrj\" (UID: \"1bc58137-000f-4dc7-8ced-06ec20f72052\") " pod="openshift-image-registry/node-ca-fwzrj"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124006    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-host\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.124079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-cnibin\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124086    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-cnibin\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124091    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-device-dir\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-os-release\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124129    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-host\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-multus-cni-dir\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124262    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx48j\" (UniqueName: \"kubernetes.io/projected/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-kube-api-access-kx48j\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124283    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-os-release\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124293    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6rzw\" (UniqueName: \"kubernetes.io/projected/ffda80ba-ef82-40c2-94d3-02488c43b1b4-kube-api-access-b6rzw\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124331    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-dbus\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124338    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/14b5655b-a1c3-4bdd-849a-cefc61ab8147-ovnkube-script-lib\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124358    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-run-ovn-kubernetes\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124411    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-run-ovn-kubernetes\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-dbus\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124507    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/14b5655b-a1c3-4bdd-849a-cefc61ab8147-env-overrides\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-kubernetes\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.124804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-run-multus-certs\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124559    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-kubernetes\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14b5655b-a1c3-4bdd-849a-cefc61ab8147-ovnkube-config\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124600    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-run-multus-certs\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124604    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-run-systemd\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124631    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-var-lib-openvswitch\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124693    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-run-systemd\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124697    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-var-lib-openvswitch\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124832    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-node-log\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124926    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.124654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-node-log\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125195    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/14b5655b-a1c3-4bdd-849a-cefc61ab8147-ovnkube-config\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125232    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhlx2\" (UniqueName: \"kubernetes.io/projected/9b362245-96fb-41e0-a9ff-166250461bb7-kube-api-access-qhlx2\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125249    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-run-netns\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125263    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-log-socket\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125292    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-var-lib-kubelet\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.125584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125318    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b362245-96fb-41e0-a9ff-166250461bb7-tmp\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125325    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-run-netns\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125350    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-log-socket\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6fc9b45b-0545-43b7-8054-c134b3145ab3-hosts-file\") pod \"node-resolver-dlfwk\" (UID: \"6fc9b45b-0545-43b7-8054-c134b3145ab3\") " pod="openshift-dns/node-resolver-dlfwk"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125369    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125413    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-var-lib-kubelet\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125435    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6fc9b45b-0545-43b7-8054-c134b3145ab3-hosts-file\") pod \"node-resolver-dlfwk\" (UID: \"6fc9b45b-0545-43b7-8054-c134b3145ab3\") " pod="openshift-dns/node-resolver-dlfwk"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125441    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4vnc\" (UniqueName: \"kubernetes.io/projected/14b5655b-a1c3-4bdd-849a-cefc61ab8147-kube-api-access-k4vnc\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-system-cni-dir\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125487    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz68x\" (UniqueName: \"kubernetes.io/projected/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-kube-api-access-jz68x\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-slash\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-run-netns\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125548    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-system-cni-dir\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125560    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-sysctl-conf\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b362245-96fb-41e0-a9ff-166250461bb7-etc-tuned\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125612    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-run-netns\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125617    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcndh\" (UniqueName: \"kubernetes.io/projected/6fc9b45b-0545-43b7-8054-c134b3145ab3-kube-api-access-jcndh\") pod \"node-resolver-dlfwk\" (UID: \"6fc9b45b-0545-43b7-8054-c134b3145ab3\") " pod="openshift-dns/node-resolver-dlfwk"
Jul 24 13:38:27.126398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125643    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125584    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-slash\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125672    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-multus-socket-dir-parent\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125697    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs\") pod \"network-metrics-daemon-d5zgw\" (UID: \"694de45f-b515-47c3-a8a7-5f0f1889c685\") " pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125721    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-kubelet-config\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125735    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-sysctl-conf\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125753    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-sys\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125770    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-multus-socket-dir-parent\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.125825    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125847    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-kubelet-config\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125824    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b3224c7-2679-4a70-a014-1db9085c4982-konnectivity-ca\") pod \"konnectivity-agent-vlwcz\" (UID: \"5b3224c7-2679-4a70-a014-1db9085c4982\") " pod="kube-system/konnectivity-agent-vlwcz"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125916    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-sys\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.125931    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs podName:694de45f-b515-47c3-a8a7-5f0f1889c685 nodeName:}" failed. No retries permitted until 2026-07-24 13:38:27.625890441 +0000 UTC m=+2.987263746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs") pod "network-metrics-daemon-d5zgw" (UID: "694de45f-b515-47c3-a8a7-5f0f1889c685") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125842    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125965    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffda80ba-ef82-40c2-94d3-02488c43b1b4-cni-binary-copy\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.125988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-var-lib-cni-bin\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.127227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-var-lib-kubelet\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126087    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-var-lib-cni-bin\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwtkt\" (UniqueName: \"kubernetes.io/projected/694de45f-b515-47c3-a8a7-5f0f1889c685-kube-api-access-rwtkt\") pod \"network-metrics-daemon-d5zgw\" (UID: \"694de45f-b515-47c3-a8a7-5f0f1889c685\") " pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126169    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-var-lib-kubelet\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-cni-bin\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-cni-bin\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-etc-kubernetes\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126273    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-sys-fs\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7-host-slash\") pod \"iptables-alerter-d7htw\" (UID: \"015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7\") " pod="openshift-network-operator/iptables-alerter-d7htw"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bc58137-000f-4dc7-8ced-06ec20f72052-host\") pod \"node-ca-fwzrj\" (UID: \"1bc58137-000f-4dc7-8ced-06ec20f72052\") " pod="openshift-image-registry/node-ca-fwzrj"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126331    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-etc-kubernetes\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126357    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126377    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b3224c7-2679-4a70-a014-1db9085c4982-konnectivity-ca\") pod \"konnectivity-agent-vlwcz\" (UID: \"5b3224c7-2679-4a70-a014-1db9085c4982\") " pod="kube-system/konnectivity-agent-vlwcz"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-sys-fs\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126399    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-etc-openvswitch\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126363    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-etc-openvswitch\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.128046 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126445    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-cni-netd\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126471    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-run-k8s-cni-cncf-io\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126495    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-run-ovn\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126510    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1bc58137-000f-4dc7-8ced-06ec20f72052-host\") pod \"node-ca-fwzrj\" (UID: \"1bc58137-000f-4dc7-8ced-06ec20f72052\") " pod="openshift-image-registry/node-ca-fwzrj"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126518    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-sysctl-d\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-systemd\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126558    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-run-k8s-cni-cncf-io\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126566    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b3224c7-2679-4a70-a014-1db9085c4982-agent-certs\") pod \"konnectivity-agent-vlwcz\" (UID: \"5b3224c7-2679-4a70-a014-1db9085c4982\") " pod="kube-system/konnectivity-agent-vlwcz"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126594    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-os-release\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126616    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ffda80ba-ef82-40c2-94d3-02488c43b1b4-multus-daemon-config\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126622    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-systemd\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126637    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-socket-dir\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126661    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-os-release\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126660    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-registration-dir\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126674    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b362245-96fb-41e0-a9ff-166250461bb7-etc-sysctl-d\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126689    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126705    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-system-cni-dir\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126706    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-registration-dir\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.128734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126596    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-host-cni-netd\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126723    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-var-lib-cni-multus\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126739    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126718    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-run-ovn\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126765    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ffda80ba-ef82-40c2-94d3-02488c43b1b4-host-var-lib-cni-multus\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv649\" (UniqueName: \"kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649\") pod \"network-check-target-hl7sr\" (UID: \"4bf6ccb9-124c-49cf-94ca-b58ea317f2ae\") " pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-run-openvswitch\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.126808    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126809    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d62xr\" (UniqueName: \"kubernetes.io/projected/015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7-kube-api-access-d62xr\") pod \"iptables-alerter-d7htw\" (UID: \"015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7\") " pod="openshift-network-operator/iptables-alerter-d7htw"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.126846    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret podName:98ca09e8-a638-4eba-a4d8-49c66f7b4a37 nodeName:}" failed. No retries permitted until 2026-07-24 13:38:27.626832498 +0000 UTC m=+2.988205815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret") pod "global-pull-secret-syncer-djnpp" (UID: "98ca09e8-a638-4eba-a4d8-49c66f7b4a37") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126949    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126965    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-system-cni-dir\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.126988    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-socket-dir\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.127099    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/14b5655b-a1c3-4bdd-849a-cefc61ab8147-run-openvswitch\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.127368    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffda80ba-ef82-40c2-94d3-02488c43b1b4-cni-binary-copy\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.127381    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ffda80ba-ef82-40c2-94d3-02488c43b1b4-multus-daemon-config\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.129999 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.128948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/14b5655b-a1c3-4bdd-849a-cefc61ab8147-ovn-node-metrics-cert\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.130571 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.129095    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b3224c7-2679-4a70-a014-1db9085c4982-agent-certs\") pod \"konnectivity-agent-vlwcz\" (UID: \"5b3224c7-2679-4a70-a014-1db9085c4982\") " pod="kube-system/konnectivity-agent-vlwcz"
Jul 24 13:38:27.130571 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.129186    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b362245-96fb-41e0-a9ff-166250461bb7-tmp\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.130571 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.130493    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b362245-96fb-41e0-a9ff-166250461bb7-etc-tuned\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.137230 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.137208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ft9n\" (UniqueName: \"kubernetes.io/projected/1bc58137-000f-4dc7-8ced-06ec20f72052-kube-api-access-7ft9n\") pod \"node-ca-fwzrj\" (UID: \"1bc58137-000f-4dc7-8ced-06ec20f72052\") " pod="openshift-image-registry/node-ca-fwzrj"
Jul 24 13:38:27.139770 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.139747    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx48j\" (UniqueName: \"kubernetes.io/projected/ac8d35e5-33f2-4a50-acc1-3da0ca98806f-kube-api-access-kx48j\") pod \"multus-additional-cni-plugins-2c8sd\" (UID: \"ac8d35e5-33f2-4a50-acc1-3da0ca98806f\") " pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.141561 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.141540    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcndh\" (UniqueName: \"kubernetes.io/projected/6fc9b45b-0545-43b7-8054-c134b3145ab3-kube-api-access-jcndh\") pod \"node-resolver-dlfwk\" (UID: \"6fc9b45b-0545-43b7-8054-c134b3145ab3\") " pod="openshift-dns/node-resolver-dlfwk"
Jul 24 13:38:27.143033 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.143013    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:38:27.143132 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.143036    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:38:27.143132 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.143049    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pv649 for pod openshift-network-diagnostics/network-check-target-hl7sr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:27.143132 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.143114    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649 podName:4bf6ccb9-124c-49cf-94ca-b58ea317f2ae nodeName:}" failed. No retries permitted until 2026-07-24 13:38:27.643100851 +0000 UTC m=+3.004474133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pv649" (UniqueName: "kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649") pod "network-check-target-hl7sr" (UID: "4bf6ccb9-124c-49cf-94ca-b58ea317f2ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:27.148837 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.146051    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhlx2\" (UniqueName: \"kubernetes.io/projected/9b362245-96fb-41e0-a9ff-166250461bb7-kube-api-access-qhlx2\") pod \"tuned-mmgdr\" (UID: \"9b362245-96fb-41e0-a9ff-166250461bb7\") " pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.148837 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.146452    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4vnc\" (UniqueName: \"kubernetes.io/projected/14b5655b-a1c3-4bdd-849a-cefc61ab8147-kube-api-access-k4vnc\") pod \"ovnkube-node-dvrjm\" (UID: \"14b5655b-a1c3-4bdd-849a-cefc61ab8147\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.148837 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.146523    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6rzw\" (UniqueName: \"kubernetes.io/projected/ffda80ba-ef82-40c2-94d3-02488c43b1b4-kube-api-access-b6rzw\") pod \"multus-v26dd\" (UID: \"ffda80ba-ef82-40c2-94d3-02488c43b1b4\") " pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.148837 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.146527    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz68x\" (UniqueName: \"kubernetes.io/projected/e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7-kube-api-access-jz68x\") pod \"aws-ebs-csi-driver-node-jvnd6\" (UID: \"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.148837 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.147512    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwtkt\" (UniqueName: \"kubernetes.io/projected/694de45f-b515-47c3-a8a7-5f0f1889c685-kube-api-access-rwtkt\") pod \"network-metrics-daemon-d5zgw\" (UID: \"694de45f-b515-47c3-a8a7-5f0f1889c685\") " pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:27.227719 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.227680    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7-host-slash\") pod \"iptables-alerter-d7htw\" (UID: \"015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7\") " pod="openshift-network-operator/iptables-alerter-d7htw"
Jul 24 13:38:27.227942 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.227751    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d62xr\" (UniqueName: \"kubernetes.io/projected/015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7-kube-api-access-d62xr\") pod \"iptables-alerter-d7htw\" (UID: \"015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7\") " pod="openshift-network-operator/iptables-alerter-d7htw"
Jul 24 13:38:27.227942 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.227779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7-iptables-alerter-script\") pod \"iptables-alerter-d7htw\" (UID: \"015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7\") " pod="openshift-network-operator/iptables-alerter-d7htw"
Jul 24 13:38:27.227942 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.227823    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7-host-slash\") pod \"iptables-alerter-d7htw\" (UID: \"015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7\") " pod="openshift-network-operator/iptables-alerter-d7htw"
Jul 24 13:38:27.228328 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.228308    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7-iptables-alerter-script\") pod \"iptables-alerter-d7htw\" (UID: \"015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7\") " pod="openshift-network-operator/iptables-alerter-d7htw"
Jul 24 13:38:27.236544 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.236486    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d62xr\" (UniqueName: \"kubernetes.io/projected/015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7-kube-api-access-d62xr\") pod \"iptables-alerter-d7htw\" (UID: \"015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7\") " pod="openshift-network-operator/iptables-alerter-d7htw"
Jul 24 13:38:27.310461 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.310425    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dlfwk"
Jul 24 13:38:27.322413 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.322389    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fwzrj"
Jul 24 13:38:27.339375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.339339    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2c8sd"
Jul 24 13:38:27.346110 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.346092    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vlwcz"
Jul 24 13:38:27.354173 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.354153    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:27.361904 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.361877    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mmgdr"
Jul 24 13:38:27.370577 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.370557    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v26dd"
Jul 24 13:38:27.378470 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.378451    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6"
Jul 24 13:38:27.386110 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.386090    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d7htw"
Jul 24 13:38:27.630409 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.630316    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs\") pod \"network-metrics-daemon-d5zgw\" (UID: \"694de45f-b515-47c3-a8a7-5f0f1889c685\") " pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:27.630409 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.630380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:27.630628 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.630500    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:27.630628 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.630500    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:27.630628 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.630561    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret podName:98ca09e8-a638-4eba-a4d8-49c66f7b4a37 nodeName:}" failed. No retries permitted until 2026-07-24 13:38:28.63054298 +0000 UTC m=+3.991916263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret") pod "global-pull-secret-syncer-djnpp" (UID: "98ca09e8-a638-4eba-a4d8-49c66f7b4a37") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:27.630628 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.630607    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs podName:694de45f-b515-47c3-a8a7-5f0f1889c685 nodeName:}" failed. No retries permitted until 2026-07-24 13:38:28.630587253 +0000 UTC m=+3.991960586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs") pod "network-metrics-daemon-d5zgw" (UID: "694de45f-b515-47c3-a8a7-5f0f1889c685") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:27.731179 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:27.731140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv649\" (UniqueName: \"kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649\") pod \"network-check-target-hl7sr\" (UID: \"4bf6ccb9-124c-49cf-94ca-b58ea317f2ae\") " pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:27.731352 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.731318    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:38:27.731352 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.731344    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:38:27.731472 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.731355    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pv649 for pod openshift-network-diagnostics/network-check-target-hl7sr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:27.731472 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:27.731431    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649 podName:4bf6ccb9-124c-49cf-94ca-b58ea317f2ae nodeName:}" failed. No retries permitted until 2026-07-24 13:38:28.731408076 +0000 UTC m=+4.092781357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv649" (UniqueName: "kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649") pod "network-check-target-hl7sr" (UID: "4bf6ccb9-124c-49cf-94ca-b58ea317f2ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:28.075957 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.075884    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 13:33:27 +0000 UTC" deadline="2028-03-26 17:23:58.223939381 +0000 UTC"
Jul 24 13:38:28.075957 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.075913    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14667h45m30.148029389s"
Jul 24 13:38:28.087787 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:28.087758    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod015fb4e3_b755_4bc4_9c8d_17b5f1a92ce7.slice/crio-41d950f11508af25cc0c2d389f4dbe6659ad36370c9942948cefd56f792dcda9 WatchSource:0}: Error finding container 41d950f11508af25cc0c2d389f4dbe6659ad36370c9942948cefd56f792dcda9: Status 404 returned error can't find the container with id 41d950f11508af25cc0c2d389f4dbe6659ad36370c9942948cefd56f792dcda9
Jul 24 13:38:28.101773 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:28.101746    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8d35e5_33f2_4a50_acc1_3da0ca98806f.slice/crio-b20e7101e13a860bdf1bfb06998a4ea7d9eede7c809bd007cc59f399267376ba WatchSource:0}: Error finding container b20e7101e13a860bdf1bfb06998a4ea7d9eede7c809bd007cc59f399267376ba: Status 404 returned error can't find the container with id b20e7101e13a860bdf1bfb06998a4ea7d9eede7c809bd007cc59f399267376ba
Jul 24 13:38:28.106989 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:28.106928    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d0a2a3_6f81_4c9d_b80f_1aaaeca944b7.slice/crio-78f9f16a18cb62846a5023972d3c70ff6644d4df012988f88782a2ef2b125242 WatchSource:0}: Error finding container 78f9f16a18cb62846a5023972d3c70ff6644d4df012988f88782a2ef2b125242: Status 404 returned error can't find the container with id 78f9f16a18cb62846a5023972d3c70ff6644d4df012988f88782a2ef2b125242
Jul 24 13:38:28.107482 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:28.107465    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b362245_96fb_41e0_a9ff_166250461bb7.slice/crio-fe6b95e91b3427778d2f41d1fbf9a329754d36ac57841668c039c55ceb816ee3 WatchSource:0}: Error finding container fe6b95e91b3427778d2f41d1fbf9a329754d36ac57841668c039c55ceb816ee3: Status 404 returned error can't find the container with id fe6b95e91b3427778d2f41d1fbf9a329754d36ac57841668c039c55ceb816ee3
Jul 24 13:38:28.108284 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:28.108259    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b5655b_a1c3_4bdd_849a_cefc61ab8147.slice/crio-9354f062f50e41c17461f311ec84d875c2c25a1c945c7fd46e6ed490ab721c49 WatchSource:0}: Error finding container 9354f062f50e41c17461f311ec84d875c2c25a1c945c7fd46e6ed490ab721c49: Status 404 returned error can't find the container with id 9354f062f50e41c17461f311ec84d875c2c25a1c945c7fd46e6ed490ab721c49
Jul 24 13:38:28.110192 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:28.110125    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3224c7_2679_4a70_a014_1db9085c4982.slice/crio-99853b7d5b402a80bf5f4ce4c45c1c74ff67752d21af7939246665e456f64c3b WatchSource:0}: Error finding container 99853b7d5b402a80bf5f4ce4c45c1c74ff67752d21af7939246665e456f64c3b: Status 404 returned error can't find the container with id 99853b7d5b402a80bf5f4ce4c45c1c74ff67752d21af7939246665e456f64c3b
Jul 24 13:38:28.110767 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:28.110689    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffda80ba_ef82_40c2_94d3_02488c43b1b4.slice/crio-87ccf273ccec3e1aed134fa080d8394a2c003762f108e720ccaebb42cd48694f WatchSource:0}: Error finding container 87ccf273ccec3e1aed134fa080d8394a2c003762f108e720ccaebb42cd48694f: Status 404 returned error can't find the container with id 87ccf273ccec3e1aed134fa080d8394a2c003762f108e720ccaebb42cd48694f
Jul 24 13:38:28.111969 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:28.111938    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fc9b45b_0545_43b7_8054_c134b3145ab3.slice/crio-975f4ca05176ba103c5b2095a9a9c30cb18d88697d0fb68221eff41fe0df1b5b WatchSource:0}: Error finding container 975f4ca05176ba103c5b2095a9a9c30cb18d88697d0fb68221eff41fe0df1b5b: Status 404 returned error can't find the container with id 975f4ca05176ba103c5b2095a9a9c30cb18d88697d0fb68221eff41fe0df1b5b
Jul 24 13:38:28.112430 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:28.112388    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc58137_000f_4dc7_8ced_06ec20f72052.slice/crio-9c883e8e15ebc219f4dccbf10d31c231b1a0aaeddd3ef4aa6bc23d56a67d0141 WatchSource:0}: Error finding container 9c883e8e15ebc219f4dccbf10d31c231b1a0aaeddd3ef4aa6bc23d56a67d0141: Status 404 returned error can't find the container with id 9c883e8e15ebc219f4dccbf10d31c231b1a0aaeddd3ef4aa6bc23d56a67d0141
Jul 24 13:38:28.202042 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.201900    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vlwcz" event={"ID":"5b3224c7-2679-4a70-a014-1db9085c4982","Type":"ContainerStarted","Data":"99853b7d5b402a80bf5f4ce4c45c1c74ff67752d21af7939246665e456f64c3b"}
Jul 24 13:38:28.207474 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.207444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v26dd" event={"ID":"ffda80ba-ef82-40c2-94d3-02488c43b1b4","Type":"ContainerStarted","Data":"87ccf273ccec3e1aed134fa080d8394a2c003762f108e720ccaebb42cd48694f"}
Jul 24 13:38:28.210978 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.210946    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm" event={"ID":"14b5655b-a1c3-4bdd-849a-cefc61ab8147","Type":"ContainerStarted","Data":"9354f062f50e41c17461f311ec84d875c2c25a1c945c7fd46e6ed490ab721c49"}
Jul 24 13:38:28.212128 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.212102    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6" event={"ID":"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7","Type":"ContainerStarted","Data":"78f9f16a18cb62846a5023972d3c70ff6644d4df012988f88782a2ef2b125242"}
Jul 24 13:38:28.214098 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.214073    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2c8sd" event={"ID":"ac8d35e5-33f2-4a50-acc1-3da0ca98806f","Type":"ContainerStarted","Data":"b20e7101e13a860bdf1bfb06998a4ea7d9eede7c809bd007cc59f399267376ba"}
Jul 24 13:38:28.218065 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.218038    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal" event={"ID":"7597d384bc0b2108c01c0cc49001edde","Type":"ContainerStarted","Data":"ee03509c7701806dff5ed2c03ca2bc304b82b875985a5e915731022ce65e9ff4"}
Jul 24 13:38:28.220186 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.220161    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mmgdr" event={"ID":"9b362245-96fb-41e0-a9ff-166250461bb7","Type":"ContainerStarted","Data":"fe6b95e91b3427778d2f41d1fbf9a329754d36ac57841668c039c55ceb816ee3"}
Jul 24 13:38:28.222265 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.222238    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d7htw" event={"ID":"015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7","Type":"ContainerStarted","Data":"41d950f11508af25cc0c2d389f4dbe6659ad36370c9942948cefd56f792dcda9"}
Jul 24 13:38:28.223249 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.223226    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fwzrj" event={"ID":"1bc58137-000f-4dc7-8ced-06ec20f72052","Type":"ContainerStarted","Data":"9c883e8e15ebc219f4dccbf10d31c231b1a0aaeddd3ef4aa6bc23d56a67d0141"}
Jul 24 13:38:28.225105 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.225083    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dlfwk" event={"ID":"6fc9b45b-0545-43b7-8054-c134b3145ab3","Type":"ContainerStarted","Data":"975f4ca05176ba103c5b2095a9a9c30cb18d88697d0fb68221eff41fe0df1b5b"}
Jul 24 13:38:28.233362 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.233316    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-47.ec2.internal" podStartSLOduration=2.233303725 podStartE2EDuration="2.233303725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:38:28.232777803 +0000 UTC m=+3.594151107" watchObservedRunningTime="2026-07-24 13:38:28.233303725 +0000 UTC m=+3.594677027"
Jul 24 13:38:28.638787 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.638708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:28.638965 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.638804    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs\") pod \"network-metrics-daemon-d5zgw\" (UID: \"694de45f-b515-47c3-a8a7-5f0f1889c685\") " pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:28.639026 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:28.638974    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:28.639127 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:28.639095    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret podName:98ca09e8-a638-4eba-a4d8-49c66f7b4a37 nodeName:}" failed. No retries permitted until 2026-07-24 13:38:30.639058618 +0000 UTC m=+6.000431913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret") pod "global-pull-secret-syncer-djnpp" (UID: "98ca09e8-a638-4eba-a4d8-49c66f7b4a37") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:28.639232 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:28.639218    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:28.639287 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:28.639271    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs podName:694de45f-b515-47c3-a8a7-5f0f1889c685 nodeName:}" failed. No retries permitted until 2026-07-24 13:38:30.639256159 +0000 UTC m=+6.000629453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs") pod "network-metrics-daemon-d5zgw" (UID: "694de45f-b515-47c3-a8a7-5f0f1889c685") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:28.739560 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:28.739511    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv649\" (UniqueName: \"kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649\") pod \"network-check-target-hl7sr\" (UID: \"4bf6ccb9-124c-49cf-94ca-b58ea317f2ae\") " pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:28.739742 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:28.739709    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:38:28.739742 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:28.739731    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:38:28.739848 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:28.739746    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pv649 for pod openshift-network-diagnostics/network-check-target-hl7sr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:28.739848 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:28.739804    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649 podName:4bf6ccb9-124c-49cf-94ca-b58ea317f2ae nodeName:}" failed. No retries permitted until 2026-07-24 13:38:30.73978573 +0000 UTC m=+6.101159032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv649" (UniqueName: "kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649") pod "network-check-target-hl7sr" (UID: "4bf6ccb9-124c-49cf-94ca-b58ea317f2ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:29.076268 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:29.076162    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 13:33:27 +0000 UTC" deadline="2028-01-25 15:12:41.000837678 +0000 UTC"
Jul 24 13:38:29.076268 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:29.076224    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13201h34m11.924617495s"
Jul 24 13:38:29.190048 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:29.190015    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:29.190218 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:29.190166    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:29.190594 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:29.190571    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:29.190691 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:29.190672    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:29.190830 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:29.190813    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:29.190930 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:29.190912    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:29.237976 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:29.237943    2559 generic.go:356] "Generic (PLEG): container finished" podID="95c76765087f6aafd2072f10ac7a2292" containerID="68ea0f626874bb8792df16233d86bb91f4da1c3c486ff5edfe98b0bcd06415bc" exitCode=0
Jul 24 13:38:29.238140 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:29.238032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" event={"ID":"95c76765087f6aafd2072f10ac7a2292","Type":"ContainerDied","Data":"68ea0f626874bb8792df16233d86bb91f4da1c3c486ff5edfe98b0bcd06415bc"}
Jul 24 13:38:30.278170 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:30.278103    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" event={"ID":"95c76765087f6aafd2072f10ac7a2292","Type":"ContainerStarted","Data":"375a4b461808b716d6e14109ba2379843b122e42dcab33d3f88cbe2f4aa8d136"}
Jul 24 13:38:30.655627 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:30.655542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:30.655796 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:30.655647    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs\") pod \"network-metrics-daemon-d5zgw\" (UID: \"694de45f-b515-47c3-a8a7-5f0f1889c685\") " pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:30.655796 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:30.655788    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:30.655943 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:30.655850    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs podName:694de45f-b515-47c3-a8a7-5f0f1889c685 nodeName:}" failed. No retries permitted until 2026-07-24 13:38:34.655829298 +0000 UTC m=+10.017202597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs") pod "network-metrics-daemon-d5zgw" (UID: "694de45f-b515-47c3-a8a7-5f0f1889c685") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:30.656308 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:30.656285    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:30.656418 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:30.656346    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret podName:98ca09e8-a638-4eba-a4d8-49c66f7b4a37 nodeName:}" failed. No retries permitted until 2026-07-24 13:38:34.656329512 +0000 UTC m=+10.017702796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret") pod "global-pull-secret-syncer-djnpp" (UID: "98ca09e8-a638-4eba-a4d8-49c66f7b4a37") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:30.756497 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:30.756449    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv649\" (UniqueName: \"kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649\") pod \"network-check-target-hl7sr\" (UID: \"4bf6ccb9-124c-49cf-94ca-b58ea317f2ae\") " pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:30.756734 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:30.756699    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:38:30.756734 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:30.756723    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:38:30.756734 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:30.756737    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pv649 for pod openshift-network-diagnostics/network-check-target-hl7sr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:30.756970 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:30.756806    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649 podName:4bf6ccb9-124c-49cf-94ca-b58ea317f2ae nodeName:}" failed. No retries permitted until 2026-07-24 13:38:34.75678755 +0000 UTC m=+10.118160846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv649" (UniqueName: "kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649") pod "network-check-target-hl7sr" (UID: "4bf6ccb9-124c-49cf-94ca-b58ea317f2ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:31.188760 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:31.188721    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:31.188760 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:31.188745    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:31.189002 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:31.188885    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:31.189057 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:31.189010    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:31.189123 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:31.189063    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:31.189176 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:31.189125    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:33.189826 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:33.189754    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:33.190224 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:33.189914    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:33.190342 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:33.190319    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:33.190480 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:33.190425    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:33.190480 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:33.190469    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:33.190591 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:33.190538    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:34.687351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:34.687305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs\") pod \"network-metrics-daemon-d5zgw\" (UID: \"694de45f-b515-47c3-a8a7-5f0f1889c685\") " pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:34.687825 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:34.687379    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:34.687825 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:34.687545    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:34.687825 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:34.687607    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret podName:98ca09e8-a638-4eba-a4d8-49c66f7b4a37 nodeName:}" failed. No retries permitted until 2026-07-24 13:38:42.687588437 +0000 UTC m=+18.048961720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret") pod "global-pull-secret-syncer-djnpp" (UID: "98ca09e8-a638-4eba-a4d8-49c66f7b4a37") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:34.688072 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:34.688050    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:34.688137 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:34.688112    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs podName:694de45f-b515-47c3-a8a7-5f0f1889c685 nodeName:}" failed. No retries permitted until 2026-07-24 13:38:42.688096577 +0000 UTC m=+18.049469872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs") pod "network-metrics-daemon-d5zgw" (UID: "694de45f-b515-47c3-a8a7-5f0f1889c685") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:34.788810 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:34.788768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv649\" (UniqueName: \"kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649\") pod \"network-check-target-hl7sr\" (UID: \"4bf6ccb9-124c-49cf-94ca-b58ea317f2ae\") " pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:34.789033 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:34.788984    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:38:34.789538 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:34.789009    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:38:34.789538 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:34.789354    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pv649 for pod openshift-network-diagnostics/network-check-target-hl7sr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:34.789538 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:34.789457    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649 podName:4bf6ccb9-124c-49cf-94ca-b58ea317f2ae nodeName:}" failed. No retries permitted until 2026-07-24 13:38:42.789417417 +0000 UTC m=+18.150790711 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv649" (UniqueName: "kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649") pod "network-check-target-hl7sr" (UID: "4bf6ccb9-124c-49cf-94ca-b58ea317f2ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:35.190301 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:35.190214    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:35.190502 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:35.190340    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:35.190870 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:35.190684    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:35.190870 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:35.190797    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:35.191052 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:35.190869    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:35.191052 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:35.190961    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:37.188802 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:37.188727    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:37.188802 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:37.188753    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:37.189430 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:37.188884    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:37.189430 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:37.188978    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:37.189430 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:37.189031    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:37.189430 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:37.189113    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:39.188603 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:39.188570    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:39.189091 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:39.188575    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:39.189091 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:39.188709    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:39.189091 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:39.188768    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:39.189091 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:39.188575    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:39.189091 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:39.188850    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:41.189160 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:41.189125    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:41.189652 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:41.189125    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:41.189652 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:41.189264    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:41.189652 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:41.189125    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:41.189652 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:41.189316    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:41.189652 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:41.189388    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:42.743753 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:42.743715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:42.744330 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:42.743799    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs\") pod \"network-metrics-daemon-d5zgw\" (UID: \"694de45f-b515-47c3-a8a7-5f0f1889c685\") " pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:42.744330 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:42.743893    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:42.744330 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:42.743955    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs podName:694de45f-b515-47c3-a8a7-5f0f1889c685 nodeName:}" failed. No retries permitted until 2026-07-24 13:38:58.743937991 +0000 UTC m=+34.105311272 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs") pod "network-metrics-daemon-d5zgw" (UID: "694de45f-b515-47c3-a8a7-5f0f1889c685") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:42.744330 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:42.743893    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:42.744330 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:42.744066    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret podName:98ca09e8-a638-4eba-a4d8-49c66f7b4a37 nodeName:}" failed. No retries permitted until 2026-07-24 13:38:58.744043604 +0000 UTC m=+34.105416888 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret") pod "global-pull-secret-syncer-djnpp" (UID: "98ca09e8-a638-4eba-a4d8-49c66f7b4a37") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:42.844843 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:42.844812    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv649\" (UniqueName: \"kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649\") pod \"network-check-target-hl7sr\" (UID: \"4bf6ccb9-124c-49cf-94ca-b58ea317f2ae\") " pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:42.845033 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:42.844956    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:38:42.845033 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:42.844977    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:38:42.845033 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:42.844988    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pv649 for pod openshift-network-diagnostics/network-check-target-hl7sr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:42.845157 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:42.845046    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649 podName:4bf6ccb9-124c-49cf-94ca-b58ea317f2ae nodeName:}" failed. No retries permitted until 2026-07-24 13:38:58.845030458 +0000 UTC m=+34.206403739 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv649" (UniqueName: "kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649") pod "network-check-target-hl7sr" (UID: "4bf6ccb9-124c-49cf-94ca-b58ea317f2ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:43.189379 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:43.189345    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:43.189573 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:43.189345    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:43.189573 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:43.189478    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:43.189573 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:43.189481    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:43.189688 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:43.189566    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:43.189734 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:43.189696    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:45.189123 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:45.189084    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:45.189629 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:45.189188    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:45.189629 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:45.189192    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:45.189629 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:45.189312    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:45.189629 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:45.189343    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:45.189629 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:45.189430    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:47.189170 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.188952    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:47.190100 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.188953    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:47.190100 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:47.189260    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:47.190100 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.189038    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:47.190100 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:47.189325    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:47.190100 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:47.189457    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:47.313601 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.313561    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6" event={"ID":"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7","Type":"ContainerStarted","Data":"14119e71d2c81080c97c74a826a8cc3ab29d20997d1c3ae64b2eb2378331c4e7"}
Jul 24 13:38:47.315410 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.315377    2559 generic.go:356] "Generic (PLEG): container finished" podID="ac8d35e5-33f2-4a50-acc1-3da0ca98806f" containerID="badca11eaff50193ec480e8de9b92eb90d94522bd60cbf06b1cb9e0c2c57aef6" exitCode=0
Jul 24 13:38:47.315554 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.315477    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2c8sd" event={"ID":"ac8d35e5-33f2-4a50-acc1-3da0ca98806f","Type":"ContainerDied","Data":"badca11eaff50193ec480e8de9b92eb90d94522bd60cbf06b1cb9e0c2c57aef6"}
Jul 24 13:38:47.317738 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.317709    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mmgdr" event={"ID":"9b362245-96fb-41e0-a9ff-166250461bb7","Type":"ContainerStarted","Data":"387c37709dc7e92341eeeb5ac6464c6b01f9770b8ec4226522ae53c6142a3667"}
Jul 24 13:38:47.319445 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.319411    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fwzrj" event={"ID":"1bc58137-000f-4dc7-8ced-06ec20f72052","Type":"ContainerStarted","Data":"abf578ebc963ff24b5091669090583777aeae4872b7d35185c2a75e8a22ea381"}
Jul 24 13:38:47.321006 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.320981    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dlfwk" event={"ID":"6fc9b45b-0545-43b7-8054-c134b3145ab3","Type":"ContainerStarted","Data":"c83dd1cef2ef2e0a5c42c6f8e2e210531ca2e4c28c92fe83cbf5d9325878ed83"}
Jul 24 13:38:47.322668 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.322623    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vlwcz" event={"ID":"5b3224c7-2679-4a70-a014-1db9085c4982","Type":"ContainerStarted","Data":"12aeef584f18f67de63f903cbab69921bddb329db71466b74c62caba514a4f5a"}
Jul 24 13:38:47.324459 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.324432    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v26dd" event={"ID":"ffda80ba-ef82-40c2-94d3-02488c43b1b4","Type":"ContainerStarted","Data":"fdbc50a518f3cc3f8ee0dc416e9987b42afb6181c75640207b44d7c2702ff760"}
Jul 24 13:38:47.327741 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.327717    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm" event={"ID":"14b5655b-a1c3-4bdd-849a-cefc61ab8147","Type":"ContainerStarted","Data":"a952d371b3301c0f1def3777c8a122aab15dbbebe9a74f6a9614c8eb8d3ba4ae"}
Jul 24 13:38:47.327822 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.327785    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm" event={"ID":"14b5655b-a1c3-4bdd-849a-cefc61ab8147","Type":"ContainerStarted","Data":"e5de540551d65f6f1fbda996bcf9416acebcf8bf0ad3e3425dffc8d36147f534"}
Jul 24 13:38:47.327889 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.327819    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm" event={"ID":"14b5655b-a1c3-4bdd-849a-cefc61ab8147","Type":"ContainerStarted","Data":"ed79096c14918dd2240ab16930ed14afe21c04459f89b9631f448d9a0433e6ce"}
Jul 24 13:38:47.327889 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.327877    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm" event={"ID":"14b5655b-a1c3-4bdd-849a-cefc61ab8147","Type":"ContainerStarted","Data":"4f79052b3fe1fb9834b9ba96bccf2650cbbd255da841a57d2ee9634407e2907e"}
Jul 24 13:38:47.327970 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.327919    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm" event={"ID":"14b5655b-a1c3-4bdd-849a-cefc61ab8147","Type":"ContainerStarted","Data":"de4dd47c63773ed290516a3a93b7d073d7a331213af7eeb6e83f853af58d1956"}
Jul 24 13:38:47.327970 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.327949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm" event={"ID":"14b5655b-a1c3-4bdd-849a-cefc61ab8147","Type":"ContainerStarted","Data":"6d2e1b2a5ed19fa827bd4b47ee72f29a0f6ec844c7d1937d47db99a9d8399075"}
Jul 24 13:38:47.343974 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.343921    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-47.ec2.internal" podStartSLOduration=21.343903835 podStartE2EDuration="21.343903835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:38:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:38:30.296838292 +0000 UTC m=+5.658211596" watchObservedRunningTime="2026-07-24 13:38:47.343903835 +0000 UTC m=+22.705277142"
Jul 24 13:38:47.381172 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.381121    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mmgdr" podStartSLOduration=4.090504548 podStartE2EDuration="22.381104693s" totalImagesPullingTime="18.290600145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:38:47.380777833 +0000 UTC m=+22.742151137" watchObservedRunningTime="2026-07-24 13:38:47.381104693 +0000 UTC m=+22.742477995"
Jul 24 13:38:47.381467 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.381439    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vlwcz" podStartSLOduration=11.956012297000001 podStartE2EDuration="22.381431173s" totalImagesPullingTime="10.425418876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:38:47.362130957 +0000 UTC m=+22.723504255" watchObservedRunningTime="2026-07-24 13:38:47.381431173 +0000 UTC m=+22.742804476"
Jul 24 13:38:47.399820 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.399774    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v26dd" podStartSLOduration=4.059636266 podStartE2EDuration="22.399758506s" totalImagesPullingTime="18.34012224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:38:47.399401581 +0000 UTC m=+22.760774884" watchObservedRunningTime="2026-07-24 13:38:47.399758506 +0000 UTC m=+22.761131808"
Jul 24 13:38:47.415529 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.415482    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dlfwk" podStartSLOduration=4.130205443 podStartE2EDuration="22.415468567s" totalImagesPullingTime="18.285263124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:38:47.415177795 +0000 UTC m=+22.776551098" watchObservedRunningTime="2026-07-24 13:38:47.415468567 +0000 UTC m=+22.776841871"
Jul 24 13:38:47.814215 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:47.814182    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 24 13:38:48.082453 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:48.082289    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T13:38:47.814199465Z","UUID":"f6e7f103-4452-43a5-8fec-1bb6de0db7a6","Handler":null,"Name":"","Endpoint":""}
Jul 24 13:38:48.085423 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:48.084918    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 24 13:38:48.085423 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:48.084954    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 24 13:38:48.333558 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:48.333450    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6" event={"ID":"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7","Type":"ContainerStarted","Data":"41be1d9f559ffecd02a8cbe93d4a288bf6bfcb0f0479b208430f452d9f704dc8"}
Jul 24 13:38:48.335440 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:48.335412    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d7htw" event={"ID":"015fb4e3-b755-4bc4-9c8d-17b5f1a92ce7","Type":"ContainerStarted","Data":"3d91c4e945ade23ca060a9d0830efd03cdfad345a1a24208fe87ddf27e297b76"}
Jul 24 13:38:48.351339 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:48.351256    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fwzrj" podStartSLOduration=5.066818277 podStartE2EDuration="23.35123854s" totalImagesPullingTime="18.284420263s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:38:47.432884952 +0000 UTC m=+22.794258258" watchObservedRunningTime="2026-07-24 13:38:48.35123854 +0000 UTC m=+23.712611844"
Jul 24 13:38:48.351797 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:48.351757    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d7htw" podStartSLOduration=5.052718812 podStartE2EDuration="23.351739926s" totalImagesPullingTime="18.299021114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:38:48.351408976 +0000 UTC m=+23.712782281" watchObservedRunningTime="2026-07-24 13:38:48.351739926 +0000 UTC m=+23.713113231"
Jul 24 13:38:49.188734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:49.188704    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:49.188734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:49.188740    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:49.189110 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:49.188713    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:49.189110 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:49.188843    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:49.189110 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:49.188934    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:49.189110 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:49.189011    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:49.341996 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:49.341949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm" event={"ID":"14b5655b-a1c3-4bdd-849a-cefc61ab8147","Type":"ContainerStarted","Data":"b82fb27f1b15c46abdf92a421e8ef6255e6db8adedfc94cbe7f22c35768bd6d0"}
Jul 24 13:38:49.344568 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:49.344527    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6" event={"ID":"e3d0a2a3-6f81-4c9d-b80f-1aaaeca944b7","Type":"ContainerStarted","Data":"ee7b625b613d8374d27f7e404d90f9a6cf4dd0ad8cbdf21596897fec42e5d129"}
Jul 24 13:38:49.362607 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:49.362524    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vlwcz"
Jul 24 13:38:49.363929 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:49.363891    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jvnd6" podStartSLOduration=3.914661726 podStartE2EDuration="24.363876493s" totalImagesPullingTime="20.449214767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:38:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:38:49.363779193 +0000 UTC m=+24.725152500" watchObservedRunningTime="2026-07-24 13:38:49.363876493 +0000 UTC m=+24.725249796"
Jul 24 13:38:49.801768 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:49.801725    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vlwcz"
Jul 24 13:38:49.802412 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:49.802388    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vlwcz"
Jul 24 13:38:50.348164 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:50.348140    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vlwcz"
Jul 24 13:38:51.188614 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:51.188576    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:51.188804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:51.188580    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:51.188804 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:51.188723    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:51.188804 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:51.188594    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:51.188998 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:51.188821    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:51.188998 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:51.188885    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:52.355087 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:52.354881    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm" event={"ID":"14b5655b-a1c3-4bdd-849a-cefc61ab8147","Type":"ContainerStarted","Data":"d825cff5024a1cfbb9489da7656b74aa67f5d94b2402371be61a790a5505eafc"}
Jul 24 13:38:52.355978 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:52.355150    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:52.356799 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:52.356777    2559 generic.go:356] "Generic (PLEG): container finished" podID="ac8d35e5-33f2-4a50-acc1-3da0ca98806f" containerID="288a49f35238e152b7c8353c5495bc3d18bd9d0b71475098a6632a6b5a4f8e79" exitCode=0
Jul 24 13:38:52.356936 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:52.356872    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2c8sd" event={"ID":"ac8d35e5-33f2-4a50-acc1-3da0ca98806f","Type":"ContainerDied","Data":"288a49f35238e152b7c8353c5495bc3d18bd9d0b71475098a6632a6b5a4f8e79"}
Jul 24 13:38:52.370692 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:52.370671    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:52.381286 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:52.381251    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm" podStartSLOduration=9.024111567 podStartE2EDuration="27.381238522s" totalImagesPullingTime="18.357126955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:38:52.380046785 +0000 UTC m=+27.741420087" watchObservedRunningTime="2026-07-24 13:38:52.381238522 +0000 UTC m=+27.742611808"
Jul 24 13:38:53.189407 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.189219    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:53.189582 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.189220    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:53.189582 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:53.189501    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:53.189582 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.189263    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:53.189738 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:53.189623    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:53.189738 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:53.189640    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:53.360568 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.360535    2559 generic.go:356] "Generic (PLEG): container finished" podID="ac8d35e5-33f2-4a50-acc1-3da0ca98806f" containerID="1c7afc6a308a9321adfc0ff7d4ca69b6b34e0ee0bc6c8cac67a9cb177508e821" exitCode=0
Jul 24 13:38:53.360953 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.360591    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2c8sd" event={"ID":"ac8d35e5-33f2-4a50-acc1-3da0ca98806f","Type":"ContainerDied","Data":"1c7afc6a308a9321adfc0ff7d4ca69b6b34e0ee0bc6c8cac67a9cb177508e821"}
Jul 24 13:38:53.360953 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.360695    2559 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 24 13:38:53.361218 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.361198    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:53.375304 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.375287    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:53.528382 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.528304    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-djnpp"]
Jul 24 13:38:53.528528 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.528399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:53.528528 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:53.528494    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:53.531875 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.531831    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hl7sr"]
Jul 24 13:38:53.532007 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.531943    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:53.532071 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:53.532035    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:53.532631 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.532603    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d5zgw"]
Jul 24 13:38:53.532744 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:53.532691    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:53.532807 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:53.532788    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:54.035108 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:54.035079    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:38:55.190474 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:55.190443    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:55.190840 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:55.190544    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:55.190840 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:55.190586    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:55.190840 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:55.190578    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:55.190840 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:55.190666    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:55.190840 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:55.190743    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:55.367650 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:55.367622    2559 generic.go:356] "Generic (PLEG): container finished" podID="ac8d35e5-33f2-4a50-acc1-3da0ca98806f" containerID="528d4b562979eeca34ff19a1d8e57bc127a6b53ad02cfa70ababe7ae244d6635" exitCode=0
Jul 24 13:38:55.367803 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:55.367712    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2c8sd" event={"ID":"ac8d35e5-33f2-4a50-acc1-3da0ca98806f","Type":"ContainerDied","Data":"528d4b562979eeca34ff19a1d8e57bc127a6b53ad02cfa70ababe7ae244d6635"}
Jul 24 13:38:57.192191 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:57.191985    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:57.192615 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:57.192034    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:57.192615 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:57.192262    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:57.192615 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:57.192362    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:57.192615 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:57.192037    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:57.192615 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:57.192477    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:58.766561 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:58.766526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs\") pod \"network-metrics-daemon-d5zgw\" (UID: \"694de45f-b515-47c3-a8a7-5f0f1889c685\") " pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:58.767018 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:58.766584    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:58.767018 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:58.766705    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:58.767018 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:58.766716    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:58.767018 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:58.766784    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs podName:694de45f-b515-47c3-a8a7-5f0f1889c685 nodeName:}" failed. No retries permitted until 2026-07-24 13:39:30.76676048 +0000 UTC m=+66.128133762 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs") pod "network-metrics-daemon-d5zgw" (UID: "694de45f-b515-47c3-a8a7-5f0f1889c685") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 24 13:38:58.767018 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:58.766806    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret podName:98ca09e8-a638-4eba-a4d8-49c66f7b4a37 nodeName:}" failed. No retries permitted until 2026-07-24 13:39:30.766795642 +0000 UTC m=+66.128168937 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret") pod "global-pull-secret-syncer-djnpp" (UID: "98ca09e8-a638-4eba-a4d8-49c66f7b4a37") : object "kube-system"/"original-pull-secret" not registered
Jul 24 13:38:58.867607 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:58.867577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv649\" (UniqueName: \"kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649\") pod \"network-check-target-hl7sr\" (UID: \"4bf6ccb9-124c-49cf-94ca-b58ea317f2ae\") " pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:58.867780 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:58.867730    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 24 13:38:58.867780 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:58.867748    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 24 13:38:58.867780 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:58.867757    2559 projected.go:196] Error preparing data for projected volume kube-api-access-pv649 for pod openshift-network-diagnostics/network-check-target-hl7sr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:58.867930 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:58.867803    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649 podName:4bf6ccb9-124c-49cf-94ca-b58ea317f2ae nodeName:}" failed. No retries permitted until 2026-07-24 13:39:30.867791136 +0000 UTC m=+66.229164417 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv649" (UniqueName: "kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649") pod "network-check-target-hl7sr" (UID: "4bf6ccb9-124c-49cf-94ca-b58ea317f2ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 24 13:38:59.189525 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.189496    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:38:59.189696 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.189528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:38:59.189696 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.189496    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:38:59.189696 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:59.189608    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hl7sr" podUID="4bf6ccb9-124c-49cf-94ca-b58ea317f2ae"
Jul 24 13:38:59.189839 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:59.189743    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5zgw" podUID="694de45f-b515-47c3-a8a7-5f0f1889c685"
Jul 24 13:38:59.189923 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:59.189879    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-djnpp" podUID="98ca09e8-a638-4eba-a4d8-49c66f7b4a37"
Jul 24 13:38:59.396919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.396900    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-47.ec2.internal" event="NodeReady"
Jul 24 13:38:59.397018 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.397008    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 24 13:38:59.433313 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.433287    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-798bff4796-njxgv"]
Jul 24 13:38:59.435679 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.435663    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.440136 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.440087    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 24 13:38:59.440628 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.440615    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 24 13:38:59.440688 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.440627    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l24vv\""
Jul 24 13:38:59.441505 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.441489    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 24 13:38:59.445068 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.445048    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 24 13:38:59.446520 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.446347    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j9254"]
Jul 24 13:38:59.447984 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.447969    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j9254"
Jul 24 13:38:59.450436 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.450420    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xl6tf\""
Jul 24 13:38:59.450524 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.450435    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 24 13:38:59.451089 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.451020    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 24 13:38:59.454629 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.453926    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xlhvh"]
Jul 24 13:38:59.457429 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.457407    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-798bff4796-njxgv"]
Jul 24 13:38:59.457526 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.457484    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xlhvh"
Jul 24 13:38:59.459938 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.459897    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j9j4b\""
Jul 24 13:38:59.460007 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.459897    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 24 13:38:59.460153 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.460140    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 24 13:38:59.460221 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.460206    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 24 13:38:59.462991 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.462974    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j9254"]
Jul 24 13:38:59.466438 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.466418    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xlhvh"]
Jul 24 13:38:59.574342 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574315    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65da1b68-61f6-4171-b9fe-270a84cdd52f-ca-trust-extracted\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.574470 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574348    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4cf4108d-bdcb-4215-bc72-22f3d28211c6-config-volume\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:38:59.574470 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65da1b68-61f6-4171-b9fe-270a84cdd52f-image-registry-private-configuration\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.574470 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-bound-sa-token\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.574470 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574421    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cf4108d-bdcb-4215-bc72-22f3d28211c6-tmp-dir\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:38:59.574639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574491    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-certificates\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.574639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574559    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ck2w\" (UniqueName: \"kubernetes.io/projected/4cf4108d-bdcb-4215-bc72-22f3d28211c6-kube-api-access-7ck2w\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:38:59.574639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574588    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65da1b68-61f6-4171-b9fe-270a84cdd52f-installation-pull-secrets\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.574639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574615    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92ef8199-a528-4240-b439-f7ea2a677307-cert\") pod \"ingress-canary-xlhvh\" (UID: \"92ef8199-a528-4240-b439-f7ea2a677307\") " pod="openshift-ingress-canary/ingress-canary-xlhvh"
Jul 24 13:38:59.574639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574633    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65da1b68-61f6-4171-b9fe-270a84cdd52f-trusted-ca\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.574795 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574655    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:38:59.574795 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574697    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqcpt\" (UniqueName: \"kubernetes.io/projected/92ef8199-a528-4240-b439-f7ea2a677307-kube-api-access-zqcpt\") pod \"ingress-canary-xlhvh\" (UID: \"92ef8199-a528-4240-b439-f7ea2a677307\") " pod="openshift-ingress-canary/ingress-canary-xlhvh"
Jul 24 13:38:59.574795 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.574795 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.574742    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djzfp\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-kube-api-access-djzfp\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.675680 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.675625    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqcpt\" (UniqueName: \"kubernetes.io/projected/92ef8199-a528-4240-b439-f7ea2a677307-kube-api-access-zqcpt\") pod \"ingress-canary-xlhvh\" (UID: \"92ef8199-a528-4240-b439-f7ea2a677307\") " pod="openshift-ingress-canary/ingress-canary-xlhvh"
Jul 24 13:38:59.675680 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.675685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.675956 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.675712    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djzfp\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-kube-api-access-djzfp\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.675956 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.675765    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65da1b68-61f6-4171-b9fe-270a84cdd52f-ca-trust-extracted\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.675956 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.675883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4cf4108d-bdcb-4215-bc72-22f3d28211c6-config-volume\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:38:59.675956 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.675929    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65da1b68-61f6-4171-b9fe-270a84cdd52f-image-registry-private-configuration\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.675956 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.675951    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-bound-sa-token\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.676211 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:59.675970    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:38:59.676211 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:59.675988    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798bff4796-njxgv: secret "image-registry-tls" not found
Jul 24 13:38:59.676211 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:59.676050    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls podName:65da1b68-61f6-4171-b9fe-270a84cdd52f nodeName:}" failed. No retries permitted until 2026-07-24 13:39:00.176028018 +0000 UTC m=+35.537401315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls") pod "image-registry-798bff4796-njxgv" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f") : secret "image-registry-tls" not found
Jul 24 13:38:59.676211 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.676068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cf4108d-bdcb-4215-bc72-22f3d28211c6-tmp-dir\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:38:59.676211 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.676096    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-certificates\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.676211 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.676131    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ck2w\" (UniqueName: \"kubernetes.io/projected/4cf4108d-bdcb-4215-bc72-22f3d28211c6-kube-api-access-7ck2w\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:38:59.676211 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.676158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65da1b68-61f6-4171-b9fe-270a84cdd52f-installation-pull-secrets\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.676211 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.676182    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65da1b68-61f6-4171-b9fe-270a84cdd52f-ca-trust-extracted\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.676606 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.676188    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92ef8199-a528-4240-b439-f7ea2a677307-cert\") pod \"ingress-canary-xlhvh\" (UID: \"92ef8199-a528-4240-b439-f7ea2a677307\") " pod="openshift-ingress-canary/ingress-canary-xlhvh"
Jul 24 13:38:59.676606 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.676269    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65da1b68-61f6-4171-b9fe-270a84cdd52f-trusted-ca\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.676606 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.676305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:38:59.676606 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.676370    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cf4108d-bdcb-4215-bc72-22f3d28211c6-tmp-dir\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:38:59.676606 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:59.676425    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:38:59.676606 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:38:59.676468    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls podName:4cf4108d-bdcb-4215-bc72-22f3d28211c6 nodeName:}" failed. No retries permitted until 2026-07-24 13:39:00.176454206 +0000 UTC m=+35.537827500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls") pod "dns-default-j9254" (UID: "4cf4108d-bdcb-4215-bc72-22f3d28211c6") : secret "dns-default-metrics-tls" not found
Jul 24 13:38:59.676606 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.676532    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4cf4108d-bdcb-4215-bc72-22f3d28211c6-config-volume\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:38:59.676991 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.676623    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-certificates\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.677234 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.677209    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65da1b68-61f6-4171-b9fe-270a84cdd52f-trusted-ca\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.680121 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.680103    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65da1b68-61f6-4171-b9fe-270a84cdd52f-image-registry-private-configuration\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.680204 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.680124    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92ef8199-a528-4240-b439-f7ea2a677307-cert\") pod \"ingress-canary-xlhvh\" (UID: \"92ef8199-a528-4240-b439-f7ea2a677307\") " pod="openshift-ingress-canary/ingress-canary-xlhvh"
Jul 24 13:38:59.680204 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.680135    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65da1b68-61f6-4171-b9fe-270a84cdd52f-installation-pull-secrets\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.684580 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.684555    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqcpt\" (UniqueName: \"kubernetes.io/projected/92ef8199-a528-4240-b439-f7ea2a677307-kube-api-access-zqcpt\") pod \"ingress-canary-xlhvh\" (UID: \"92ef8199-a528-4240-b439-f7ea2a677307\") " pod="openshift-ingress-canary/ingress-canary-xlhvh"
Jul 24 13:38:59.684697 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.684621    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ck2w\" (UniqueName: \"kubernetes.io/projected/4cf4108d-bdcb-4215-bc72-22f3d28211c6-kube-api-access-7ck2w\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:38:59.685135 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.685090    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djzfp\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-kube-api-access-djzfp\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.685365 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.685342    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-bound-sa-token\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:38:59.782177 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.782092    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xlhvh"
Jul 24 13:38:59.912184 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:38:59.911984    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xlhvh"]
Jul 24 13:38:59.915802 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:38:59.915778    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ef8199_a528_4240_b439_f7ea2a677307.slice/crio-1519105637e6c433cfb28940ea005500190c2bdbc29fea0115a311069cb28dbb WatchSource:0}: Error finding container 1519105637e6c433cfb28940ea005500190c2bdbc29fea0115a311069cb28dbb: Status 404 returned error can't find the container with id 1519105637e6c433cfb28940ea005500190c2bdbc29fea0115a311069cb28dbb
Jul 24 13:39:00.180566 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:00.180432    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:39:00.180566 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:00.180482    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:39:00.180808 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:00.180597    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:39:00.180808 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:00.180603    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:39:00.180808 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:00.180608    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798bff4796-njxgv: secret "image-registry-tls" not found
Jul 24 13:39:00.180808 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:00.180698    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls podName:4cf4108d-bdcb-4215-bc72-22f3d28211c6 nodeName:}" failed. No retries permitted until 2026-07-24 13:39:01.180678539 +0000 UTC m=+36.542051821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls") pod "dns-default-j9254" (UID: "4cf4108d-bdcb-4215-bc72-22f3d28211c6") : secret "dns-default-metrics-tls" not found
Jul 24 13:39:00.180808 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:00.180729    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls podName:65da1b68-61f6-4171-b9fe-270a84cdd52f nodeName:}" failed. No retries permitted until 2026-07-24 13:39:01.180718235 +0000 UTC m=+36.542091516 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls") pod "image-registry-798bff4796-njxgv" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f") : secret "image-registry-tls" not found
Jul 24 13:39:00.382818 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:00.382787    2559 generic.go:356] "Generic (PLEG): container finished" podID="ac8d35e5-33f2-4a50-acc1-3da0ca98806f" containerID="8263a01e6d03875c005a6211bbb7f2e32491d67dc0079d792c96583921210a64" exitCode=0
Jul 24 13:39:00.383030 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:00.382880    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2c8sd" event={"ID":"ac8d35e5-33f2-4a50-acc1-3da0ca98806f","Type":"ContainerDied","Data":"8263a01e6d03875c005a6211bbb7f2e32491d67dc0079d792c96583921210a64"}
Jul 24 13:39:00.383956 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:00.383937    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xlhvh" event={"ID":"92ef8199-a528-4240-b439-f7ea2a677307","Type":"ContainerStarted","Data":"1519105637e6c433cfb28940ea005500190c2bdbc29fea0115a311069cb28dbb"}
Jul 24 13:39:01.188732 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:01.188697    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:39:01.189322 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:01.188747    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:39:01.189322 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:01.188873    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:39:01.189322 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:01.188891    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798bff4796-njxgv: secret "image-registry-tls" not found
Jul 24 13:39:01.189322 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:01.188950    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls podName:65da1b68-61f6-4171-b9fe-270a84cdd52f nodeName:}" failed. No retries permitted until 2026-07-24 13:39:03.1889314 +0000 UTC m=+38.550304681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls") pod "image-registry-798bff4796-njxgv" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f") : secret "image-registry-tls" not found
Jul 24 13:39:01.189322 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:01.188872    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:39:01.189322 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:01.189008    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls podName:4cf4108d-bdcb-4215-bc72-22f3d28211c6 nodeName:}" failed. No retries permitted until 2026-07-24 13:39:03.188994282 +0000 UTC m=+38.550367562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls") pod "dns-default-j9254" (UID: "4cf4108d-bdcb-4215-bc72-22f3d28211c6") : secret "dns-default-metrics-tls" not found
Jul 24 13:39:01.192301 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:01.192274    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:39:01.192434 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:01.192389    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:39:01.192434 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:01.192401    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:39:01.195142 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:01.195125    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 13:39:01.196349 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:01.196069    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 13:39:01.196349 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:01.196111    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 13:39:01.196349 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:01.196127    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bnhnl\""
Jul 24 13:39:01.196349 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:01.196145    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 13:39:01.196349 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:01.196079    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8v4t2\""
Jul 24 13:39:01.390445 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:01.390407    2559 generic.go:356] "Generic (PLEG): container finished" podID="ac8d35e5-33f2-4a50-acc1-3da0ca98806f" containerID="bcf7490c9105aa2201905c1028a680a73a090cdb6091de81a4646055845edba4" exitCode=0
Jul 24 13:39:01.390614 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:01.390487    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2c8sd" event={"ID":"ac8d35e5-33f2-4a50-acc1-3da0ca98806f","Type":"ContainerDied","Data":"bcf7490c9105aa2201905c1028a680a73a090cdb6091de81a4646055845edba4"}
Jul 24 13:39:02.395837 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:02.395806    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2c8sd" event={"ID":"ac8d35e5-33f2-4a50-acc1-3da0ca98806f","Type":"ContainerStarted","Data":"9c622e359b8df716a2dc666e9e3cc02f18618ec0d1d8b755ca16486c024b8485"}
Jul 24 13:39:02.422948 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:02.422892    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2c8sd" podStartSLOduration=8.73303008 podStartE2EDuration="37.422875071s" totalImagesPullingTime="28.689844991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:38:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:02.422235938 +0000 UTC m=+37.783609241" watchObservedRunningTime="2026-07-24 13:39:02.422875071 +0000 UTC m=+37.784248369"
Jul 24 13:39:03.205190 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:03.205009    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:39:03.205318 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:03.205250    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:39:03.205318 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:03.205161    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:39:03.205318 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:03.205300    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798bff4796-njxgv: secret "image-registry-tls" not found
Jul 24 13:39:03.205419 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:03.205330    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:39:03.205419 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:03.205349    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls podName:65da1b68-61f6-4171-b9fe-270a84cdd52f nodeName:}" failed. No retries permitted until 2026-07-24 13:39:07.205332778 +0000 UTC m=+42.566706061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls") pod "image-registry-798bff4796-njxgv" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f") : secret "image-registry-tls" not found
Jul 24 13:39:03.205419 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:03.205377    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls podName:4cf4108d-bdcb-4215-bc72-22f3d28211c6 nodeName:}" failed. No retries permitted until 2026-07-24 13:39:07.205364164 +0000 UTC m=+42.566737444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls") pod "dns-default-j9254" (UID: "4cf4108d-bdcb-4215-bc72-22f3d28211c6") : secret "dns-default-metrics-tls" not found
Jul 24 13:39:03.399481 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:03.399361    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xlhvh" event={"ID":"92ef8199-a528-4240-b439-f7ea2a677307","Type":"ContainerStarted","Data":"c3a9314f45726eb8f08ca854b7c0a5f27a56da3c26bf04a8e38b20b58efcbd5b"}
Jul 24 13:39:03.415161 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:03.415107    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xlhvh" podStartSLOduration=1.847180823 podStartE2EDuration="4.415087421s" totalImagesPullingTime="2.567906598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:03.414915687 +0000 UTC m=+38.776288991" watchObservedRunningTime="2026-07-24 13:39:03.415087421 +0000 UTC m=+38.776460724"
Jul 24 13:39:07.233208 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:07.233175    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:39:07.233597 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:07.233256    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:39:07.233597 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:07.233337    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:39:07.233597 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:07.233352    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:39:07.233597 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:07.233353    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798bff4796-njxgv: secret "image-registry-tls" not found
Jul 24 13:39:07.233597 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:07.233406    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls podName:4cf4108d-bdcb-4215-bc72-22f3d28211c6 nodeName:}" failed. No retries permitted until 2026-07-24 13:39:15.233393322 +0000 UTC m=+50.594766607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls") pod "dns-default-j9254" (UID: "4cf4108d-bdcb-4215-bc72-22f3d28211c6") : secret "dns-default-metrics-tls" not found
Jul 24 13:39:07.233597 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:07.233421    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls podName:65da1b68-61f6-4171-b9fe-270a84cdd52f nodeName:}" failed. No retries permitted until 2026-07-24 13:39:15.233414978 +0000 UTC m=+50.594788259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls") pod "image-registry-798bff4796-njxgv" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f") : secret "image-registry-tls" not found
Jul 24 13:39:15.295578 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:15.295540    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:39:15.296069 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:15.295592    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:39:15.296069 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:15.295696    2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 24 13:39:15.296069 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:15.295701    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 24 13:39:15.296069 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:15.295778    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls podName:4cf4108d-bdcb-4215-bc72-22f3d28211c6 nodeName:}" failed. No retries permitted until 2026-07-24 13:39:31.295760969 +0000 UTC m=+66.657134250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls") pod "dns-default-j9254" (UID: "4cf4108d-bdcb-4215-bc72-22f3d28211c6") : secret "dns-default-metrics-tls" not found
Jul 24 13:39:15.296069 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:15.295706    2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798bff4796-njxgv: secret "image-registry-tls" not found
Jul 24 13:39:15.296069 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:15.295848    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls podName:65da1b68-61f6-4171-b9fe-270a84cdd52f nodeName:}" failed. No retries permitted until 2026-07-24 13:39:31.295834245 +0000 UTC m=+66.657207529 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls") pod "image-registry-798bff4796-njxgv" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f") : secret "image-registry-tls" not found
Jul 24 13:39:25.377778 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:25.377749    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvrjm"
Jul 24 13:39:30.804451 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:30.804401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:39:30.804917 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:30.804503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs\") pod \"network-metrics-daemon-d5zgw\" (UID: \"694de45f-b515-47c3-a8a7-5f0f1889c685\") " pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:39:30.807278 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:30.807259    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 24 13:39:30.807811 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:30.807797    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 24 13:39:30.819350 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:30.819329    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98ca09e8-a638-4eba-a4d8-49c66f7b4a37-original-pull-secret\") pod \"global-pull-secret-syncer-djnpp\" (UID: \"98ca09e8-a638-4eba-a4d8-49c66f7b4a37\") " pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:39:30.819412 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:30.819329    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/694de45f-b515-47c3-a8a7-5f0f1889c685-metrics-certs\") pod \"network-metrics-daemon-d5zgw\" (UID: \"694de45f-b515-47c3-a8a7-5f0f1889c685\") " pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:39:30.904891 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:30.904837    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv649\" (UniqueName: \"kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649\") pod \"network-check-target-hl7sr\" (UID: \"4bf6ccb9-124c-49cf-94ca-b58ea317f2ae\") " pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:39:30.907404 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:30.907387    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8v4t2\""
Jul 24 13:39:30.907464 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:30.907400    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 24 13:39:30.910724 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:30.910708    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-djnpp"
Jul 24 13:39:30.914831 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:30.914815    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5zgw"
Jul 24 13:39:30.917993 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:30.917980    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 24 13:39:30.929387 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:30.929360    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv649\" (UniqueName: \"kubernetes.io/projected/4bf6ccb9-124c-49cf-94ca-b58ea317f2ae-kube-api-access-pv649\") pod \"network-check-target-hl7sr\" (UID: \"4bf6ccb9-124c-49cf-94ca-b58ea317f2ae\") " pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:39:31.092013 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.091979    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-djnpp"]
Jul 24 13:39:31.095791 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:31.095761    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98ca09e8_a638_4eba_a4d8_49c66f7b4a37.slice/crio-18fde6168f0a842c3dc0c6a91da63ab5ad25c93e2f7f0af030aa7ddbc48008dd WatchSource:0}: Error finding container 18fde6168f0a842c3dc0c6a91da63ab5ad25c93e2f7f0af030aa7ddbc48008dd: Status 404 returned error can't find the container with id 18fde6168f0a842c3dc0c6a91da63ab5ad25c93e2f7f0af030aa7ddbc48008dd
Jul 24 13:39:31.108528 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.108504    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d5zgw"]
Jul 24 13:39:31.111319 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:31.111295    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694de45f_b515_47c3_a8a7_5f0f1889c685.slice/crio-a1a9481cce9595bbd8f3ecd046cd005ad33260929b5c5dc2ba4664713da9aa01 WatchSource:0}: Error finding container a1a9481cce9595bbd8f3ecd046cd005ad33260929b5c5dc2ba4664713da9aa01: Status 404 returned error can't find the container with id a1a9481cce9595bbd8f3ecd046cd005ad33260929b5c5dc2ba4664713da9aa01
Jul 24 13:39:31.220777 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.220743    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bnhnl\""
Jul 24 13:39:31.229639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.229611    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:39:31.309533 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.309499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:39:31.309668 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.309556    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:39:31.313300 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.312249    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cf4108d-bdcb-4215-bc72-22f3d28211c6-metrics-tls\") pod \"dns-default-j9254\" (UID: \"4cf4108d-bdcb-4215-bc72-22f3d28211c6\") " pod="openshift-dns/dns-default-j9254"
Jul 24 13:39:31.313300 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.312420    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls\") pod \"image-registry-798bff4796-njxgv\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") " pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:39:31.391429 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.391398    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hl7sr"]
Jul 24 13:39:31.393757 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:31.393728    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf6ccb9_124c_49cf_94ca_b58ea317f2ae.slice/crio-ecd8d294fcc8a2ccaab1b4dd73ff6acf9577c46f714f468da80e714fc1ca47e9 WatchSource:0}: Error finding container ecd8d294fcc8a2ccaab1b4dd73ff6acf9577c46f714f468da80e714fc1ca47e9: Status 404 returned error can't find the container with id ecd8d294fcc8a2ccaab1b4dd73ff6acf9577c46f714f468da80e714fc1ca47e9
Jul 24 13:39:31.468503 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.468467    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d5zgw" event={"ID":"694de45f-b515-47c3-a8a7-5f0f1889c685","Type":"ContainerStarted","Data":"a1a9481cce9595bbd8f3ecd046cd005ad33260929b5c5dc2ba4664713da9aa01"}
Jul 24 13:39:31.469722 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.469686    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-djnpp" event={"ID":"98ca09e8-a638-4eba-a4d8-49c66f7b4a37","Type":"ContainerStarted","Data":"18fde6168f0a842c3dc0c6a91da63ab5ad25c93e2f7f0af030aa7ddbc48008dd"}
Jul 24 13:39:31.470911 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.470888    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hl7sr" event={"ID":"4bf6ccb9-124c-49cf-94ca-b58ea317f2ae","Type":"ContainerStarted","Data":"ecd8d294fcc8a2ccaab1b4dd73ff6acf9577c46f714f468da80e714fc1ca47e9"}
Jul 24 13:39:31.575400 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.575355    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l24vv\""
Jul 24 13:39:31.580282 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.580257    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xl6tf\""
Jul 24 13:39:31.582183 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.582163    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:39:31.588514 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.588446    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j9254"
Jul 24 13:39:31.673670 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.673624    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-844758777-vlhpj"]
Jul 24 13:39:31.698089 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.695008    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"]
Jul 24 13:39:31.698089 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.695751    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.701575 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.699720    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 24 13:39:31.701575 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.700222    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-txzvv\""
Jul 24 13:39:31.701575 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.700391    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 24 13:39:31.701575 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.700436    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 24 13:39:31.701575 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.700557    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 24 13:39:31.701575 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.700591    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 24 13:39:31.701948 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.701642    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 24 13:39:31.713228 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.712141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-default-certificate\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.713228 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.712184    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-metrics-certs\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.713228 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.712227    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-service-ca-bundle\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.713228 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.712254    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jds8k\" (UniqueName: \"kubernetes.io/projected/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-kube-api-access-jds8k\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.713228 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.712289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-stats-auth\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.713228 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.712332    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"]
Jul 24 13:39:31.713228 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.712369    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-844758777-vlhpj"]
Jul 24 13:39:31.713228 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.712464    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"
Jul 24 13:39:31.716211 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.716060    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 24 13:39:31.716317 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.716274    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 24 13:39:31.716811 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.716629    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 24 13:39:31.716908 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.716838    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 24 13:39:31.774632 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.774600    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-798bff4796-njxgv"]
Jul 24 13:39:31.783787 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.782787    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd"]
Jul 24 13:39:31.784028 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:31.783949    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65da1b68_61f6_4171_b9fe_270a84cdd52f.slice/crio-0f13e4742951ab3b733a2b7dd14f4b0e1405d1e76f1016bbf866492560fe4aad WatchSource:0}: Error finding container 0f13e4742951ab3b733a2b7dd14f4b0e1405d1e76f1016bbf866492560fe4aad: Status 404 returned error can't find the container with id 0f13e4742951ab3b733a2b7dd14f4b0e1405d1e76f1016bbf866492560fe4aad
Jul 24 13:39:31.802884 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.802823    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j9254"]
Jul 24 13:39:31.803000 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.802895    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd"]
Jul 24 13:39:31.803113 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.803009    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd"
Jul 24 13:39:31.804235 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:31.804155    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf4108d_bdcb_4215_bc72_22f3d28211c6.slice/crio-66e98f7942d3e68d8af001119b7c007deeb857f049006afec0b707ab3ec07cd1 WatchSource:0}: Error finding container 66e98f7942d3e68d8af001119b7c007deeb857f049006afec0b707ab3ec07cd1: Status 404 returned error can't find the container with id 66e98f7942d3e68d8af001119b7c007deeb857f049006afec0b707ab3ec07cd1
Jul 24 13:39:31.805910 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.805736    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 24 13:39:31.806298 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.806001    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:39:31.806298 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.806295    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lr6nl\""
Jul 24 13:39:31.806675 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.806647    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 24 13:39:31.812774 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.812747    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jds8k\" (UniqueName: \"kubernetes.io/projected/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-kube-api-access-jds8k\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.812886 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.812795    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-stats-auth\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.812886 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.812824    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4da9a66-65df-4853-98cb-c38215c81994-tmp\") pod \"klusterlet-addon-workmgr-85bb9f66df-bwjcr\" (UID: \"a4da9a66-65df-4853-98cb-c38215c81994\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"
Jul 24 13:39:31.812886 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.812876    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4w8j\" (UniqueName: \"kubernetes.io/projected/a4da9a66-65df-4853-98cb-c38215c81994-kube-api-access-r4w8j\") pod \"klusterlet-addon-workmgr-85bb9f66df-bwjcr\" (UID: \"a4da9a66-65df-4853-98cb-c38215c81994\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"
Jul 24 13:39:31.813055 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.812927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-default-certificate\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.813055 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.812961    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-metrics-certs\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.813055 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.812987    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a4da9a66-65df-4853-98cb-c38215c81994-klusterlet-config\") pod \"klusterlet-addon-workmgr-85bb9f66df-bwjcr\" (UID: \"a4da9a66-65df-4853-98cb-c38215c81994\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"
Jul 24 13:39:31.813055 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.813033    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-service-ca-bundle\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.814103 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.814056    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-service-ca-bundle\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.817168 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.817142    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-metrics-certs\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.818899 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.818870    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-stats-auth\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.819365 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.819345    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-default-certificate\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.841887 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.841787    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jds8k\" (UniqueName: \"kubernetes.io/projected/2c34fa6e-abb0-45d7-9ba6-5da2efa8388b-kube-api-access-jds8k\") pod \"router-default-844758777-vlhpj\" (UID: \"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b\") " pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:31.914427 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.914390    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4w8j\" (UniqueName: \"kubernetes.io/projected/a4da9a66-65df-4853-98cb-c38215c81994-kube-api-access-r4w8j\") pod \"klusterlet-addon-workmgr-85bb9f66df-bwjcr\" (UID: \"a4da9a66-65df-4853-98cb-c38215c81994\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"
Jul 24 13:39:31.914602 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.914454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a4da9a66-65df-4853-98cb-c38215c81994-klusterlet-config\") pod \"klusterlet-addon-workmgr-85bb9f66df-bwjcr\" (UID: \"a4da9a66-65df-4853-98cb-c38215c81994\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"
Jul 24 13:39:31.914602 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.914481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/be4802a8-3808-4677-b629-a84b646ebeb0-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wwkqd\" (UID: \"be4802a8-3808-4677-b629-a84b646ebeb0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd"
Jul 24 13:39:31.914602 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.914509    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgtwb\" (UniqueName: \"kubernetes.io/projected/be4802a8-3808-4677-b629-a84b646ebeb0-kube-api-access-xgtwb\") pod \"cluster-samples-operator-6748489656-wwkqd\" (UID: \"be4802a8-3808-4677-b629-a84b646ebeb0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd"
Jul 24 13:39:31.914602 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.914545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4da9a66-65df-4853-98cb-c38215c81994-tmp\") pod \"klusterlet-addon-workmgr-85bb9f66df-bwjcr\" (UID: \"a4da9a66-65df-4853-98cb-c38215c81994\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"
Jul 24 13:39:31.915060 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.915010    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a4da9a66-65df-4853-98cb-c38215c81994-tmp\") pod \"klusterlet-addon-workmgr-85bb9f66df-bwjcr\" (UID: \"a4da9a66-65df-4853-98cb-c38215c81994\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"
Jul 24 13:39:31.917398 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.917367    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a4da9a66-65df-4853-98cb-c38215c81994-klusterlet-config\") pod \"klusterlet-addon-workmgr-85bb9f66df-bwjcr\" (UID: \"a4da9a66-65df-4853-98cb-c38215c81994\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"
Jul 24 13:39:31.927339 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:31.927311    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4w8j\" (UniqueName: \"kubernetes.io/projected/a4da9a66-65df-4853-98cb-c38215c81994-kube-api-access-r4w8j\") pod \"klusterlet-addon-workmgr-85bb9f66df-bwjcr\" (UID: \"a4da9a66-65df-4853-98cb-c38215c81994\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"
Jul 24 13:39:32.013904 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.013869    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:32.015613 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.015443    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/be4802a8-3808-4677-b629-a84b646ebeb0-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wwkqd\" (UID: \"be4802a8-3808-4677-b629-a84b646ebeb0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd"
Jul 24 13:39:32.015613 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.015519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgtwb\" (UniqueName: \"kubernetes.io/projected/be4802a8-3808-4677-b629-a84b646ebeb0-kube-api-access-xgtwb\") pod \"cluster-samples-operator-6748489656-wwkqd\" (UID: \"be4802a8-3808-4677-b629-a84b646ebeb0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd"
Jul 24 13:39:32.019457 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.019431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/be4802a8-3808-4677-b629-a84b646ebeb0-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-wwkqd\" (UID: \"be4802a8-3808-4677-b629-a84b646ebeb0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd"
Jul 24 13:39:32.027075 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.027047    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"
Jul 24 13:39:32.028962 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.028911    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgtwb\" (UniqueName: \"kubernetes.io/projected/be4802a8-3808-4677-b629-a84b646ebeb0-kube-api-access-xgtwb\") pod \"cluster-samples-operator-6748489656-wwkqd\" (UID: \"be4802a8-3808-4677-b629-a84b646ebeb0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd"
Jul 24 13:39:32.116713 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.116617    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd"
Jul 24 13:39:32.480006 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.479272    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-798bff4796-njxgv" event={"ID":"65da1b68-61f6-4171-b9fe-270a84cdd52f","Type":"ContainerStarted","Data":"a9d6356fe9725ba5a6b9d72078f4cb2f0ea5075f6f17503887bec8361d91a553"}
Jul 24 13:39:32.480155 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.480070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-798bff4796-njxgv" event={"ID":"65da1b68-61f6-4171-b9fe-270a84cdd52f","Type":"ContainerStarted","Data":"0f13e4742951ab3b733a2b7dd14f4b0e1405d1e76f1016bbf866492560fe4aad"}
Jul 24 13:39:32.480155 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.480100    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:39:32.482310 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.482268    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j9254" event={"ID":"4cf4108d-bdcb-4215-bc72-22f3d28211c6","Type":"ContainerStarted","Data":"66e98f7942d3e68d8af001119b7c007deeb857f049006afec0b707ab3ec07cd1"}
Jul 24 13:39:32.502674 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.502615    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-798bff4796-njxgv" podStartSLOduration=68.502593629 podStartE2EDuration="1m8.502593629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:38:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:32.501489871 +0000 UTC m=+67.862863175" watchObservedRunningTime="2026-07-24 13:39:32.502593629 +0000 UTC m=+67.863966933"
Jul 24 13:39:32.536661 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.536472    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"]
Jul 24 13:39:32.544139 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.544073    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-844758777-vlhpj"]
Jul 24 13:39:32.572371 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:32.572309    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd"]
Jul 24 13:39:32.673030 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:32.672425    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4da9a66_65df_4853_98cb_c38215c81994.slice/crio-1cf7b8f25d406db26920b97e4ad0f40d0e997e340eb41c825fc104684f7fa568 WatchSource:0}: Error finding container 1cf7b8f25d406db26920b97e4ad0f40d0e997e340eb41c825fc104684f7fa568: Status 404 returned error can't find the container with id 1cf7b8f25d406db26920b97e4ad0f40d0e997e340eb41c825fc104684f7fa568
Jul 24 13:39:32.674174 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:32.673985    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c34fa6e_abb0_45d7_9ba6_5da2efa8388b.slice/crio-b6dbcf8a74c001d790a7baa4b318ffe6fc3cf2212c7bba85cdaadb4fcfeaf485 WatchSource:0}: Error finding container b6dbcf8a74c001d790a7baa4b318ffe6fc3cf2212c7bba85cdaadb4fcfeaf485: Status 404 returned error can't find the container with id b6dbcf8a74c001d790a7baa4b318ffe6fc3cf2212c7bba85cdaadb4fcfeaf485
Jul 24 13:39:33.489538 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:33.489499    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr" event={"ID":"a4da9a66-65df-4853-98cb-c38215c81994","Type":"ContainerStarted","Data":"1cf7b8f25d406db26920b97e4ad0f40d0e997e340eb41c825fc104684f7fa568"}
Jul 24 13:39:33.493252 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:33.493222    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-844758777-vlhpj" event={"ID":"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b","Type":"ContainerStarted","Data":"ef72ada8731bdb8734c01e45a41cde4f990fbbd7f4053aea953f085c9094464d"}
Jul 24 13:39:33.493356 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:33.493274    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-844758777-vlhpj" event={"ID":"2c34fa6e-abb0-45d7-9ba6-5da2efa8388b","Type":"ContainerStarted","Data":"b6dbcf8a74c001d790a7baa4b318ffe6fc3cf2212c7bba85cdaadb4fcfeaf485"}
Jul 24 13:39:33.498186 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:33.496678    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d5zgw" event={"ID":"694de45f-b515-47c3-a8a7-5f0f1889c685","Type":"ContainerStarted","Data":"12cd52fe2e9bd91dc66c609ca423f83e6ff5f628aa3d18bac6b3d51ccc350cec"}
Jul 24 13:39:33.498186 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:33.496737    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d5zgw" event={"ID":"694de45f-b515-47c3-a8a7-5f0f1889c685","Type":"ContainerStarted","Data":"4b235ece0352c48c3f48eb08cee939224aad6cddb8c0991b3ea7306e0c4b4ff0"}
Jul 24 13:39:33.499699 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:33.499675    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd" event={"ID":"be4802a8-3808-4677-b629-a84b646ebeb0","Type":"ContainerStarted","Data":"5f2cd41c84edf83b3946295440a2f9ffea5192ee3ac5632f19f83313f1043d90"}
Jul 24 13:39:33.514568 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:33.514095    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-844758777-vlhpj" podStartSLOduration=2.5140756079999997 podStartE2EDuration="2.514075608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:33.512897298 +0000 UTC m=+68.874270603" watchObservedRunningTime="2026-07-24 13:39:33.514075608 +0000 UTC m=+68.875448915"
Jul 24 13:39:33.530019 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:33.529969    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d5zgw" podStartSLOduration=66.95015113 podStartE2EDuration="1m8.529951107s" totalImagesPullingTime="1.579799977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:33.529420368 +0000 UTC m=+68.890793668" watchObservedRunningTime="2026-07-24 13:39:33.529951107 +0000 UTC m=+68.891324412"
Jul 24 13:39:34.016670 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:34.015363    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:34.018693 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:34.018553    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:34.508308 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:34.506449    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:34.508308 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:34.508032    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-844758777-vlhpj"
Jul 24 13:39:39.133629 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.133580    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q8w4g"]
Jul 24 13:39:39.136423 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.136400    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.139435 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.139407    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 24 13:39:39.139974 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.139919    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 24 13:39:39.140106 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.139973    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 24 13:39:39.140106 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.139986    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bbx6j\""
Jul 24 13:39:39.140106 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.140026    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 24 13:39:39.150289 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.150268    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q8w4g"]
Jul 24 13:39:39.177774 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.175565    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5nbv\" (UniqueName: \"kubernetes.io/projected/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-api-access-c5nbv\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.177774 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.175631    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76db45b2-91ed-4a49-9db7-3d01bacf33ce-crio-socket\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.177774 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.175677    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76db45b2-91ed-4a49-9db7-3d01bacf33ce-data-volume\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.177774 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.175718    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.177774 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.175750    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.276232 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.276189    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76db45b2-91ed-4a49-9db7-3d01bacf33ce-data-volume\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.276424 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.276252    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.276424 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.276287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.276424 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.276326    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5nbv\" (UniqueName: \"kubernetes.io/projected/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-api-access-c5nbv\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.276424 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.276368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76db45b2-91ed-4a49-9db7-3d01bacf33ce-crio-socket\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.276610 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:39.276427    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:39:39.276610 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.276463    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76db45b2-91ed-4a49-9db7-3d01bacf33ce-crio-socket\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.276610 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:39.276476    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:39:39.276610 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:39.276520    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm podName:76db45b2-91ed-4a49-9db7-3d01bacf33ce nodeName:}" failed. No retries permitted until 2026-07-24 13:39:39.77649722 +0000 UTC m=+75.137870514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8w4g" (UID: "76db45b2-91ed-4a49-9db7-3d01bacf33ce") : configmap "kube-rbac-proxy" not found
Jul 24 13:39:39.276610 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:39.276538    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls podName:76db45b2-91ed-4a49-9db7-3d01bacf33ce nodeName:}" failed. No retries permitted until 2026-07-24 13:39:39.776528992 +0000 UTC m=+75.137902273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8w4g" (UID: "76db45b2-91ed-4a49-9db7-3d01bacf33ce") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:39:39.276829 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.276609    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76db45b2-91ed-4a49-9db7-3d01bacf33ce-data-volume\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.284400 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.284372    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5nbv\" (UniqueName: \"kubernetes.io/projected/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-api-access-c5nbv\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.534123 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.534021    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j9254" event={"ID":"4cf4108d-bdcb-4215-bc72-22f3d28211c6","Type":"ContainerStarted","Data":"d781ecfd68d15960618155e777ce1bd190c79711821701e9716208b51418dae5"}
Jul 24 13:39:39.537047 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.536285    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hl7sr" event={"ID":"4bf6ccb9-124c-49cf-94ca-b58ea317f2ae","Type":"ContainerStarted","Data":"4add2b5cfe1ee96805694025c6ec3328ab6a9b7da9e42acaacc4513f940b9575"}
Jul 24 13:39:39.537047 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.536991    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:39:39.539139 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.539061    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd" event={"ID":"be4802a8-3808-4677-b629-a84b646ebeb0","Type":"ContainerStarted","Data":"2028f476d4d41bf66136147527f959816e9d160eadbaae5d3a38143a67ef0ed2"}
Jul 24 13:39:39.543812 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.543775    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr" event={"ID":"a4da9a66-65df-4853-98cb-c38215c81994","Type":"ContainerStarted","Data":"0bdfd43de846104fe06fb99050e48112a8b781c360e6456775b4c25655fb9a03"}
Jul 24 13:39:39.543964 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.543841    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"
Jul 24 13:39:39.547354 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.547300    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr"
Jul 24 13:39:39.554937 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.554832    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hl7sr" podStartSLOduration=66.550237917 podStartE2EDuration="1m14.554818669s" totalImagesPullingTime="8.004580752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:39.553995915 +0000 UTC m=+74.915369219" watchObservedRunningTime="2026-07-24 13:39:39.554818669 +0000 UTC m=+74.916191965"
Jul 24 13:39:39.574662 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.573468    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85bb9f66df-bwjcr" podStartSLOduration=1.837399064 podStartE2EDuration="8.573448244s" totalImagesPullingTime="6.73604918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:39.572739306 +0000 UTC m=+74.934112608" watchObservedRunningTime="2026-07-24 13:39:39.573448244 +0000 UTC m=+74.934821548"
Jul 24 13:39:39.779917 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.779879    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.779917 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:39.779918    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:39.780152 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:39.780008    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:39:39.780152 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:39.780021    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:39:39.780152 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:39.780071    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls podName:76db45b2-91ed-4a49-9db7-3d01bacf33ce nodeName:}" failed. No retries permitted until 2026-07-24 13:39:40.780058581 +0000 UTC m=+76.141431865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8w4g" (UID: "76db45b2-91ed-4a49-9db7-3d01bacf33ce") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:39:39.780152 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:39.780100    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm podName:76db45b2-91ed-4a49-9db7-3d01bacf33ce nodeName:}" failed. No retries permitted until 2026-07-24 13:39:40.780082308 +0000 UTC m=+76.141455589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8w4g" (UID: "76db45b2-91ed-4a49-9db7-3d01bacf33ce") : configmap "kube-rbac-proxy" not found
Jul 24 13:39:40.547498 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:40.547462    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-djnpp" event={"ID":"98ca09e8-a638-4eba-a4d8-49c66f7b4a37","Type":"ContainerStarted","Data":"b58670c72c038c76044112fa0c14c519154049b97e03dacf290596ab341c05d0"}
Jul 24 13:39:40.549100 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:40.549077    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j9254" event={"ID":"4cf4108d-bdcb-4215-bc72-22f3d28211c6","Type":"ContainerStarted","Data":"65a78a23a837385281a38c998386cd4b979df65ca24c776f89bdfea8bbf98d1c"}
Jul 24 13:39:40.549277 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:40.549132    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j9254"
Jul 24 13:39:40.550767 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:40.550747    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd" event={"ID":"be4802a8-3808-4677-b629-a84b646ebeb0","Type":"ContainerStarted","Data":"bd3995f2bd5b182865b63e042e61bf0e183ea832bf030603581cb44510f5f1fd"}
Jul 24 13:39:40.563586 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:40.563551    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-djnpp" podStartSLOduration=67.261095758 podStartE2EDuration="1m15.563538005s" totalImagesPullingTime="8.302442247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:40.562956237 +0000 UTC m=+75.924329541" watchObservedRunningTime="2026-07-24 13:39:40.563538005 +0000 UTC m=+75.924911320"
Jul 24 13:39:40.580572 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:40.580533    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j9254" podStartSLOduration=34.013210384 podStartE2EDuration="41.580521292s" totalImagesPullingTime="7.567310908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:40.579202439 +0000 UTC m=+75.940575743" watchObservedRunningTime="2026-07-24 13:39:40.580521292 +0000 UTC m=+75.941894604"
Jul 24 13:39:40.595054 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:40.595013    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-wwkqd" podStartSLOduration=2.945339345 podStartE2EDuration="9.59500031s" totalImagesPullingTime="6.649660965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:40.593975181 +0000 UTC m=+75.955348484" watchObservedRunningTime="2026-07-24 13:39:40.59500031 +0000 UTC m=+75.956373603"
Jul 24 13:39:40.788228 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:40.788174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:40.788428 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:40.788238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:40.788428 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:40.788315    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:39:40.788428 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:40.788365    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:39:40.788428 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:40.788385    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm podName:76db45b2-91ed-4a49-9db7-3d01bacf33ce nodeName:}" failed. No retries permitted until 2026-07-24 13:39:42.788368609 +0000 UTC m=+78.149741890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8w4g" (UID: "76db45b2-91ed-4a49-9db7-3d01bacf33ce") : configmap "kube-rbac-proxy" not found
Jul 24 13:39:40.788428 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:40.788413    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls podName:76db45b2-91ed-4a49-9db7-3d01bacf33ce nodeName:}" failed. No retries permitted until 2026-07-24 13:39:42.788398346 +0000 UTC m=+78.149771628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8w4g" (UID: "76db45b2-91ed-4a49-9db7-3d01bacf33ce") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:39:41.318784 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.318754    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dlfwk_6fc9b45b-0545-43b7-8054-c134b3145ab3/dns-node-resolver/0.log"
Jul 24 13:39:41.717801 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.717767    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-798bff4796-njxgv_65da1b68-61f6-4171-b9fe-270a84cdd52f/registry/0.log"
Jul 24 13:39:41.745618 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.745592    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"]
Jul 24 13:39:41.747673 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.747659    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:41.750639 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.750621    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8tr92\""
Jul 24 13:39:41.750747 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.750684    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 24 13:39:41.752228 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.752211    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 24 13:39:41.752314 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.752300    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 24 13:39:41.752369 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.752316    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 24 13:39:41.752425 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.752409    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 24 13:39:41.760075 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.760057    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"]
Jul 24 13:39:41.800108 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.800080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5vsq\" (UniqueName: \"kubernetes.io/projected/44de8ee9-714e-4dc1-af88-550c58cf190d-kube-api-access-m5vsq\") pod \"prometheus-operator-84d69f794d-qqbqm\" (UID: \"44de8ee9-714e-4dc1-af88-550c58cf190d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:41.800235 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.800114    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/44de8ee9-714e-4dc1-af88-550c58cf190d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-qqbqm\" (UID: \"44de8ee9-714e-4dc1-af88-550c58cf190d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:41.800235 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.800189    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44de8ee9-714e-4dc1-af88-550c58cf190d-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-qqbqm\" (UID: \"44de8ee9-714e-4dc1-af88-550c58cf190d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:41.800235 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.800209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44de8ee9-714e-4dc1-af88-550c58cf190d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-qqbqm\" (UID: \"44de8ee9-714e-4dc1-af88-550c58cf190d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:41.901015 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.900976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5vsq\" (UniqueName: \"kubernetes.io/projected/44de8ee9-714e-4dc1-af88-550c58cf190d-kube-api-access-m5vsq\") pod \"prometheus-operator-84d69f794d-qqbqm\" (UID: \"44de8ee9-714e-4dc1-af88-550c58cf190d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:41.901015 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.901015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/44de8ee9-714e-4dc1-af88-550c58cf190d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-qqbqm\" (UID: \"44de8ee9-714e-4dc1-af88-550c58cf190d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:41.901234 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.901159    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44de8ee9-714e-4dc1-af88-550c58cf190d-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-qqbqm\" (UID: \"44de8ee9-714e-4dc1-af88-550c58cf190d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:41.901234 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.901188    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44de8ee9-714e-4dc1-af88-550c58cf190d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-qqbqm\" (UID: \"44de8ee9-714e-4dc1-af88-550c58cf190d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:41.901814 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.901788    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44de8ee9-714e-4dc1-af88-550c58cf190d-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-qqbqm\" (UID: \"44de8ee9-714e-4dc1-af88-550c58cf190d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:41.903446 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.903423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/44de8ee9-714e-4dc1-af88-550c58cf190d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-qqbqm\" (UID: \"44de8ee9-714e-4dc1-af88-550c58cf190d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:41.903564 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.903498    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/44de8ee9-714e-4dc1-af88-550c58cf190d-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-qqbqm\" (UID: \"44de8ee9-714e-4dc1-af88-550c58cf190d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:41.909796 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:41.909775    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5vsq\" (UniqueName: \"kubernetes.io/projected/44de8ee9-714e-4dc1-af88-550c58cf190d-kube-api-access-m5vsq\") pod \"prometheus-operator-84d69f794d-qqbqm\" (UID: \"44de8ee9-714e-4dc1-af88-550c58cf190d\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:42.056808 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:42.056730    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"
Jul 24 13:39:42.115758 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:42.115731    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fwzrj_1bc58137-000f-4dc7-8ced-06ec20f72052/node-ca/0.log"
Jul 24 13:39:42.177986 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:42.177955    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-qqbqm"]
Jul 24 13:39:42.180681 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:42.180660    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44de8ee9_714e_4dc1_af88_550c58cf190d.slice/crio-428aabd6b342dde4484caa3014564027615e6781324133eea2d5432f56a6358f WatchSource:0}: Error finding container 428aabd6b342dde4484caa3014564027615e6781324133eea2d5432f56a6358f: Status 404 returned error can't find the container with id 428aabd6b342dde4484caa3014564027615e6781324133eea2d5432f56a6358f
Jul 24 13:39:42.557951 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:42.557915    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm" event={"ID":"44de8ee9-714e-4dc1-af88-550c58cf190d","Type":"ContainerStarted","Data":"428aabd6b342dde4484caa3014564027615e6781324133eea2d5432f56a6358f"}
Jul 24 13:39:42.718479 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:42.718451    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-844758777-vlhpj_2c34fa6e-abb0-45d7-9ba6-5da2efa8388b/router/0.log"
Jul 24 13:39:42.809932 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:42.809834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:42.809932 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:42.809904    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:42.810192 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:42.809955    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 24 13:39:42.810192 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:42.810036    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm podName:76db45b2-91ed-4a49-9db7-3d01bacf33ce nodeName:}" failed. No retries permitted until 2026-07-24 13:39:46.810015472 +0000 UTC m=+82.171388755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-q8w4g" (UID: "76db45b2-91ed-4a49-9db7-3d01bacf33ce") : configmap "kube-rbac-proxy" not found
Jul 24 13:39:42.810192 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:42.810078    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 24 13:39:42.810192 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:42.810138    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls podName:76db45b2-91ed-4a49-9db7-3d01bacf33ce nodeName:}" failed. No retries permitted until 2026-07-24 13:39:46.810121181 +0000 UTC m=+82.171494470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-q8w4g" (UID: "76db45b2-91ed-4a49-9db7-3d01bacf33ce") : secret "insights-runtime-extractor-tls" not found
Jul 24 13:39:43.315371 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:43.315348    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xlhvh_92ef8199-a528-4240-b439-f7ea2a677307/serve-healthcheck-canary/0.log"
Jul 24 13:39:43.563945 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:43.563847    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm" event={"ID":"44de8ee9-714e-4dc1-af88-550c58cf190d","Type":"ContainerStarted","Data":"f2b6555a280d6db7b9ce2c55632eef64907c63fa1a9c987cf905cff5f1833079"}
Jul 24 13:39:43.563945 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:43.563914    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm" event={"ID":"44de8ee9-714e-4dc1-af88-550c58cf190d","Type":"ContainerStarted","Data":"82a7b3a9e80f03c5c6aa6c33e84c68740be69addb29e985346440a6de90b4c81"}
Jul 24 13:39:43.586087 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:43.586043    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-qqbqm" podStartSLOduration=1.468439745 podStartE2EDuration="2.586029203s" totalImagesPullingTime="1.117589458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:43.585486784 +0000 UTC m=+78.946860088" watchObservedRunningTime="2026-07-24 13:39:43.586029203 +0000 UTC m=+78.947402505"
Jul 24 13:39:45.071304 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.071271    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"]
Jul 24 13:39:45.073265 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.073250    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.075740 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.075715    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 24 13:39:45.075740 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.075734    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 24 13:39:45.076004 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.075991    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-td9xg\""
Jul 24 13:39:45.086354 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.086333    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"]
Jul 24 13:39:45.102822 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.102793    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g8br8"]
Jul 24 13:39:45.104865 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.104841    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.107225 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.107201    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"]
Jul 24 13:39:45.108068 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.108045    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 24 13:39:45.108068 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.108060    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xbctl\""
Jul 24 13:39:45.108225 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.108054    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 24 13:39:45.108380 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.108364    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 24 13:39:45.109337 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.109322    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.111544 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.111525    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hzdwc\""
Jul 24 13:39:45.111811 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.111788    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 24 13:39:45.111956 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.111934    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 24 13:39:45.112018 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.111984    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 24 13:39:45.120945 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.120927    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"]
Jul 24 13:39:45.133384 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.133359    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-98mvw\" (UID: \"a5d7d804-a7f1-4a2f-aea0-2306aafca41e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.133498 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.133391    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-98mvw\" (UID: \"a5d7d804-a7f1-4a2f-aea0-2306aafca41e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.133498 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.133415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfnpm\" (UniqueName: \"kubernetes.io/projected/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-kube-api-access-hfnpm\") pod \"openshift-state-metrics-b8f49f5c6-98mvw\" (UID: \"a5d7d804-a7f1-4a2f-aea0-2306aafca41e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.133498 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.133452    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-98mvw\" (UID: \"a5d7d804-a7f1-4a2f-aea0-2306aafca41e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.233988 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.233952    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b2f7fb2-4227-4b29-a184-f96807d92797-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.234165 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.233993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfnpm\" (UniqueName: \"kubernetes.io/projected/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-kube-api-access-hfnpm\") pod \"openshift-state-metrics-b8f49f5c6-98mvw\" (UID: \"a5d7d804-a7f1-4a2f-aea0-2306aafca41e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.234165 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234014    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-textfile\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.234165 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234050    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-98mvw\" (UID: \"a5d7d804-a7f1-4a2f-aea0-2306aafca41e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.234165 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b2f7fb2-4227-4b29-a184-f96807d92797-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.234165 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234102    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v9v2\" (UniqueName: \"kubernetes.io/projected/3b2f7fb2-4227-4b29-a184-f96807d92797-kube-api-access-6v9v2\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.234165 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234130    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-wtmp\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.234165 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234149    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.234165 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234167    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-sys\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.234412 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:45.234192    2559 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 24 13:39:45.234412 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234196    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b2f7fb2-4227-4b29-a184-f96807d92797-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.234412 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:45.234251    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-openshift-state-metrics-tls podName:a5d7d804-a7f1-4a2f-aea0-2306aafca41e nodeName:}" failed. No retries permitted until 2026-07-24 13:39:45.734232858 +0000 UTC m=+81.095606143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-98mvw" (UID: "a5d7d804-a7f1-4a2f-aea0-2306aafca41e") : secret "openshift-state-metrics-tls" not found
Jul 24 13:39:45.234412 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmbk5\" (UniqueName: \"kubernetes.io/projected/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-kube-api-access-jmbk5\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.234412 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234343    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-tls\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.234412 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234394    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b2f7fb2-4227-4b29-a184-f96807d92797-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.234617 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-metrics-client-ca\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.234617 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234460    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b2f7fb2-4227-4b29-a184-f96807d92797-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.234617 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234504    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-98mvw\" (UID: \"a5d7d804-a7f1-4a2f-aea0-2306aafca41e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.234617 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234536    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-98mvw\" (UID: \"a5d7d804-a7f1-4a2f-aea0-2306aafca41e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.234617 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234557    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-root\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.234617 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.234577    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-accelerators-collector-config\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.235130 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.235110    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-98mvw\" (UID: \"a5d7d804-a7f1-4a2f-aea0-2306aafca41e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.236809 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.236772    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-98mvw\" (UID: \"a5d7d804-a7f1-4a2f-aea0-2306aafca41e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.242448 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.242426    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfnpm\" (UniqueName: \"kubernetes.io/projected/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-kube-api-access-hfnpm\") pod \"openshift-state-metrics-b8f49f5c6-98mvw\" (UID: \"a5d7d804-a7f1-4a2f-aea0-2306aafca41e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.335130 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335049    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b2f7fb2-4227-4b29-a184-f96807d92797-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.335130 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-textfile\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.335318 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335292    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b2f7fb2-4227-4b29-a184-f96807d92797-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.335368 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335355    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v9v2\" (UniqueName: \"kubernetes.io/projected/3b2f7fb2-4227-4b29-a184-f96807d92797-kube-api-access-6v9v2\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.335419 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335388    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-textfile\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.335419 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335396    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-wtmp\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.335522 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335447    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.335522 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-sys\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.335522 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b2f7fb2-4227-4b29-a184-f96807d92797-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.335665 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335553    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-wtmp\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.335665 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335578    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-sys\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.335665 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335623    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmbk5\" (UniqueName: \"kubernetes.io/projected/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-kube-api-access-jmbk5\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.335826 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-tls\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.335826 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335742    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b2f7fb2-4227-4b29-a184-f96807d92797-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.335826 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335774    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-metrics-client-ca\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.335826 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b2f7fb2-4227-4b29-a184-f96807d92797-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.336051 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-root\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.336051 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335875    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3b2f7fb2-4227-4b29-a184-f96807d92797-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.336051 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.335891    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-accelerators-collector-config\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.336051 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:45.335907    2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 24 13:39:45.336051 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:39:45.335985    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-tls podName:c90e2a9a-1707-4b8c-ac09-356ecbf9252a nodeName:}" failed. No retries permitted until 2026-07-24 13:39:45.835964765 +0000 UTC m=+81.197338046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-tls") pod "node-exporter-g8br8" (UID: "c90e2a9a-1707-4b8c-ac09-356ecbf9252a") : secret "node-exporter-tls" not found
Jul 24 13:39:45.336345 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.336168    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3b2f7fb2-4227-4b29-a184-f96807d92797-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.336345 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.336248    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-root\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.336439 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.336395    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-metrics-client-ca\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.336516 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.336484    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-accelerators-collector-config\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.337164 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.337138    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b2f7fb2-4227-4b29-a184-f96807d92797-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.337960 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.337934    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b2f7fb2-4227-4b29-a184-f96807d92797-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.338069 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.338011    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.338203 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.338187    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b2f7fb2-4227-4b29-a184-f96807d92797-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.343654 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.343631    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmbk5\" (UniqueName: \"kubernetes.io/projected/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-kube-api-access-jmbk5\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.344091 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.344070    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v9v2\" (UniqueName: \"kubernetes.io/projected/3b2f7fb2-4227-4b29-a184-f96807d92797-kube-api-access-6v9v2\") pod \"kube-state-metrics-56d9f944b4-t6gbv\" (UID: \"3b2f7fb2-4227-4b29-a184-f96807d92797\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.421614 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.421580    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"
Jul 24 13:39:45.550741 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.550705    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv"]
Jul 24 13:39:45.568682 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:45.568656    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b2f7fb2_4227_4b29_a184_f96807d92797.slice/crio-fc3dae6c23b9f66a484069dae5ca01795477e641a0c9a429070c6f10ccce6d77 WatchSource:0}: Error finding container fc3dae6c23b9f66a484069dae5ca01795477e641a0c9a429070c6f10ccce6d77: Status 404 returned error can't find the container with id fc3dae6c23b9f66a484069dae5ca01795477e641a0c9a429070c6f10ccce6d77
Jul 24 13:39:45.739280 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.739241    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-98mvw\" (UID: \"a5d7d804-a7f1-4a2f-aea0-2306aafca41e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.741672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.741645    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5d7d804-a7f1-4a2f-aea0-2306aafca41e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-98mvw\" (UID: \"a5d7d804-a7f1-4a2f-aea0-2306aafca41e\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:45.840174 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.840140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-tls\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.842527 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.842498    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c90e2a9a-1707-4b8c-ac09-356ecbf9252a-node-exporter-tls\") pod \"node-exporter-g8br8\" (UID: \"c90e2a9a-1707-4b8c-ac09-356ecbf9252a\") " pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:45.981499 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:45.981465    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"
Jul 24 13:39:46.016227 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:46.016197    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g8br8"
Jul 24 13:39:46.027874 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:46.027804    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90e2a9a_1707_4b8c_ac09_356ecbf9252a.slice/crio-f6557102a25d45c1022a1499a92049c68a99f8253ddce717e06f975d6fa45d0c WatchSource:0}: Error finding container f6557102a25d45c1022a1499a92049c68a99f8253ddce717e06f975d6fa45d0c: Status 404 returned error can't find the container with id f6557102a25d45c1022a1499a92049c68a99f8253ddce717e06f975d6fa45d0c
Jul 24 13:39:46.134544 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:46.134501    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw"]
Jul 24 13:39:46.138901 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:46.138877    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d7d804_a7f1_4a2f_aea0_2306aafca41e.slice/crio-2e8c55e34843e54038cd99e072d6a8fee992cb4eee0e3de629f7c8ac5884c931 WatchSource:0}: Error finding container 2e8c55e34843e54038cd99e072d6a8fee992cb4eee0e3de629f7c8ac5884c931: Status 404 returned error can't find the container with id 2e8c55e34843e54038cd99e072d6a8fee992cb4eee0e3de629f7c8ac5884c931
Jul 24 13:39:46.581250 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:46.581070    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw" event={"ID":"a5d7d804-a7f1-4a2f-aea0-2306aafca41e","Type":"ContainerStarted","Data":"502795c95c4f0ecf76217f15e3b4fef375d2752571f75b9f51b180473bf0dd1a"}
Jul 24 13:39:46.581250 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:46.581147    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw" event={"ID":"a5d7d804-a7f1-4a2f-aea0-2306aafca41e","Type":"ContainerStarted","Data":"ba4dc8833db423675b8d4200d74494e81726ed95a82f51d25f57973417da1fd2"}
Jul 24 13:39:46.581250 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:46.581177    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw" event={"ID":"a5d7d804-a7f1-4a2f-aea0-2306aafca41e","Type":"ContainerStarted","Data":"2e8c55e34843e54038cd99e072d6a8fee992cb4eee0e3de629f7c8ac5884c931"}
Jul 24 13:39:46.583022 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:46.582991    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8br8" event={"ID":"c90e2a9a-1707-4b8c-ac09-356ecbf9252a","Type":"ContainerStarted","Data":"f6557102a25d45c1022a1499a92049c68a99f8253ddce717e06f975d6fa45d0c"}
Jul 24 13:39:46.584387 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:46.584316    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv" event={"ID":"3b2f7fb2-4227-4b29-a184-f96807d92797","Type":"ContainerStarted","Data":"fc3dae6c23b9f66a484069dae5ca01795477e641a0c9a429070c6f10ccce6d77"}
Jul 24 13:39:46.850643 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:46.850548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:46.850643 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:46.850608    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:46.851225 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:46.851185    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76db45b2-91ed-4a49-9db7-3d01bacf33ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:46.853372 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:46.853349    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76db45b2-91ed-4a49-9db7-3d01bacf33ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q8w4g\" (UID: \"76db45b2-91ed-4a49-9db7-3d01bacf33ce\") " pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:46.948067 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:46.948034    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q8w4g"
Jul 24 13:39:47.130061 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:47.130030    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q8w4g"]
Jul 24 13:39:47.134361 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:47.134181    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76db45b2_91ed_4a49_9db7_3d01bacf33ce.slice/crio-f858ba252c55db6f9b92f34b615b1ec6ebc327ebc2105b5329219eaf168a32cf WatchSource:0}: Error finding container f858ba252c55db6f9b92f34b615b1ec6ebc327ebc2105b5329219eaf168a32cf: Status 404 returned error can't find the container with id f858ba252c55db6f9b92f34b615b1ec6ebc327ebc2105b5329219eaf168a32cf
Jul 24 13:39:47.590522 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:47.590481    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8w4g" event={"ID":"76db45b2-91ed-4a49-9db7-3d01bacf33ce","Type":"ContainerStarted","Data":"f858ba252c55db6f9b92f34b615b1ec6ebc327ebc2105b5329219eaf168a32cf"}
Jul 24 13:39:47.593051 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:47.593023    2559 generic.go:356] "Generic (PLEG): container finished" podID="c90e2a9a-1707-4b8c-ac09-356ecbf9252a" containerID="4480901f0fb9c4656caa72199514e80234fa13067c6dc3bf4ff8f227b2a7a876" exitCode=0
Jul 24 13:39:47.593183 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:47.593133    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8br8" event={"ID":"c90e2a9a-1707-4b8c-ac09-356ecbf9252a","Type":"ContainerDied","Data":"4480901f0fb9c4656caa72199514e80234fa13067c6dc3bf4ff8f227b2a7a876"}
Jul 24 13:39:47.595707 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:47.595682    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv" event={"ID":"3b2f7fb2-4227-4b29-a184-f96807d92797","Type":"ContainerStarted","Data":"c8e08062652328f02f8285f49e84bf70bbb597ebb243309a7e33b1e168c9c245"}
Jul 24 13:39:47.595813 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:47.595732    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv" event={"ID":"3b2f7fb2-4227-4b29-a184-f96807d92797","Type":"ContainerStarted","Data":"757d9396ad87205afbd597b0e410762a373a93da1b2ebcfbb09806a209c5acef"}
Jul 24 13:39:47.595813 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:47.595765    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv" event={"ID":"3b2f7fb2-4227-4b29-a184-f96807d92797","Type":"ContainerStarted","Data":"4e9bf812cc2c78d6a66c1433515b29dae167ffb962f52f530de216056978a304"}
Jul 24 13:39:47.634767 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:47.634720    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-t6gbv" podStartSLOduration=1.221694611 podStartE2EDuration="2.634700428s" totalImagesPullingTime="1.413005817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:39:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:47.633716349 +0000 UTC m=+82.995089653" watchObservedRunningTime="2026-07-24 13:39:47.634700428 +0000 UTC m=+82.996073733"
Jul 24 13:39:48.090084 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.090045    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-865d599f6f-tzz29"]
Jul 24 13:39:48.095108 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.095083    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.099559 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.099535    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 24 13:39:48.105260 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.103535    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 24 13:39:48.105260 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.103999    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 24 13:39:48.105260 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.104215    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dt2uhrkhfed0c\""
Jul 24 13:39:48.105260 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.105049    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 24 13:39:48.105880 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.105635    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 24 13:39:48.111443 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.106252    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ps2m5\""
Jul 24 13:39:48.113600 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.113576    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-865d599f6f-tzz29"]
Jul 24 13:39:48.162006 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.161969    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-tls\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.162211 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.162023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.162211 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.162070    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-grpc-tls\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.162211 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.162098    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.162365 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.162205    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrw8j\" (UniqueName: \"kubernetes.io/projected/7e2c8b54-473b-4257-867a-7ed3c486a299-kube-api-access-nrw8j\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.162365 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.162300    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.162365 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.162338    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e2c8b54-473b-4257-867a-7ed3c486a299-metrics-client-ca\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.162506 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.162374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.263770 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.263732    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.263968 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.263783    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e2c8b54-473b-4257-867a-7ed3c486a299-metrics-client-ca\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.263968 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.263819    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.263968 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.263874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-tls\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.263968 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.263900    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.263968 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.263925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-grpc-tls\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.263968 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.263954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.264240 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.263993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrw8j\" (UniqueName: \"kubernetes.io/projected/7e2c8b54-473b-4257-867a-7ed3c486a299-kube-api-access-nrw8j\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.267240 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.267211    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.267788 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.267763    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.267902 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.267820    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e2c8b54-473b-4257-867a-7ed3c486a299-metrics-client-ca\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.268493 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.268468    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.268572 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.268489    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-tls\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.269077 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.269050    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.270392 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.270371    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e2c8b54-473b-4257-867a-7ed3c486a299-secret-grpc-tls\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.273404 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.273357    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrw8j\" (UniqueName: \"kubernetes.io/projected/7e2c8b54-473b-4257-867a-7ed3c486a299-kube-api-access-nrw8j\") pod \"thanos-querier-865d599f6f-tzz29\" (UID: \"7e2c8b54-473b-4257-867a-7ed3c486a299\") " pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.417384 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.417295    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:48.568607 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.568571    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-865d599f6f-tzz29"]
Jul 24 13:39:48.572139 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:48.572111    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e2c8b54_473b_4257_867a_7ed3c486a299.slice/crio-a9b43aa95a686940777a2a687588e1f9dd367f7c9d3661947a3cb2831416956a WatchSource:0}: Error finding container a9b43aa95a686940777a2a687588e1f9dd367f7c9d3661947a3cb2831416956a: Status 404 returned error can't find the container with id a9b43aa95a686940777a2a687588e1f9dd367f7c9d3661947a3cb2831416956a
Jul 24 13:39:48.602740 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.602704    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw" event={"ID":"a5d7d804-a7f1-4a2f-aea0-2306aafca41e","Type":"ContainerStarted","Data":"3edbfc95ccc2952b7bcb00c0f663a839a112a5865035faafda413f437fd2afb7"}
Jul 24 13:39:48.605714 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.605682    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8br8" event={"ID":"c90e2a9a-1707-4b8c-ac09-356ecbf9252a","Type":"ContainerStarted","Data":"8dad1eaedd7c71428b61297f8f21f7c7473648713dbdeeccc4498af6a3858e1a"}
Jul 24 13:39:48.605830 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.605750    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8br8" event={"ID":"c90e2a9a-1707-4b8c-ac09-356ecbf9252a","Type":"ContainerStarted","Data":"448104758ca69b84139d64c21be012263629a8ab5bf960712e61083bcbbae518"}
Jul 24 13:39:48.607162 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.607137    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29" event={"ID":"7e2c8b54-473b-4257-867a-7ed3c486a299","Type":"ContainerStarted","Data":"a9b43aa95a686940777a2a687588e1f9dd367f7c9d3661947a3cb2831416956a"}
Jul 24 13:39:48.622231 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:48.622187    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-98mvw" podStartSLOduration=2.287776427 podStartE2EDuration="3.622170964s" totalImagesPullingTime="1.334394537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:39:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:48.621783262 +0000 UTC m=+83.983156569" watchObservedRunningTime="2026-07-24 13:39:48.622170964 +0000 UTC m=+83.983544268"
Jul 24 13:39:50.556452 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:50.556422    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j9254"
Jul 24 13:39:50.576835 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:50.576784    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g8br8" podStartSLOduration=4.495901363 podStartE2EDuration="5.576763912s" totalImagesPullingTime="979.787003ms" totalInitContainerRuntime="101.075546ms" isStatefulPod=true podCreationTimestamp="2026-07-24 13:39:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:48.64752404 +0000 UTC m=+84.008897343" watchObservedRunningTime="2026-07-24 13:39:50.576763912 +0000 UTC m=+85.938137218"
Jul 24 13:39:51.393321 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.392950    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:39:51.404924 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.404151    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.408632 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.408607    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 13:39:51.409085 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.408668    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 13:39:51.410563 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.410547    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 13:39:51.410976 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.410954    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 13:39:51.411258 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.411241    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 13:39:51.411448 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.411427    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 13:39:51.411577 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.410959    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 13:39:51.419719 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.415488    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 13:39:51.419719 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.415810    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 13:39:51.419719 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.416102    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 13:39:51.419719 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.416343    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 13:39:51.419719 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.416651    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 13:39:51.421489 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.420566    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d55gl\""
Jul 24 13:39:51.421489 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.421211    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 13:39:51.421670 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.421510    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 13:39:51.421670 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.421651    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ii0pa3j0kq48\""
Jul 24 13:39:51.423434 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.422053    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 13:39:51.427757 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.427607    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:39:51.495942 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.495901    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496103 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.495961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496103 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496007    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496103 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496103 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496049    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496334 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496107    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496334 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496143    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496334 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496197    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496334 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rflcz\" (UniqueName: \"kubernetes.io/projected/febecf30-1655-4414-818f-4882011b6929-kube-api-access-rflcz\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496334 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496279    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496334 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496329    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496614 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496364    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/febecf30-1655-4414-818f-4882011b6929-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496614 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496392    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-web-config\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496614 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-config\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496614 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496449    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496614 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496493    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/febecf30-1655-4414-818f-4882011b6929-config-out\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496614 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496517    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496614 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496546    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496614 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496593    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.496917 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.496639    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.597797 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.597742    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.597797 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.597777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.597797 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.597803    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.597829    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.597914    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.597963    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rflcz\" (UniqueName: \"kubernetes.io/projected/febecf30-1655-4414-818f-4882011b6929-kube-api-access-rflcz\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/febecf30-1655-4414-818f-4882011b6929-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598154    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-web-config\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598190    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-config\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598211    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/febecf30-1655-4414-818f-4882011b6929-config-out\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598293    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598317    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598398    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.598488 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598431    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.599263 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598662    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.599263 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.598662    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.599263 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.599104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.599407 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.599385    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.599616 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.599592    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.600617 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.600291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.602519 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.602490    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.603397 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.603099    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.605098 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.605072    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/febecf30-1655-4414-818f-4882011b6929-config-out\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.605256 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.605207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.605256 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.605218    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.605551 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.605484    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-config\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.606068 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.606030    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.606332 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.606303    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.606667 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.606649    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/febecf30-1655-4414-818f-4882011b6929-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.607049 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.607027    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.607311 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.607280    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-web-config\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.607566 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.607537    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.609003 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.608960    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.616081 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.616055    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rflcz\" (UniqueName: \"kubernetes.io/projected/febecf30-1655-4414-818f-4882011b6929-kube-api-access-rflcz\") pod \"prometheus-k8s-0\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:51.728737 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:51.728665    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:39:53.238802 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:53.238778    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:39:53.240893 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:39:53.240870    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfebecf30_1655_4414_818f_4882011b6929.slice/crio-766d8b858713060aeaa33eee2c720b5765515ee003499cb259e8b8e2304cf7fe WatchSource:0}: Error finding container 766d8b858713060aeaa33eee2c720b5765515ee003499cb259e8b8e2304cf7fe: Status 404 returned error can't find the container with id 766d8b858713060aeaa33eee2c720b5765515ee003499cb259e8b8e2304cf7fe
Jul 24 13:39:53.504484 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:53.504459    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:39:53.631513 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:53.631475    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerStarted","Data":"766d8b858713060aeaa33eee2c720b5765515ee003499cb259e8b8e2304cf7fe"}
Jul 24 13:39:53.633805 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:53.633770    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29" event={"ID":"7e2c8b54-473b-4257-867a-7ed3c486a299","Type":"ContainerStarted","Data":"3d2af3d1445949c04c7c1ca41fed5caa96df7649dac86472702a48cda40ef9e4"}
Jul 24 13:39:53.633950 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:53.633836    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29" event={"ID":"7e2c8b54-473b-4257-867a-7ed3c486a299","Type":"ContainerStarted","Data":"35ae739d07ba9e1b61a0333e3b79a9dab6cddf8149d2ca4c04aa5f5710377ee3"}
Jul 24 13:39:53.633950 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:53.633896    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29" event={"ID":"7e2c8b54-473b-4257-867a-7ed3c486a299","Type":"ContainerStarted","Data":"964eecb4e9df338f911ce5ad63cdf9e2675cd402158b27e3b55951b3a54dab3c"}
Jul 24 13:39:53.635547 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:53.635521    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8w4g" event={"ID":"76db45b2-91ed-4a49-9db7-3d01bacf33ce","Type":"ContainerStarted","Data":"af3421e07acdf2d6178f898b4e618046f1915c14d606bfd0cbe001f5e2efa2dd"}
Jul 24 13:39:54.643440 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:54.643402    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29" event={"ID":"7e2c8b54-473b-4257-867a-7ed3c486a299","Type":"ContainerStarted","Data":"09dafd4a7fed898f669788e33bc03519f4dc5b1fa153bb392cd96e9308038ab8"}
Jul 24 13:39:54.645732 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:54.645523    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerStarted","Data":"d8ea0dc16c1642a23071ca1e09fc6a047557cd64b41c254b00cb85c0b91192c0"}
Jul 24 13:39:55.653810 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:55.653776    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29" event={"ID":"7e2c8b54-473b-4257-867a-7ed3c486a299","Type":"ContainerStarted","Data":"ede5c2b1624497f5715efdbe93adfd186de6e642679f95e4bcbcaec4d04701de"}
Jul 24 13:39:55.654332 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:55.653870    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29" event={"ID":"7e2c8b54-473b-4257-867a-7ed3c486a299","Type":"ContainerStarted","Data":"c65df6ba2bce1b145435fc15d5e236a60d409c921036703068a84d88d99422c4"}
Jul 24 13:39:55.654332 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:55.653916    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:39:55.655492 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:55.655465    2559 generic.go:356] "Generic (PLEG): container finished" podID="febecf30-1655-4414-818f-4882011b6929" containerID="d8ea0dc16c1642a23071ca1e09fc6a047557cd64b41c254b00cb85c0b91192c0" exitCode=0
Jul 24 13:39:55.655627 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:55.655537    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerDied","Data":"d8ea0dc16c1642a23071ca1e09fc6a047557cd64b41c254b00cb85c0b91192c0"}
Jul 24 13:39:55.678795 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:55.678444    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29" podStartSLOduration=1.947256653 podStartE2EDuration="7.678424451s" totalImagesPullingTime="5.731167798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:39:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:39:55.677952897 +0000 UTC m=+91.039326215" watchObservedRunningTime="2026-07-24 13:39:55.678424451 +0000 UTC m=+91.039797754"
Jul 24 13:39:57.316433 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:57.316396    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-798bff4796-njxgv"]
Jul 24 13:39:57.667849 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:39:57.667767    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8w4g" event={"ID":"76db45b2-91ed-4a49-9db7-3d01bacf33ce","Type":"ContainerStarted","Data":"b213b4a3c8ea34411f6007e3d3c9f94cca918c7bfe9a5ae017f3e61c31ae0398"}
Jul 24 13:40:00.689291 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:00.689245    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q8w4g" event={"ID":"76db45b2-91ed-4a49-9db7-3d01bacf33ce","Type":"ContainerStarted","Data":"fe9f41b412cc205ef922dca5454d454f86e2114321048c4ed28a603fcada6945"}
Jul 24 13:40:00.699930 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:00.697934    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerStarted","Data":"83787c0b2cbcb122560cd67632f922edc784c03fe0ce365486a33f20ffba6118"}
Jul 24 13:40:00.699930 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:00.698150    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerStarted","Data":"a63adfb7b11213e4b397f9cedc06f21def0a2a4d08a9805f5f0766a5e9883d8e"}
Jul 24 13:40:00.699930 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:00.698202    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerStarted","Data":"ac7b20f7e7761e6a7b2e381d4d455df69df1841b2f535ad191fc50b9a4cae6a0"}
Jul 24 13:40:00.710568 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:00.710314    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q8w4g" podStartSLOduration=8.514736949 podStartE2EDuration="21.71028946s" totalImagesPullingTime="13.195552511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 13:39:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:40:00.709209056 +0000 UTC m=+96.070582387" watchObservedRunningTime="2026-07-24 13:40:00.71028946 +0000 UTC m=+96.071662763"
Jul 24 13:40:01.667209 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:01.667180    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-865d599f6f-tzz29"
Jul 24 13:40:01.706949 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:01.706912    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerStarted","Data":"ced71cfd049cb67bf65fa177fa46e5b494f79511c9b818aafecb86b78e1df23f"}
Jul 24 13:40:01.707339 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:01.707003    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerStarted","Data":"c8649de85cd899f1a5a504c46f5e9562411c62f23ccafdac3923e7f88c561ad6"}
Jul 24 13:40:01.707339 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:01.707050    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerStarted","Data":"11582ee2bbc97afa53b10d816fb66e33e909d6adb697cace5406c9e6996b8fe7"}
Jul 24 13:40:01.728882 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:01.728827    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:40:01.740264 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:01.740197    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.622347642 podStartE2EDuration="10.740173433s" totalImagesPullingTime="6.088391202s" totalInitContainerRuntime="29.434589ms" isStatefulPod=false podCreationTimestamp="2026-07-24 13:39:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:40:01.73702407 +0000 UTC m=+97.098397376" watchObservedRunningTime="2026-07-24 13:40:01.740173433 +0000 UTC m=+97.101546736"
Jul 24 13:40:11.556872 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:11.556825    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hl7sr"
Jul 24 13:40:22.342735 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.342693    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-798bff4796-njxgv" podUID="65da1b68-61f6-4171-b9fe-270a84cdd52f" containerName="registry" containerID="cri-o://a9d6356fe9725ba5a6b9d72078f4cb2f0ea5075f6f17503887bec8361d91a553" gracePeriod=30
Jul 24 13:40:22.613445 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.613377    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:40:22.672596 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.672568    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65da1b68-61f6-4171-b9fe-270a84cdd52f-ca-trust-extracted\") pod \"65da1b68-61f6-4171-b9fe-270a84cdd52f\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") "
Jul 24 13:40:22.672789 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.672638    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-bound-sa-token\") pod \"65da1b68-61f6-4171-b9fe-270a84cdd52f\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") "
Jul 24 13:40:22.672789 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.672671    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65da1b68-61f6-4171-b9fe-270a84cdd52f-trusted-ca\") pod \"65da1b68-61f6-4171-b9fe-270a84cdd52f\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") "
Jul 24 13:40:22.672789 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.672700    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djzfp\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-kube-api-access-djzfp\") pod \"65da1b68-61f6-4171-b9fe-270a84cdd52f\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") "
Jul 24 13:40:22.672986 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.672878    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-certificates\") pod \"65da1b68-61f6-4171-b9fe-270a84cdd52f\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") "
Jul 24 13:40:22.672986 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.672936    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65da1b68-61f6-4171-b9fe-270a84cdd52f-image-registry-private-configuration\") pod \"65da1b68-61f6-4171-b9fe-270a84cdd52f\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") "
Jul 24 13:40:22.673096 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.673009    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65da1b68-61f6-4171-b9fe-270a84cdd52f-installation-pull-secrets\") pod \"65da1b68-61f6-4171-b9fe-270a84cdd52f\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") "
Jul 24 13:40:22.673096 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.673035    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls\") pod \"65da1b68-61f6-4171-b9fe-270a84cdd52f\" (UID: \"65da1b68-61f6-4171-b9fe-270a84cdd52f\") "
Jul 24 13:40:22.673209 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.673143    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65da1b68-61f6-4171-b9fe-270a84cdd52f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "65da1b68-61f6-4171-b9fe-270a84cdd52f" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:40:22.673209 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.673194    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "65da1b68-61f6-4171-b9fe-270a84cdd52f" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:40:22.673356 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.673332    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65da1b68-61f6-4171-b9fe-270a84cdd52f-trusted-ca\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:40:22.673491 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.673462    2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-certificates\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:40:22.675739 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.675703    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "65da1b68-61f6-4171-b9fe-270a84cdd52f" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:40:22.675739 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.675720    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65da1b68-61f6-4171-b9fe-270a84cdd52f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "65da1b68-61f6-4171-b9fe-270a84cdd52f" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:40:22.675920 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.675803    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-kube-api-access-djzfp" (OuterVolumeSpecName: "kube-api-access-djzfp") pod "65da1b68-61f6-4171-b9fe-270a84cdd52f" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f"). InnerVolumeSpecName "kube-api-access-djzfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:40:22.675920 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.675821    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65da1b68-61f6-4171-b9fe-270a84cdd52f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "65da1b68-61f6-4171-b9fe-270a84cdd52f" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:40:22.676087 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.676060    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "65da1b68-61f6-4171-b9fe-270a84cdd52f" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:40:22.682564 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.682543    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65da1b68-61f6-4171-b9fe-270a84cdd52f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "65da1b68-61f6-4171-b9fe-270a84cdd52f" (UID: "65da1b68-61f6-4171-b9fe-270a84cdd52f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:40:22.774285 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.774248    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djzfp\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-kube-api-access-djzfp\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:40:22.774285 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.774278    2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65da1b68-61f6-4171-b9fe-270a84cdd52f-image-registry-private-configuration\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:40:22.774285 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.774288    2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65da1b68-61f6-4171-b9fe-270a84cdd52f-installation-pull-secrets\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:40:22.774285 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.774298    2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-registry-tls\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:40:22.774682 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.774309    2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65da1b68-61f6-4171-b9fe-270a84cdd52f-ca-trust-extracted\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:40:22.774682 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.774318    2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65da1b68-61f6-4171-b9fe-270a84cdd52f-bound-sa-token\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:40:22.787637 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.787603    2559 generic.go:356] "Generic (PLEG): container finished" podID="65da1b68-61f6-4171-b9fe-270a84cdd52f" containerID="a9d6356fe9725ba5a6b9d72078f4cb2f0ea5075f6f17503887bec8361d91a553" exitCode=0
Jul 24 13:40:22.787775 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.787651    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-798bff4796-njxgv"
Jul 24 13:40:22.787775 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.787686    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-798bff4796-njxgv" event={"ID":"65da1b68-61f6-4171-b9fe-270a84cdd52f","Type":"ContainerDied","Data":"a9d6356fe9725ba5a6b9d72078f4cb2f0ea5075f6f17503887bec8361d91a553"}
Jul 24 13:40:22.787775 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.787737    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-798bff4796-njxgv" event={"ID":"65da1b68-61f6-4171-b9fe-270a84cdd52f","Type":"ContainerDied","Data":"0f13e4742951ab3b733a2b7dd14f4b0e1405d1e76f1016bbf866492560fe4aad"}
Jul 24 13:40:22.787775 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.787758    2559 scope.go:117] "RemoveContainer" containerID="a9d6356fe9725ba5a6b9d72078f4cb2f0ea5075f6f17503887bec8361d91a553"
Jul 24 13:40:22.796637 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.796618    2559 scope.go:117] "RemoveContainer" containerID="a9d6356fe9725ba5a6b9d72078f4cb2f0ea5075f6f17503887bec8361d91a553"
Jul 24 13:40:22.796941 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:40:22.796918    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9d6356fe9725ba5a6b9d72078f4cb2f0ea5075f6f17503887bec8361d91a553\": container with ID starting with a9d6356fe9725ba5a6b9d72078f4cb2f0ea5075f6f17503887bec8361d91a553 not found: ID does not exist" containerID="a9d6356fe9725ba5a6b9d72078f4cb2f0ea5075f6f17503887bec8361d91a553"
Jul 24 13:40:22.797019 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.796950    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d6356fe9725ba5a6b9d72078f4cb2f0ea5075f6f17503887bec8361d91a553"} err="failed to get container status \"a9d6356fe9725ba5a6b9d72078f4cb2f0ea5075f6f17503887bec8361d91a553\": rpc error: code = NotFound desc = could not find container \"a9d6356fe9725ba5a6b9d72078f4cb2f0ea5075f6f17503887bec8361d91a553\": container with ID starting with a9d6356fe9725ba5a6b9d72078f4cb2f0ea5075f6f17503887bec8361d91a553 not found: ID does not exist"
Jul 24 13:40:22.808020 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.807999    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-798bff4796-njxgv"]
Jul 24 13:40:22.811821 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:22.811800    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-798bff4796-njxgv"]
Jul 24 13:40:23.194924 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:23.194893    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65da1b68-61f6-4171-b9fe-270a84cdd52f" path="/var/lib/kubelet/pods/65da1b68-61f6-4171-b9fe-270a84cdd52f/volumes"
Jul 24 13:40:51.729094 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:51.729055    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:40:51.744894 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:51.744870    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:40:51.919589 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:40:51.919562    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:09.740015 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.739981    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:41:09.740504 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.740274    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="prometheus" containerID="cri-o://ac7b20f7e7761e6a7b2e381d4d455df69df1841b2f535ad191fc50b9a4cae6a0" gracePeriod=600
Jul 24 13:41:09.740504 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.740297    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="kube-rbac-proxy" containerID="cri-o://c8649de85cd899f1a5a504c46f5e9562411c62f23ccafdac3923e7f88c561ad6" gracePeriod=600
Jul 24 13:41:09.740504 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.740343    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ced71cfd049cb67bf65fa177fa46e5b494f79511c9b818aafecb86b78e1df23f" gracePeriod=600
Jul 24 13:41:09.740504 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.740362    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="kube-rbac-proxy-web" containerID="cri-o://11582ee2bbc97afa53b10d816fb66e33e909d6adb697cace5406c9e6996b8fe7" gracePeriod=600
Jul 24 13:41:09.740504 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.740325    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="thanos-sidecar" containerID="cri-o://83787c0b2cbcb122560cd67632f922edc784c03fe0ce365486a33f20ffba6118" gracePeriod=600
Jul 24 13:41:09.740504 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.740370    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="config-reloader" containerID="cri-o://a63adfb7b11213e4b397f9cedc06f21def0a2a4d08a9805f5f0766a5e9883d8e" gracePeriod=600
Jul 24 13:41:09.979899 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.979844    2559 generic.go:356] "Generic (PLEG): container finished" podID="febecf30-1655-4414-818f-4882011b6929" containerID="ced71cfd049cb67bf65fa177fa46e5b494f79511c9b818aafecb86b78e1df23f" exitCode=0
Jul 24 13:41:09.979899 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.979887    2559 generic.go:356] "Generic (PLEG): container finished" podID="febecf30-1655-4414-818f-4882011b6929" containerID="c8649de85cd899f1a5a504c46f5e9562411c62f23ccafdac3923e7f88c561ad6" exitCode=0
Jul 24 13:41:09.979899 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.979896    2559 generic.go:356] "Generic (PLEG): container finished" podID="febecf30-1655-4414-818f-4882011b6929" containerID="11582ee2bbc97afa53b10d816fb66e33e909d6adb697cace5406c9e6996b8fe7" exitCode=0
Jul 24 13:41:09.979899 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.979902    2559 generic.go:356] "Generic (PLEG): container finished" podID="febecf30-1655-4414-818f-4882011b6929" containerID="83787c0b2cbcb122560cd67632f922edc784c03fe0ce365486a33f20ffba6118" exitCode=0
Jul 24 13:41:09.979899 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.979909    2559 generic.go:356] "Generic (PLEG): container finished" podID="febecf30-1655-4414-818f-4882011b6929" containerID="a63adfb7b11213e4b397f9cedc06f21def0a2a4d08a9805f5f0766a5e9883d8e" exitCode=0
Jul 24 13:41:09.980205 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.979918    2559 generic.go:356] "Generic (PLEG): container finished" podID="febecf30-1655-4414-818f-4882011b6929" containerID="ac7b20f7e7761e6a7b2e381d4d455df69df1841b2f535ad191fc50b9a4cae6a0" exitCode=0
Jul 24 13:41:09.980205 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.979906    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerDied","Data":"ced71cfd049cb67bf65fa177fa46e5b494f79511c9b818aafecb86b78e1df23f"}
Jul 24 13:41:09.980205 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.980016    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerDied","Data":"c8649de85cd899f1a5a504c46f5e9562411c62f23ccafdac3923e7f88c561ad6"}
Jul 24 13:41:09.980205 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.980049    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerDied","Data":"11582ee2bbc97afa53b10d816fb66e33e909d6adb697cace5406c9e6996b8fe7"}
Jul 24 13:41:09.980205 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.980079    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerDied","Data":"83787c0b2cbcb122560cd67632f922edc784c03fe0ce365486a33f20ffba6118"}
Jul 24 13:41:09.980205 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.980104    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerDied","Data":"a63adfb7b11213e4b397f9cedc06f21def0a2a4d08a9805f5f0766a5e9883d8e"}
Jul 24 13:41:09.980205 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.980132    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerDied","Data":"ac7b20f7e7761e6a7b2e381d4d455df69df1841b2f535ad191fc50b9a4cae6a0"}
Jul 24 13:41:09.999235 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:09.999179    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:10.055175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055137    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-0\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055171    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/febecf30-1655-4414-818f-4882011b6929-tls-assets\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055394 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055194    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-trusted-ca-bundle\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055394 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055232    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-tls\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055505 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055360    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-metrics-client-certs\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055505 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055478    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-config\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055608 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055572    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:41:10.055608 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055549    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-serving-certs-ca-bundle\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055712 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055662    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-metrics-client-ca\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055712 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055701    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/febecf30-1655-4414-818f-4882011b6929-config-out\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055813 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055731    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-web-config\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055813 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055760    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-kubelet-serving-ca-bundle\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055813 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055786    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-thanos-prometheus-http-client-file\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055994 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055840    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-kube-rbac-proxy\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055994 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055903    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-db\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055994 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055931    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.055994 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.055958    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.056191 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.056014    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-2\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.056191 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.056040    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rflcz\" (UniqueName: \"kubernetes.io/projected/febecf30-1655-4414-818f-4882011b6929-kube-api-access-rflcz\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.056191 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.056063    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-1\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.056191 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.056104    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-grpc-tls\") pod \"febecf30-1655-4414-818f-4882011b6929\" (UID: \"febecf30-1655-4414-818f-4882011b6929\") "
Jul 24 13:41:10.056378 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.056270    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:41:10.056378 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.056348    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:41:10.056473 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.056407    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-metrics-client-ca\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.056473 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.056427    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.056996 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.056732    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:41:10.056996 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.056813    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:41:10.057818 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.057563    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:41:10.058673 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.058557    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 13:41:10.058768 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.058666    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/febecf30-1655-4414-818f-4882011b6929-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:41:10.059402 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.059370    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febecf30-1655-4414-818f-4882011b6929-config-out" (OuterVolumeSpecName: "config-out") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:41:10.059685 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.059541    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 13:41:10.060235 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.060200    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:41:10.060315 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.060229    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:41:10.060496 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.060468    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:41:10.063724 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.062097    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/febecf30-1655-4414-818f-4882011b6929-kube-api-access-rflcz" (OuterVolumeSpecName: "kube-api-access-rflcz") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "kube-api-access-rflcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:41:10.063724 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.062307    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-config" (OuterVolumeSpecName: "config") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:41:10.063724 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.062374    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:41:10.063724 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.062551    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:41:10.063724 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.063663    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:41:10.064175 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.064150    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:41:10.072188 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.072165    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-web-config" (OuterVolumeSpecName: "web-config") pod "febecf30-1655-4414-818f-4882011b6929" (UID: "febecf30-1655-4414-818f-4882011b6929"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157444    2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-metrics-client-certs\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157482    2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-config\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157496    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157519    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/febecf30-1655-4414-818f-4882011b6929-config-out\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157531    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-web-config\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157545    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157558    2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157572    2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-kube-rbac-proxy\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157586    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-db\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157600    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157615    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157627    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157640    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rflcz\" (UniqueName: \"kubernetes.io/projected/febecf30-1655-4414-818f-4882011b6929-kube-api-access-rflcz\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157653    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157666    2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-grpc-tls\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157678    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/febecf30-1655-4414-818f-4882011b6929-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157688    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/febecf30-1655-4414-818f-4882011b6929-tls-assets\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.157727 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.157700    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/febecf30-1655-4414-818f-4882011b6929-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:41:10.986489 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.986456    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"febecf30-1655-4414-818f-4882011b6929","Type":"ContainerDied","Data":"766d8b858713060aeaa33eee2c720b5765515ee003499cb259e8b8e2304cf7fe"}
Jul 24 13:41:10.986489 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.986482    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:10.986984 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.986532    2559 scope.go:117] "RemoveContainer" containerID="ced71cfd049cb67bf65fa177fa46e5b494f79511c9b818aafecb86b78e1df23f"
Jul 24 13:41:10.996174 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:10.996155    2559 scope.go:117] "RemoveContainer" containerID="c8649de85cd899f1a5a504c46f5e9562411c62f23ccafdac3923e7f88c561ad6"
Jul 24 13:41:11.003041 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.003021    2559 scope.go:117] "RemoveContainer" containerID="11582ee2bbc97afa53b10d816fb66e33e909d6adb697cace5406c9e6996b8fe7"
Jul 24 13:41:11.009638 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.009619    2559 scope.go:117] "RemoveContainer" containerID="83787c0b2cbcb122560cd67632f922edc784c03fe0ce365486a33f20ffba6118"
Jul 24 13:41:11.014815 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.014794    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:41:11.017139 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.017105    2559 scope.go:117] "RemoveContainer" containerID="a63adfb7b11213e4b397f9cedc06f21def0a2a4d08a9805f5f0766a5e9883d8e"
Jul 24 13:41:11.019936 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.019914    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:41:11.024394 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.024375    2559 scope.go:117] "RemoveContainer" containerID="ac7b20f7e7761e6a7b2e381d4d455df69df1841b2f535ad191fc50b9a4cae6a0"
Jul 24 13:41:11.031921 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.031904    2559 scope.go:117] "RemoveContainer" containerID="d8ea0dc16c1642a23071ca1e09fc6a047557cd64b41c254b00cb85c0b91192c0"
Jul 24 13:41:11.050342 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050320    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:41:11.050629 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050616    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="kube-rbac-proxy-web"
Jul 24 13:41:11.050672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050630    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="kube-rbac-proxy-web"
Jul 24 13:41:11.050672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050640    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="prometheus"
Jul 24 13:41:11.050672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050645    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="prometheus"
Jul 24 13:41:11.050672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050655    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="kube-rbac-proxy"
Jul 24 13:41:11.050672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050661    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="kube-rbac-proxy"
Jul 24 13:41:11.050672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050669    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="config-reloader"
Jul 24 13:41:11.050672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050675    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="config-reloader"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050682    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65da1b68-61f6-4171-b9fe-270a84cdd52f" containerName="registry"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050687    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="65da1b68-61f6-4171-b9fe-270a84cdd52f" containerName="registry"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050695    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="thanos-sidecar"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050700    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="thanos-sidecar"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050708    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="kube-rbac-proxy-thanos"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050713    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="kube-rbac-proxy-thanos"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050719    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="init-config-reloader"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050723    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="init-config-reloader"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050764    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="config-reloader"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050771    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="kube-rbac-proxy-thanos"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050776    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="prometheus"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050784    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="thanos-sidecar"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050789    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="65da1b68-61f6-4171-b9fe-270a84cdd52f" containerName="registry"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050795    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="kube-rbac-proxy-web"
Jul 24 13:41:11.050935 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.050801    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="febecf30-1655-4414-818f-4882011b6929" containerName="kube-rbac-proxy"
Jul 24 13:41:11.054916 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.054900    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.057572 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.057552    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 24 13:41:11.057760 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.057555    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 24 13:41:11.057842 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.057761    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d55gl\""
Jul 24 13:41:11.057842 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.057610    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 24 13:41:11.057842 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.057794    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 24 13:41:11.058037 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.057681    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 24 13:41:11.058247 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.058227    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 24 13:41:11.058331 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.058254    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 24 13:41:11.058331 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.058262    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 24 13:41:11.058439 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.058344    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ii0pa3j0kq48\""
Jul 24 13:41:11.058439 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.058373    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 24 13:41:11.058439 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.058406    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 24 13:41:11.058597 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.058454    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 24 13:41:11.058647 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.058599    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 24 13:41:11.058736 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.058719    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 24 13:41:11.061497 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.061471    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 24 13:41:11.065664 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.065639    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 24 13:41:11.070618 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.070594    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:41:11.164131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164098    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164133    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-config\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164401 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164401 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164169    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164401 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164241    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164401 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164295    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164401 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164339    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164401 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164401 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164395    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kzbr\" (UniqueName: \"kubernetes.io/projected/5d1c927b-0936-458a-b704-b817b42c82b5-kube-api-access-7kzbr\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164422    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d1c927b-0936-458a-b704-b817b42c82b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164459    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164530    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164601    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164618    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164646    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164672 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164981 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164685    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.164981 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.164711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d1c927b-0936-458a-b704-b817b42c82b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.193461 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.193430    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="febecf30-1655-4414-818f-4882011b6929" path="/var/lib/kubelet/pods/febecf30-1655-4414-818f-4882011b6929/volumes"
Jul 24 13:41:11.266012 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.265945    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.266012 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.265980    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.266012 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.266005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.266254 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.266022    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.266254 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.266041    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.266254 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.266059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.266254 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.266079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.266254 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.266094    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d1c927b-0936-458a-b704-b817b42c82b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.266254 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.266113    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.266599 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.266575    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.266762 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.266670    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.266910 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.266891    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-config\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.267034 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.267018    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.267107 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.266907    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.267107 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.267072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.267208 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.267111    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.267208 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.267139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.267208 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.267173    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.267352 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.267208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.267352 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.267238    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kzbr\" (UniqueName: \"kubernetes.io/projected/5d1c927b-0936-458a-b704-b817b42c82b5-kube-api-access-7kzbr\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.267352 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.267270    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d1c927b-0936-458a-b704-b817b42c82b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.267352 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.267299    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.267352 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.267334    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.267697 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.267671    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.268312 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.268292    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.268441 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.267034    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.269563 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.269169    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.269563 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.269204    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d1c927b-0936-458a-b704-b817b42c82b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.269563 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.269214    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.269563 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.269497    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-config\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.270022 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.269884    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.270022 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.269954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.270168 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.270141    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.270625 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.270552    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.271160 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.271140    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.271720 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.271693    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.272004 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.271983    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d1c927b-0936-458a-b704-b817b42c82b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.272055 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.272044    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d1c927b-0936-458a-b704-b817b42c82b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.272521 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.272503    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d1c927b-0936-458a-b704-b817b42c82b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.277343 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.277321    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kzbr\" (UniqueName: \"kubernetes.io/projected/5d1c927b-0936-458a-b704-b817b42c82b5-kube-api-access-7kzbr\") pod \"prometheus-k8s-0\" (UID: \"5d1c927b-0936-458a-b704-b817b42c82b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.365786 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.365755    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:41:11.505147 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.505093    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 24 13:41:11.508003 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:41:11.507982    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1c927b_0936_458a_b704_b817b42c82b5.slice/crio-40fb7b22e6ab42ff91fd7de84c85932734ce0b037b8bf4c82397fcb9a83b65e1 WatchSource:0}: Error finding container 40fb7b22e6ab42ff91fd7de84c85932734ce0b037b8bf4c82397fcb9a83b65e1: Status 404 returned error can't find the container with id 40fb7b22e6ab42ff91fd7de84c85932734ce0b037b8bf4c82397fcb9a83b65e1
Jul 24 13:41:11.992773 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.992731    2559 generic.go:356] "Generic (PLEG): container finished" podID="5d1c927b-0936-458a-b704-b817b42c82b5" containerID="65f58641be94d5ee2d51e5698d58a21a0642ebf5dd5e2b78df0a6b8b3f76b7f0" exitCode=0
Jul 24 13:41:11.993241 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.992801    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d1c927b-0936-458a-b704-b817b42c82b5","Type":"ContainerDied","Data":"65f58641be94d5ee2d51e5698d58a21a0642ebf5dd5e2b78df0a6b8b3f76b7f0"}
Jul 24 13:41:11.993241 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:11.992897    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d1c927b-0936-458a-b704-b817b42c82b5","Type":"ContainerStarted","Data":"40fb7b22e6ab42ff91fd7de84c85932734ce0b037b8bf4c82397fcb9a83b65e1"}
Jul 24 13:41:13.000500 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:13.000459    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d1c927b-0936-458a-b704-b817b42c82b5","Type":"ContainerStarted","Data":"b49be50bf0c96b2bee198028af30747c88272c1c7c63b88f3902c728c5111841"}
Jul 24 13:41:13.000956 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:13.000567    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d1c927b-0936-458a-b704-b817b42c82b5","Type":"ContainerStarted","Data":"8a0dea50a58f82ce3069a8e683e871002c795b2a5f4409cfa3bd14f52ffd6afd"}
Jul 24 13:41:13.000956 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:13.000624    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d1c927b-0936-458a-b704-b817b42c82b5","Type":"ContainerStarted","Data":"390e22b610aca9382ff857442846ccf48d130cf55b82b599b969d20bc0dcb12c"}
Jul 24 13:41:13.000956 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:13.000668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d1c927b-0936-458a-b704-b817b42c82b5","Type":"ContainerStarted","Data":"a3e2c7dcec23bc2de739df2203ed7b0629d7225974f5edab84ad7d8c3a7dfb46"}
Jul 24 13:41:13.000956 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:13.000706    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d1c927b-0936-458a-b704-b817b42c82b5","Type":"ContainerStarted","Data":"f104b2838eece3fd8c6932b163283d3455d6c58a0e7ea9de9355153d178e4a47"}
Jul 24 13:41:13.000956 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:13.000745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d1c927b-0936-458a-b704-b817b42c82b5","Type":"ContainerStarted","Data":"1ef394efd3c08f6d981678f526d80382120448096b01e2145117c6a13c3b78a2"}
Jul 24 13:41:13.032367 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:13.032311    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.013403494 podStartE2EDuration="2.032290958s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.887464ms" isStatefulPod=false podCreationTimestamp="2026-07-24 13:41:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:41:13.030324619 +0000 UTC m=+168.391697947" watchObservedRunningTime="2026-07-24 13:41:13.032290958 +0000 UTC m=+168.393664262"
Jul 24 13:41:16.366535 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:41:16.366498    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:42:11.366764 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:42:11.366717    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:42:11.381970 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:42:11.381945    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:42:12.244500 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:42:12.244460    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 24 13:43:25.028401 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:43:25.028364    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 24 13:44:39.136483 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.136402    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"]
Jul 24 13:44:39.140875 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.139545    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.143254 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.143233    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 24 13:44:39.143395 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.143257    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 24 13:44:39.144016 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.143959    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q2sql\""
Jul 24 13:44:39.144141 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.144064    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 24 13:44:39.144141 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.144119    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 24 13:44:39.168192 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.168165    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"]
Jul 24 13:44:39.204237 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.204210    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fa3eda8-be09-4596-82ef-06eda0b4f541-tmp\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.204375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.204294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4fa3eda8-be09-4596-82ef-06eda0b4f541-manifests\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.204375 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.204320    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fa3eda8-be09-4596-82ef-06eda0b4f541-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.204472 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.204380    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4fa3eda8-be09-4596-82ef-06eda0b4f541-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.204472 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.204411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx66z\" (UniqueName: \"kubernetes.io/projected/4fa3eda8-be09-4596-82ef-06eda0b4f541-kube-api-access-gx66z\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.305509 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.305478    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4fa3eda8-be09-4596-82ef-06eda0b4f541-manifests\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.305509 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.305507    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fa3eda8-be09-4596-82ef-06eda0b4f541-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.305686 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.305532    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4fa3eda8-be09-4596-82ef-06eda0b4f541-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.305686 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.305548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx66z\" (UniqueName: \"kubernetes.io/projected/4fa3eda8-be09-4596-82ef-06eda0b4f541-kube-api-access-gx66z\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.305686 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.305587    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fa3eda8-be09-4596-82ef-06eda0b4f541-tmp\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.305960 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.305943    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4fa3eda8-be09-4596-82ef-06eda0b4f541-manifests\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.307910 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.307881    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4fa3eda8-be09-4596-82ef-06eda0b4f541-tmp\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.308114 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.308094    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4fa3eda8-be09-4596-82ef-06eda0b4f541-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.308155 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.308099    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fa3eda8-be09-4596-82ef-06eda0b4f541-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.314992 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.314963    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx66z\" (UniqueName: \"kubernetes.io/projected/4fa3eda8-be09-4596-82ef-06eda0b4f541-kube-api-access-gx66z\") pod \"opendatahub-operator-controller-manager-6c96dc84dd-s68bf\" (UID: \"4fa3eda8-be09-4596-82ef-06eda0b4f541\") " pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.452704 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.452679    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:39.583440 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.583370    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"]
Jul 24 13:44:39.585661 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:44:39.585634    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa3eda8_be09_4596_82ef_06eda0b4f541.slice/crio-1048201b5bf97656a2890f4ec28f7a53cd085b7784fc17a35fae21e5ec572596 WatchSource:0}: Error finding container 1048201b5bf97656a2890f4ec28f7a53cd085b7784fc17a35fae21e5ec572596: Status 404 returned error can't find the container with id 1048201b5bf97656a2890f4ec28f7a53cd085b7784fc17a35fae21e5ec572596
Jul 24 13:44:39.587506 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.587487    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 13:44:39.769894 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:39.769793    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf" event={"ID":"4fa3eda8-be09-4596-82ef-06eda0b4f541","Type":"ContainerStarted","Data":"1048201b5bf97656a2890f4ec28f7a53cd085b7784fc17a35fae21e5ec572596"}
Jul 24 13:44:42.786057 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:42.785967    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf" event={"ID":"4fa3eda8-be09-4596-82ef-06eda0b4f541","Type":"ContainerStarted","Data":"82e027fac1dab60417260d64848630a4ac204b6f871fd70b3e048c5656c750f9"}
Jul 24 13:44:43.791098 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:43.791068    2559 generic.go:356] "Generic (PLEG): container finished" podID="4fa3eda8-be09-4596-82ef-06eda0b4f541" containerID="82e027fac1dab60417260d64848630a4ac204b6f871fd70b3e048c5656c750f9" exitCode=0
Jul 24 13:44:43.791492 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:43.791158    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf" event={"ID":"4fa3eda8-be09-4596-82ef-06eda0b4f541","Type":"ContainerDied","Data":"82e027fac1dab60417260d64848630a4ac204b6f871fd70b3e048c5656c750f9"}
Jul 24 13:44:44.797332 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:44.797302    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf" event={"ID":"4fa3eda8-be09-4596-82ef-06eda0b4f541","Type":"ContainerStarted","Data":"5fa09aae0c8491bf8462ed842649a6eb8b25a8180370686e1e47dce7ff453b85"}
Jul 24 13:44:44.797740 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:44.797368    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:44.818974 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:44.818925    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf" podStartSLOduration=1.35325107 podStartE2EDuration="5.818906089s" totalImagesPullingTime="3.416189761s" totalInitContainerRuntime="1.049465258s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:44:44.817026515 +0000 UTC m=+380.178399843" watchObservedRunningTime="2026-07-24 13:44:44.818906089 +0000 UTC m=+380.180279394"
Jul 24 13:44:55.804609 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:55.804577    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c96dc84dd-s68bf"
Jul 24 13:44:58.522922 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.522886    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"]
Jul 24 13:44:58.532024 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.531996    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"
Jul 24 13:44:58.534873 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.534836    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 24 13:44:58.535009 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.534889    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xf7q8\""
Jul 24 13:44:58.535009 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.534838    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 24 13:44:58.539037 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.539007    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"]
Jul 24 13:44:58.673556 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.673519    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrnz6\" (UniqueName: \"kubernetes.io/projected/56045d8f-d165-4ee9-9791-0da40f1a1b0b-kube-api-access-mrnz6\") pod \"kube-auth-proxy-7f8885cbd9-x48rw\" (UID: \"56045d8f-d165-4ee9-9791-0da40f1a1b0b\") " pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"
Jul 24 13:44:58.673713 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.673578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56045d8f-d165-4ee9-9791-0da40f1a1b0b-tls-certs\") pod \"kube-auth-proxy-7f8885cbd9-x48rw\" (UID: \"56045d8f-d165-4ee9-9791-0da40f1a1b0b\") " pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"
Jul 24 13:44:58.673713 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.673684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56045d8f-d165-4ee9-9791-0da40f1a1b0b-tmp\") pod \"kube-auth-proxy-7f8885cbd9-x48rw\" (UID: \"56045d8f-d165-4ee9-9791-0da40f1a1b0b\") " pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"
Jul 24 13:44:58.774721 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.774634    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56045d8f-d165-4ee9-9791-0da40f1a1b0b-tls-certs\") pod \"kube-auth-proxy-7f8885cbd9-x48rw\" (UID: \"56045d8f-d165-4ee9-9791-0da40f1a1b0b\") " pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"
Jul 24 13:44:58.774721 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.774698    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56045d8f-d165-4ee9-9791-0da40f1a1b0b-tmp\") pod \"kube-auth-proxy-7f8885cbd9-x48rw\" (UID: \"56045d8f-d165-4ee9-9791-0da40f1a1b0b\") " pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"
Jul 24 13:44:58.775022 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.774730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrnz6\" (UniqueName: \"kubernetes.io/projected/56045d8f-d165-4ee9-9791-0da40f1a1b0b-kube-api-access-mrnz6\") pod \"kube-auth-proxy-7f8885cbd9-x48rw\" (UID: \"56045d8f-d165-4ee9-9791-0da40f1a1b0b\") " pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"
Jul 24 13:44:58.775022 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:44:58.774810    2559 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 24 13:44:58.775022 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:44:58.774929    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56045d8f-d165-4ee9-9791-0da40f1a1b0b-tls-certs podName:56045d8f-d165-4ee9-9791-0da40f1a1b0b nodeName:}" failed. No retries permitted until 2026-07-24 13:44:59.27490604 +0000 UTC m=+394.636279336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/56045d8f-d165-4ee9-9791-0da40f1a1b0b-tls-certs") pod "kube-auth-proxy-7f8885cbd9-x48rw" (UID: "56045d8f-d165-4ee9-9791-0da40f1a1b0b") : secret "kube-auth-proxy-tls" not found
Jul 24 13:44:58.777044 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.777023    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56045d8f-d165-4ee9-9791-0da40f1a1b0b-tmp\") pod \"kube-auth-proxy-7f8885cbd9-x48rw\" (UID: \"56045d8f-d165-4ee9-9791-0da40f1a1b0b\") " pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"
Jul 24 13:44:58.794284 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:58.794255    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrnz6\" (UniqueName: \"kubernetes.io/projected/56045d8f-d165-4ee9-9791-0da40f1a1b0b-kube-api-access-mrnz6\") pod \"kube-auth-proxy-7f8885cbd9-x48rw\" (UID: \"56045d8f-d165-4ee9-9791-0da40f1a1b0b\") " pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"
Jul 24 13:44:59.279432 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:59.279395    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56045d8f-d165-4ee9-9791-0da40f1a1b0b-tls-certs\") pod \"kube-auth-proxy-7f8885cbd9-x48rw\" (UID: \"56045d8f-d165-4ee9-9791-0da40f1a1b0b\") " pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"
Jul 24 13:44:59.282472 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:59.282444    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56045d8f-d165-4ee9-9791-0da40f1a1b0b-tls-certs\") pod \"kube-auth-proxy-7f8885cbd9-x48rw\" (UID: \"56045d8f-d165-4ee9-9791-0da40f1a1b0b\") " pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"
Jul 24 13:44:59.444016 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:59.443976    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"
Jul 24 13:44:59.580932 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:59.580785    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw"]
Jul 24 13:44:59.582975 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:44:59.582950    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56045d8f_d165_4ee9_9791_0da40f1a1b0b.slice/crio-fee966d9447c5623f8e5b921bd95fdd7dfef27dfed1a56fad58aabf72bc74e99 WatchSource:0}: Error finding container fee966d9447c5623f8e5b921bd95fdd7dfef27dfed1a56fad58aabf72bc74e99: Status 404 returned error can't find the container with id fee966d9447c5623f8e5b921bd95fdd7dfef27dfed1a56fad58aabf72bc74e99
Jul 24 13:44:59.861319 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:44:59.861224    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw" event={"ID":"56045d8f-d165-4ee9-9791-0da40f1a1b0b","Type":"ContainerStarted","Data":"fee966d9447c5623f8e5b921bd95fdd7dfef27dfed1a56fad58aabf72bc74e99"}
Jul 24 13:45:02.877276 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:02.877243    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw" event={"ID":"56045d8f-d165-4ee9-9791-0da40f1a1b0b","Type":"ContainerStarted","Data":"a7ef95248669b0b2a9da9b13fd087645bdb21cbacc1a8262412283f4d789c83b"}
Jul 24 13:45:02.894245 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:02.894191    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f8885cbd9-x48rw" podStartSLOduration=2.543951467 podStartE2EDuration="4.894176217s" totalImagesPullingTime="2.35022475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:02.893139065 +0000 UTC m=+398.254512381" watchObservedRunningTime="2026-07-24 13:45:02.894176217 +0000 UTC m=+398.255549519"
Jul 24 13:45:05.538089 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.538051    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"]
Jul 24 13:45:05.540882 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.540848    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.544229 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.544194    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 24 13:45:05.544532 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.544505    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-sxf42\""
Jul 24 13:45:05.559280 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.559255    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"]
Jul 24 13:45:05.632553 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.632504    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.632760 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.632595    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.632760 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.632620    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.632760 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.632649    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.632760 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.632675    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.632760 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.632701    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2jqd\" (UniqueName: \"kubernetes.io/projected/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-kube-api-access-j2jqd\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.632760 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.632734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.633009 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.632795    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.633009 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.632838    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.733669 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.733632    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.733892 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.733696    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.733892 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.733727    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.733892 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.733759    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.733892 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.733786    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.733892 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.733809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2jqd\" (UniqueName: \"kubernetes.io/projected/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-kube-api-access-j2jqd\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.733892 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.733844    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.734204 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.733913    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.734204 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.733962    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.734297 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.734250    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.734769 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.734528    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.734769 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.734545    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.734769 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.734677    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.734769 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.734727    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.736405 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.736380    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.736718 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.736692    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.745456 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.745425    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.746140 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.746119    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2jqd\" (UniqueName: \"kubernetes.io/projected/9b96e249-442e-4b3b-bb8f-6c3c43e36f48-kube-api-access-j2jqd\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl\" (UID: \"9b96e249-442e-4b3b-bb8f-6c3c43e36f48\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:05.854477 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:05.854384    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:06.010937 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.010909    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"]
Jul 24 13:45:06.012767 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:45:06.012736    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b96e249_442e_4b3b_bb8f_6c3c43e36f48.slice/crio-b4c8f4a31b76f55aaaa7ea2ab5f47e3f402098af196efcd894d441944b4fbafa WatchSource:0}: Error finding container b4c8f4a31b76f55aaaa7ea2ab5f47e3f402098af196efcd894d441944b4fbafa: Status 404 returned error can't find the container with id b4c8f4a31b76f55aaaa7ea2ab5f47e3f402098af196efcd894d441944b4fbafa
Jul 24 13:45:06.249482 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.249448    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"]
Jul 24 13:45:06.252745 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.252729    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.255493 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.255469    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 24 13:45:06.255612 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.255469    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 24 13:45:06.255612 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.255553    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 24 13:45:06.255612 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.255475    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-659nq\""
Jul 24 13:45:06.255759 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.255475    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 24 13:45:06.255759 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.255471    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 24 13:45:06.261231 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.261212    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"]
Jul 24 13:45:06.339724 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.339691    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce526fee-4295-49d3-8506-c76bca20bd98-cert\") pod \"lws-controller-manager-7f486947b8-zqnxm\" (UID: \"ce526fee-4295-49d3-8506-c76bca20bd98\") " pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.339922 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.339735    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4n79\" (UniqueName: \"kubernetes.io/projected/ce526fee-4295-49d3-8506-c76bca20bd98-kube-api-access-f4n79\") pod \"lws-controller-manager-7f486947b8-zqnxm\" (UID: \"ce526fee-4295-49d3-8506-c76bca20bd98\") " pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.339922 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.339779    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce526fee-4295-49d3-8506-c76bca20bd98-metrics-cert\") pod \"lws-controller-manager-7f486947b8-zqnxm\" (UID: \"ce526fee-4295-49d3-8506-c76bca20bd98\") " pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.339922 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.339816    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ce526fee-4295-49d3-8506-c76bca20bd98-manager-config\") pod \"lws-controller-manager-7f486947b8-zqnxm\" (UID: \"ce526fee-4295-49d3-8506-c76bca20bd98\") " pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.441092 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.441062    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ce526fee-4295-49d3-8506-c76bca20bd98-manager-config\") pod \"lws-controller-manager-7f486947b8-zqnxm\" (UID: \"ce526fee-4295-49d3-8506-c76bca20bd98\") " pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.441296 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.441120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce526fee-4295-49d3-8506-c76bca20bd98-cert\") pod \"lws-controller-manager-7f486947b8-zqnxm\" (UID: \"ce526fee-4295-49d3-8506-c76bca20bd98\") " pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.441296 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.441147    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4n79\" (UniqueName: \"kubernetes.io/projected/ce526fee-4295-49d3-8506-c76bca20bd98-kube-api-access-f4n79\") pod \"lws-controller-manager-7f486947b8-zqnxm\" (UID: \"ce526fee-4295-49d3-8506-c76bca20bd98\") " pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.441296 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.441177    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce526fee-4295-49d3-8506-c76bca20bd98-metrics-cert\") pod \"lws-controller-manager-7f486947b8-zqnxm\" (UID: \"ce526fee-4295-49d3-8506-c76bca20bd98\") " pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.441807 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.441773    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ce526fee-4295-49d3-8506-c76bca20bd98-manager-config\") pod \"lws-controller-manager-7f486947b8-zqnxm\" (UID: \"ce526fee-4295-49d3-8506-c76bca20bd98\") " pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.443738 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.443715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ce526fee-4295-49d3-8506-c76bca20bd98-cert\") pod \"lws-controller-manager-7f486947b8-zqnxm\" (UID: \"ce526fee-4295-49d3-8506-c76bca20bd98\") " pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.443738 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.443734    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce526fee-4295-49d3-8506-c76bca20bd98-metrics-cert\") pod \"lws-controller-manager-7f486947b8-zqnxm\" (UID: \"ce526fee-4295-49d3-8506-c76bca20bd98\") " pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.453030 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.453010    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4n79\" (UniqueName: \"kubernetes.io/projected/ce526fee-4295-49d3-8506-c76bca20bd98-kube-api-access-f4n79\") pod \"lws-controller-manager-7f486947b8-zqnxm\" (UID: \"ce526fee-4295-49d3-8506-c76bca20bd98\") " pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.563503 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.563401    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:06.691800 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.691765    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"]
Jul 24 13:45:06.695515 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:45:06.695490    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce526fee_4295_49d3_8506_c76bca20bd98.slice/crio-669e0de0474e5823901822dc2e112d9780aff193fcdb0c809f997fbc76191e3d WatchSource:0}: Error finding container 669e0de0474e5823901822dc2e112d9780aff193fcdb0c809f997fbc76191e3d: Status 404 returned error can't find the container with id 669e0de0474e5823901822dc2e112d9780aff193fcdb0c809f997fbc76191e3d
Jul 24 13:45:06.898747 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.898618    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm" event={"ID":"ce526fee-4295-49d3-8506-c76bca20bd98","Type":"ContainerStarted","Data":"669e0de0474e5823901822dc2e112d9780aff193fcdb0c809f997fbc76191e3d"}
Jul 24 13:45:06.900193 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:06.900159    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl" event={"ID":"9b96e249-442e-4b3b-bb8f-6c3c43e36f48","Type":"ContainerStarted","Data":"b4c8f4a31b76f55aaaa7ea2ab5f47e3f402098af196efcd894d441944b4fbafa"}
Jul 24 13:45:08.836426 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:08.836391    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 13:45:08.836718 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:08.836469    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 13:45:08.836718 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:08.836501    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 13:45:09.917351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:09.917312    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl" event={"ID":"9b96e249-442e-4b3b-bb8f-6c3c43e36f48","Type":"ContainerStarted","Data":"b64b4fe35301ff598d74cb911b19ef164cd6c6dca572f468700c8ec12b898243"}
Jul 24 13:45:09.940144 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:09.939718    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl" podStartSLOduration=2.118328296 podStartE2EDuration="4.939695819s" totalImagesPullingTime="2.821367523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:09.938906989 +0000 UTC m=+405.300280294" watchObservedRunningTime="2026-07-24 13:45:09.939695819 +0000 UTC m=+405.301069123"
Jul 24 13:45:10.854812 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:10.854773    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:10.859644 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:10.859620    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:10.923263 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:10.923228    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm" event={"ID":"ce526fee-4295-49d3-8506-c76bca20bd98","Type":"ContainerStarted","Data":"0ab2ffe21a7601928d18b55104e52e5372f9d8fe848fef444d47f25e3652ab72"}
Jul 24 13:45:10.923734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:10.923363    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:45:10.923734 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:10.923392    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:10.924386 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:10.924366    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl"
Jul 24 13:45:10.943215 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:10.943163    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm" podStartSLOduration=0.926570312 podStartE2EDuration="4.943150068s" totalImagesPullingTime="4.016579756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:45:10.942179613 +0000 UTC m=+406.303552917" watchObservedRunningTime="2026-07-24 13:45:10.943150068 +0000 UTC m=+406.304523371"
Jul 24 13:45:21.929705 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:45:21.929669    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7f486947b8-zqnxm"
Jul 24 13:47:42.392231 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.392199    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"]
Jul 24 13:47:42.395482 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.395458    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.401880 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.398313    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-wpxvp\""
Jul 24 13:47:42.406691 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.406658    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"]
Jul 24 13:47:42.472809 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.472771    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.472809 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.472811    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/908772b2-f9e5-4479-b7c9-ed4049b624a4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.473088 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.472832    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.473088 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.472944    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spbk6\" (UniqueName: \"kubernetes.io/projected/908772b2-f9e5-4479-b7c9-ed4049b624a4-kube-api-access-spbk6\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.473088 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.472971    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.473088 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.473016    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/908772b2-f9e5-4479-b7c9-ed4049b624a4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.473088 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.473047    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/908772b2-f9e5-4479-b7c9-ed4049b624a4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.473298 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.473118    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.473298 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.473158    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.574320 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.574280    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.574510 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.574332    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spbk6\" (UniqueName: \"kubernetes.io/projected/908772b2-f9e5-4479-b7c9-ed4049b624a4-kube-api-access-spbk6\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.574510 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.574362    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.574510 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.574390    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/908772b2-f9e5-4479-b7c9-ed4049b624a4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.574510 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.574430    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/908772b2-f9e5-4479-b7c9-ed4049b624a4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.574510 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.574465    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.574510 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.574488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.574810 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.574561    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.574810 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.574590    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/908772b2-f9e5-4479-b7c9-ed4049b624a4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.574810 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.574793    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.575009 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.574831    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.575009 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.574895    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.575107 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.575032    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.575221 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.575199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/908772b2-f9e5-4479-b7c9-ed4049b624a4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.576847 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.576822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/908772b2-f9e5-4479-b7c9-ed4049b624a4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.576993 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.576977    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/908772b2-f9e5-4479-b7c9-ed4049b624a4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.581539 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.581515    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/908772b2-f9e5-4479-b7c9-ed4049b624a4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.582081 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.582066    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spbk6\" (UniqueName: \"kubernetes.io/projected/908772b2-f9e5-4479-b7c9-ed4049b624a4-kube-api-access-spbk6\") pod \"maas-default-gateway-openshift-default-78bb78ff78-4pp26\" (UID: \"908772b2-f9e5-4479-b7c9-ed4049b624a4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.712278 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.712240    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:42.846518 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.846436    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"]
Jul 24 13:47:42.848956 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:47:42.848921    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908772b2_f9e5_4479_b7c9_ed4049b624a4.slice/crio-c0283932afc6d570ebe5a915f7c5d88045937631b3c46dffa567e2e5d59006fd WatchSource:0}: Error finding container c0283932afc6d570ebe5a915f7c5d88045937631b3c46dffa567e2e5d59006fd: Status 404 returned error can't find the container with id c0283932afc6d570ebe5a915f7c5d88045937631b3c46dffa567e2e5d59006fd
Jul 24 13:47:42.851517 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.851456    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 13:47:42.851604 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.851547    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 13:47:42.851604 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:42.851575    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 13:47:43.556445 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:43.556410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26" event={"ID":"908772b2-f9e5-4479-b7c9-ed4049b624a4","Type":"ContainerStarted","Data":"8e0d4266e89483c2078e11492bd142a8cb371b2d1575a3d0ede5b925fbaebc4a"}
Jul 24 13:47:43.556844 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:43.556459    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26" event={"ID":"908772b2-f9e5-4479-b7c9-ed4049b624a4","Type":"ContainerStarted","Data":"c0283932afc6d570ebe5a915f7c5d88045937631b3c46dffa567e2e5d59006fd"}
Jul 24 13:47:43.576638 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:43.576587    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26" podStartSLOduration=1.5765724140000001 podStartE2EDuration="1.576572414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:47:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:47:43.574342817 +0000 UTC m=+558.935716120" watchObservedRunningTime="2026-07-24 13:47:43.576572414 +0000 UTC m=+558.937945717"
Jul 24 13:47:43.713131 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:43.713099    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:43.717531 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:43.717507    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:44.561351 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:44.561320    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:44.562249 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:44.562232    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:47:55.732155 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.732114    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:47:55.735688 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.735665    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-h9g72"
Jul 24 13:47:55.738177 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.738156    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 24 13:47:55.738177 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.738173    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 24 13:47:55.738341 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.738185    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2sl75\""
Jul 24 13:47:55.738790 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.738777    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 24 13:47:55.745502 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.745479    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:47:55.770327 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.770291    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:47:55.788421 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.788398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d819deb4-d003-48ae-82b6-667ba08f30f9-config-file\") pod \"limitador-limitador-54d6d988d5-h9g72\" (UID: \"d819deb4-d003-48ae-82b6-667ba08f30f9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h9g72"
Jul 24 13:47:55.788503 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.788458    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6dck\" (UniqueName: \"kubernetes.io/projected/d819deb4-d003-48ae-82b6-667ba08f30f9-kube-api-access-d6dck\") pod \"limitador-limitador-54d6d988d5-h9g72\" (UID: \"d819deb4-d003-48ae-82b6-667ba08f30f9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h9g72"
Jul 24 13:47:55.889577 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.889544    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6dck\" (UniqueName: \"kubernetes.io/projected/d819deb4-d003-48ae-82b6-667ba08f30f9-kube-api-access-d6dck\") pod \"limitador-limitador-54d6d988d5-h9g72\" (UID: \"d819deb4-d003-48ae-82b6-667ba08f30f9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h9g72"
Jul 24 13:47:55.889739 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.889606    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d819deb4-d003-48ae-82b6-667ba08f30f9-config-file\") pod \"limitador-limitador-54d6d988d5-h9g72\" (UID: \"d819deb4-d003-48ae-82b6-667ba08f30f9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h9g72"
Jul 24 13:47:55.890226 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.890208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d819deb4-d003-48ae-82b6-667ba08f30f9-config-file\") pod \"limitador-limitador-54d6d988d5-h9g72\" (UID: \"d819deb4-d003-48ae-82b6-667ba08f30f9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h9g72"
Jul 24 13:47:55.897314 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:55.897288    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6dck\" (UniqueName: \"kubernetes.io/projected/d819deb4-d003-48ae-82b6-667ba08f30f9-kube-api-access-d6dck\") pod \"limitador-limitador-54d6d988d5-h9g72\" (UID: \"d819deb4-d003-48ae-82b6-667ba08f30f9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-h9g72"
Jul 24 13:47:56.048110 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:56.048021    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-h9g72"
Jul 24 13:47:56.177397 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:56.177372    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:47:56.179453 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:47:56.179420    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd819deb4_d003_48ae_82b6_667ba08f30f9.slice/crio-0d7f958365ac30e6c1e8cc325045e56f64440f36d2e9505b4e6f6e374761f529 WatchSource:0}: Error finding container 0d7f958365ac30e6c1e8cc325045e56f64440f36d2e9505b4e6f6e374761f529: Status 404 returned error can't find the container with id 0d7f958365ac30e6c1e8cc325045e56f64440f36d2e9505b4e6f6e374761f529
Jul 24 13:47:56.331767 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:56.331690    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-2qx9b"]
Jul 24 13:47:56.335972 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:56.335956    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2qx9b"
Jul 24 13:47:56.338362 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:56.338338    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qjlpp\""
Jul 24 13:47:56.339197 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:56.339177    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2qx9b"]
Jul 24 13:47:56.394463 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:56.394431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grvth\" (UniqueName: \"kubernetes.io/projected/81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a-kube-api-access-grvth\") pod \"authorino-75d556bd77-2qx9b\" (UID: \"81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a\") " pod="kuadrant-system/authorino-75d556bd77-2qx9b"
Jul 24 13:47:56.495656 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:56.495621    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grvth\" (UniqueName: \"kubernetes.io/projected/81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a-kube-api-access-grvth\") pod \"authorino-75d556bd77-2qx9b\" (UID: \"81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a\") " pod="kuadrant-system/authorino-75d556bd77-2qx9b"
Jul 24 13:47:56.504137 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:56.504102    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grvth\" (UniqueName: \"kubernetes.io/projected/81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a-kube-api-access-grvth\") pod \"authorino-75d556bd77-2qx9b\" (UID: \"81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a\") " pod="kuadrant-system/authorino-75d556bd77-2qx9b"
Jul 24 13:47:56.622349 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:56.622254    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-h9g72" event={"ID":"d819deb4-d003-48ae-82b6-667ba08f30f9","Type":"ContainerStarted","Data":"0d7f958365ac30e6c1e8cc325045e56f64440f36d2e9505b4e6f6e374761f529"}
Jul 24 13:47:56.654314 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:56.654277    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2qx9b"
Jul 24 13:47:56.830285 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:56.830241    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2qx9b"]
Jul 24 13:47:56.834208 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:47:56.834170    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81fa262c_4dd0_46f2_b6e4_f3a0b663ae0a.slice/crio-7ac029a74b5839055abef34883ee1dbed4c6763b9750ca1fc64f503028f05399 WatchSource:0}: Error finding container 7ac029a74b5839055abef34883ee1dbed4c6763b9750ca1fc64f503028f05399: Status 404 returned error can't find the container with id 7ac029a74b5839055abef34883ee1dbed4c6763b9750ca1fc64f503028f05399
Jul 24 13:47:57.630066 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:47:57.630023    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2qx9b" event={"ID":"81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a","Type":"ContainerStarted","Data":"7ac029a74b5839055abef34883ee1dbed4c6763b9750ca1fc64f503028f05399"}
Jul 24 13:48:00.645907 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:00.645835    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2qx9b" event={"ID":"81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a","Type":"ContainerStarted","Data":"165e9c84f24b025cc38e2f97ef5c7cb1192632b8795ee1834ef118e3b8d93221"}
Jul 24 13:48:00.647409 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:00.647379    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-h9g72" event={"ID":"d819deb4-d003-48ae-82b6-667ba08f30f9","Type":"ContainerStarted","Data":"6819c36e673036b11c646a94bfa263fd4db5807a4a3a3827a5321f1ec0f33afe"}
Jul 24 13:48:00.647532 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:00.647454    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-h9g72"
Jul 24 13:48:00.661635 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:00.661579    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-2qx9b" podStartSLOduration=1.043491423 podStartE2EDuration="4.66156482s" totalImagesPullingTime="3.618073397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:48:00.660161014 +0000 UTC m=+576.021534317" watchObservedRunningTime="2026-07-24 13:48:00.66156482 +0000 UTC m=+576.022938124"
Jul 24 13:48:00.677065 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:00.677003    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-h9g72" podStartSLOduration=1.41101452 podStartE2EDuration="5.676988698s" totalImagesPullingTime="4.265974178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:48:00.674158914 +0000 UTC m=+576.035532212" watchObservedRunningTime="2026-07-24 13:48:00.676988698 +0000 UTC m=+576.038362002"
Jul 24 13:48:11.652422 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:11.652389    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-h9g72"
Jul 24 13:48:31.383354 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.383324    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2qx9b"]
Jul 24 13:48:31.383984 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.383503    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-2qx9b" podUID="81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a" containerName="authorino" containerID="cri-o://165e9c84f24b025cc38e2f97ef5c7cb1192632b8795ee1834ef118e3b8d93221" gracePeriod=30
Jul 24 13:48:31.659188 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.659120    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2qx9b"
Jul 24 13:48:31.705709 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.705671    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grvth\" (UniqueName: \"kubernetes.io/projected/81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a-kube-api-access-grvth\") pod \"81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a\" (UID: \"81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a\") "
Jul 24 13:48:31.707980 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.707952    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a-kube-api-access-grvth" (OuterVolumeSpecName: "kube-api-access-grvth") pod "81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a" (UID: "81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a"). InnerVolumeSpecName "kube-api-access-grvth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 13:48:31.785454 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.785417    2559 generic.go:356] "Generic (PLEG): container finished" podID="81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a" containerID="165e9c84f24b025cc38e2f97ef5c7cb1192632b8795ee1834ef118e3b8d93221" exitCode=0
Jul 24 13:48:31.785620 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.785461    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-2qx9b"
Jul 24 13:48:31.785620 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.785497    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2qx9b" event={"ID":"81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a","Type":"ContainerDied","Data":"165e9c84f24b025cc38e2f97ef5c7cb1192632b8795ee1834ef118e3b8d93221"}
Jul 24 13:48:31.785620 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.785545    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-2qx9b" event={"ID":"81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a","Type":"ContainerDied","Data":"7ac029a74b5839055abef34883ee1dbed4c6763b9750ca1fc64f503028f05399"}
Jul 24 13:48:31.785620 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.785567    2559 scope.go:117] "RemoveContainer" containerID="165e9c84f24b025cc38e2f97ef5c7cb1192632b8795ee1834ef118e3b8d93221"
Jul 24 13:48:31.794694 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.794671    2559 scope.go:117] "RemoveContainer" containerID="165e9c84f24b025cc38e2f97ef5c7cb1192632b8795ee1834ef118e3b8d93221"
Jul 24 13:48:31.794998 ip-10-0-139-47 kubenswrapper[2559]: E0724 13:48:31.794975    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"165e9c84f24b025cc38e2f97ef5c7cb1192632b8795ee1834ef118e3b8d93221\": container with ID starting with 165e9c84f24b025cc38e2f97ef5c7cb1192632b8795ee1834ef118e3b8d93221 not found: ID does not exist" containerID="165e9c84f24b025cc38e2f97ef5c7cb1192632b8795ee1834ef118e3b8d93221"
Jul 24 13:48:31.795054 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.795007    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"165e9c84f24b025cc38e2f97ef5c7cb1192632b8795ee1834ef118e3b8d93221"} err="failed to get container status \"165e9c84f24b025cc38e2f97ef5c7cb1192632b8795ee1834ef118e3b8d93221\": rpc error: code = NotFound desc = could not find container \"165e9c84f24b025cc38e2f97ef5c7cb1192632b8795ee1834ef118e3b8d93221\": container with ID starting with 165e9c84f24b025cc38e2f97ef5c7cb1192632b8795ee1834ef118e3b8d93221 not found: ID does not exist"
Jul 24 13:48:31.806079 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.806054    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2qx9b"]
Jul 24 13:48:31.806436 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.806415    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grvth\" (UniqueName: \"kubernetes.io/projected/81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a-kube-api-access-grvth\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 13:48:31.811539 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:31.811514    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-2qx9b"]
Jul 24 13:48:33.194406 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:48:33.194377    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a" path="/var/lib/kubelet/pods/81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a/volumes"
Jul 24 13:49:12.560062 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:12.560027    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:49:19.999904 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:19.999869    2559 generic.go:356] "Generic (PLEG): container finished" podID="908772b2-f9e5-4479-b7c9-ed4049b624a4" containerID="8e0d4266e89483c2078e11492bd142a8cb371b2d1575a3d0ede5b925fbaebc4a" exitCode=0
Jul 24 13:49:20.000325 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:19.999932    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26" event={"ID":"908772b2-f9e5-4479-b7c9-ed4049b624a4","Type":"ContainerDied","Data":"8e0d4266e89483c2078e11492bd142a8cb371b2d1575a3d0ede5b925fbaebc4a"}
Jul 24 13:49:20.000325 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:20.000314    2559 scope.go:117] "RemoveContainer" containerID="8e0d4266e89483c2078e11492bd142a8cb371b2d1575a3d0ede5b925fbaebc4a"
Jul 24 13:49:20.001343 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:20.001317    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 13:49:20.001437 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:20.001382    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 13:49:20.001437 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:20.001413    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 13:49:21.009382 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:21.009339    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26" event={"ID":"908772b2-f9e5-4479-b7c9-ed4049b624a4","Type":"ContainerStarted","Data":"aca3969b357c5d6732aa1205fe03eada97f341a9cf7a104d8d3aec1c1e8dde55"}
Jul 24 13:49:21.713231 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:21.713192    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:49:21.713442 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:21.713314    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4pp26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Jul 24 13:49:21.713442 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:21.713364    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26" podUID="908772b2-f9e5-4479-b7c9-ed4049b624a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 24 13:49:22.713541 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:22.713298    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4pp26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Jul 24 13:49:22.713541 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:22.713363    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26" podUID="908772b2-f9e5-4479-b7c9-ed4049b624a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 24 13:49:23.713312 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:23.713267    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4pp26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Jul 24 13:49:23.713571 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:23.713350    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26" podUID="908772b2-f9e5-4479-b7c9-ed4049b624a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 24 13:49:24.714226 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:24.713726    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-4pp26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Jul 24 13:49:24.714226 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:24.713797    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26" podUID="908772b2-f9e5-4479-b7c9-ed4049b624a4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Jul 24 13:49:25.716485 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:25.716454    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:49:25.716904 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:25.716750    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:49:25.717461 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:25.717441    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-4pp26"
Jul 24 13:49:33.132652 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:33.132616    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:49:40.714029 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:49:40.713994    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:50:05.413345 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:05.413310    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:50:07.615919 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.615887    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"]
Jul 24 13:50:07.616312 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.616257    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a" containerName="authorino"
Jul 24 13:50:07.616312 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.616268    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a" containerName="authorino"
Jul 24 13:50:07.616393 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.616331    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="81fa262c-4dd0-46f2-b6e4-f3a0b663ae0a" containerName="authorino"
Jul 24 13:50:07.618467 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.618445    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.622262 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.622238    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 24 13:50:07.622262 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.622255    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 24 13:50:07.622443 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.622245    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 24 13:50:07.622443 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.622245    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9qk2t\""
Jul 24 13:50:07.627825 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.627801    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"]
Jul 24 13:50:07.725471 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.725432    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35fb468d-1c01-4946-ac32-ba8be76ff277-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.725471 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.725469    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35fb468d-1c01-4946-ac32-ba8be76ff277-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.725739 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.725497    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35fb468d-1c01-4946-ac32-ba8be76ff277-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.725739 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.725588    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzjt5\" (UniqueName: \"kubernetes.io/projected/35fb468d-1c01-4946-ac32-ba8be76ff277-kube-api-access-hzjt5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.725739 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.725628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35fb468d-1c01-4946-ac32-ba8be76ff277-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.725739 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.725696    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35fb468d-1c01-4946-ac32-ba8be76ff277-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.826785 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.826749    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35fb468d-1c01-4946-ac32-ba8be76ff277-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.826785 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.826790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35fb468d-1c01-4946-ac32-ba8be76ff277-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.827069 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.826921    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35fb468d-1c01-4946-ac32-ba8be76ff277-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.827069 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.826967    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzjt5\" (UniqueName: \"kubernetes.io/projected/35fb468d-1c01-4946-ac32-ba8be76ff277-kube-api-access-hzjt5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.827069 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.826997    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35fb468d-1c01-4946-ac32-ba8be76ff277-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.827069 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.827043    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35fb468d-1c01-4946-ac32-ba8be76ff277-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.827279 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.827238    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35fb468d-1c01-4946-ac32-ba8be76ff277-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.827321 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.827270    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35fb468d-1c01-4946-ac32-ba8be76ff277-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.827321 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.827313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35fb468d-1c01-4946-ac32-ba8be76ff277-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.829342 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.829313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35fb468d-1c01-4946-ac32-ba8be76ff277-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.829557 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.829538    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35fb468d-1c01-4946-ac32-ba8be76ff277-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.834920 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.834903    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzjt5\" (UniqueName: \"kubernetes.io/projected/35fb468d-1c01-4946-ac32-ba8be76ff277-kube-api-access-hzjt5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4\" (UID: \"35fb468d-1c01-4946-ac32-ba8be76ff277\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:07.929218 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:07.929115    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:08.056502 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:08.056476    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"]
Jul 24 13:50:08.058561 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:50:08.058537    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35fb468d_1c01_4946_ac32_ba8be76ff277.slice/crio-92e03f7e93c827a0ce5867982c3cec4f76a3f43ee81c32112aa0ab1496a77f4b WatchSource:0}: Error finding container 92e03f7e93c827a0ce5867982c3cec4f76a3f43ee81c32112aa0ab1496a77f4b: Status 404 returned error can't find the container with id 92e03f7e93c827a0ce5867982c3cec4f76a3f43ee81c32112aa0ab1496a77f4b
Jul 24 13:50:08.060281 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:08.060263    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 13:50:08.231638 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:08.231606    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4" event={"ID":"35fb468d-1c01-4946-ac32-ba8be76ff277","Type":"ContainerStarted","Data":"92e03f7e93c827a0ce5867982c3cec4f76a3f43ee81c32112aa0ab1496a77f4b"}
Jul 24 13:50:10.239116 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:10.239068    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:50:10.244397 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:10.244374    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4" event={"ID":"35fb468d-1c01-4946-ac32-ba8be76ff277","Type":"ContainerStarted","Data":"5d2a90fa33b3b0f2cb87b4386a046ba686043bba817d54de9c6f66b5bf9ff1af"}
Jul 24 13:50:10.264776 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:10.264724    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4" podStartSLOduration=1.8464280020000001 podStartE2EDuration="3.264710271s" totalImagesPullingTime="1.418282269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:10.263329097 +0000 UTC m=+705.624702402" watchObservedRunningTime="2026-07-24 13:50:10.264710271 +0000 UTC m=+705.626083573"
Jul 24 13:50:17.929823 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:17.929737    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:17.930330 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:17.929817    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:17.942369 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:17.942345    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:18.289431 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:18.289405    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4"
Jul 24 13:50:20.018267 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:20.018230    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:50:28.820338 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:28.820306    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"]
Jul 24 13:50:28.823635 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:28.823610    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:28.826109 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:28.826084    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 24 13:50:28.834499 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:28.834472    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"]
Jul 24 13:50:28.919139 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:28.919106    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:28.919310 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:28.919160    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:28.919310 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:28.919257    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:28.919310 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:28.919295    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:28.919443 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:28.919355    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:28.919443 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:28.919381    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhnvs\" (UniqueName: \"kubernetes.io/projected/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-kube-api-access-qhnvs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.020820 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.020784    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.021033 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.020833    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.021033 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.020889    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhnvs\" (UniqueName: \"kubernetes.io/projected/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-kube-api-access-qhnvs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.021033 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.020933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.021033 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.021002    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.021245 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.021071    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.021303 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.021268    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.021406 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.021390    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.021459 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.021391    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.023126 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.023107    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.023489 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.023466    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.028881 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.028826    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhnvs\" (UniqueName: \"kubernetes.io/projected/f5eeed37-5a64-4591-be7c-7f37bbf04ce8-kube-api-access-qhnvs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-wknxh\" (UID: \"f5eeed37-5a64-4591-be7c-7f37bbf04ce8\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.145851 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.145743    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:29.276978 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.276721    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"]
Jul 24 13:50:29.279182 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:50:29.279154    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5eeed37_5a64_4591_be7c_7f37bbf04ce8.slice/crio-ef84537145fc1278e6e26d6bb9c8f4dcc408136bf5a8a4e3753ccfd7ecb38cca WatchSource:0}: Error finding container ef84537145fc1278e6e26d6bb9c8f4dcc408136bf5a8a4e3753ccfd7ecb38cca: Status 404 returned error can't find the container with id ef84537145fc1278e6e26d6bb9c8f4dcc408136bf5a8a4e3753ccfd7ecb38cca
Jul 24 13:50:29.332299 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:29.332269    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh" event={"ID":"f5eeed37-5a64-4591-be7c-7f37bbf04ce8","Type":"ContainerStarted","Data":"ef84537145fc1278e6e26d6bb9c8f4dcc408136bf5a8a4e3753ccfd7ecb38cca"}
Jul 24 13:50:30.338404 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:30.338368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh" event={"ID":"f5eeed37-5a64-4591-be7c-7f37bbf04ce8","Type":"ContainerStarted","Data":"49e7ff86a062f03a34626283d2b1c440f98ba5498d0102dd0733bf7bee430b9c"}
Jul 24 13:50:30.356272 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:30.356217    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh" podStartSLOduration=2.195227126 podStartE2EDuration="2.356200551s" totalImagesPullingTime="160.973425ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:50:30.355004234 +0000 UTC m=+725.716377538" watchObservedRunningTime="2026-07-24 13:50:30.356200551 +0000 UTC m=+725.717573854"
Jul 24 13:50:31.521462 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:31.521424    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:50:39.145887 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:39.145843    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:39.146347 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:39.146147    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:39.157902 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:39.157881    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:50:39.389451 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:50:39.389420    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-wknxh"
Jul 24 13:51:34.146277 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.146244    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-668f95b49b-zz72f"]
Jul 24 13:51:34.149931 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.149912    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-668f95b49b-zz72f"
Jul 24 13:51:34.153096 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.153077    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 24 13:51:34.153199 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.153114    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-qjlpp\""
Jul 24 13:51:34.156152 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.156132    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-668f95b49b-zz72f"]
Jul 24 13:51:34.208374 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.208344    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/864a241c-4f2f-4820-ad07-f6380bfb0a15-tls-cert\") pod \"authorino-668f95b49b-zz72f\" (UID: \"864a241c-4f2f-4820-ad07-f6380bfb0a15\") " pod="kuadrant-system/authorino-668f95b49b-zz72f"
Jul 24 13:51:34.208374 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.208374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxbtz\" (UniqueName: \"kubernetes.io/projected/864a241c-4f2f-4820-ad07-f6380bfb0a15-kube-api-access-gxbtz\") pod \"authorino-668f95b49b-zz72f\" (UID: \"864a241c-4f2f-4820-ad07-f6380bfb0a15\") " pod="kuadrant-system/authorino-668f95b49b-zz72f"
Jul 24 13:51:34.309904 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.309839    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/864a241c-4f2f-4820-ad07-f6380bfb0a15-tls-cert\") pod \"authorino-668f95b49b-zz72f\" (UID: \"864a241c-4f2f-4820-ad07-f6380bfb0a15\") " pod="kuadrant-system/authorino-668f95b49b-zz72f"
Jul 24 13:51:34.309904 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.309904    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxbtz\" (UniqueName: \"kubernetes.io/projected/864a241c-4f2f-4820-ad07-f6380bfb0a15-kube-api-access-gxbtz\") pod \"authorino-668f95b49b-zz72f\" (UID: \"864a241c-4f2f-4820-ad07-f6380bfb0a15\") " pod="kuadrant-system/authorino-668f95b49b-zz72f"
Jul 24 13:51:34.312198 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.312173    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/864a241c-4f2f-4820-ad07-f6380bfb0a15-tls-cert\") pod \"authorino-668f95b49b-zz72f\" (UID: \"864a241c-4f2f-4820-ad07-f6380bfb0a15\") " pod="kuadrant-system/authorino-668f95b49b-zz72f"
Jul 24 13:51:34.318078 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.318055    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxbtz\" (UniqueName: \"kubernetes.io/projected/864a241c-4f2f-4820-ad07-f6380bfb0a15-kube-api-access-gxbtz\") pod \"authorino-668f95b49b-zz72f\" (UID: \"864a241c-4f2f-4820-ad07-f6380bfb0a15\") " pod="kuadrant-system/authorino-668f95b49b-zz72f"
Jul 24 13:51:34.459611 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.459583    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-668f95b49b-zz72f"
Jul 24 13:51:34.608660 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.608635    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-668f95b49b-zz72f"]
Jul 24 13:51:34.611252 ip-10-0-139-47 kubenswrapper[2559]: W0724 13:51:34.611222    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod864a241c_4f2f_4820_ad07_f6380bfb0a15.slice/crio-e1f2fb03ca1d701470fa0e5e566ce9fe2fd62456bd114b6d9cf585fc86183679 WatchSource:0}: Error finding container e1f2fb03ca1d701470fa0e5e566ce9fe2fd62456bd114b6d9cf585fc86183679: Status 404 returned error can't find the container with id e1f2fb03ca1d701470fa0e5e566ce9fe2fd62456bd114b6d9cf585fc86183679
Jul 24 13:51:34.626038 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:34.626006    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-668f95b49b-zz72f" event={"ID":"864a241c-4f2f-4820-ad07-f6380bfb0a15","Type":"ContainerStarted","Data":"e1f2fb03ca1d701470fa0e5e566ce9fe2fd62456bd114b6d9cf585fc86183679"}
Jul 24 13:51:35.632376 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:35.632342    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-668f95b49b-zz72f" event={"ID":"864a241c-4f2f-4820-ad07-f6380bfb0a15","Type":"ContainerStarted","Data":"5691f0f1a39a4ad69f5865f8a39d4343837d02074142b9f1e3367b00fecf6de9"}
Jul 24 13:51:35.648629 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:51:35.648580    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-668f95b49b-zz72f" podStartSLOduration=1.3041523320000001 podStartE2EDuration="1.648565212s" totalImagesPullingTime="344.41288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 13:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 13:51:35.646882086 +0000 UTC m=+791.008255381" watchObservedRunningTime="2026-07-24 13:51:35.648565212 +0000 UTC m=+791.009938499"
Jul 24 13:52:03.822421 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:52:03.822375    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:52:14.417088 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:52:14.417049    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:52:25.626256 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:52:25.626221    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:54:06.822580 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:54:06.822549    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:54:16.639387 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:54:16.639352    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:54:45.619086 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:54:45.619049    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:54:55.512920 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:54:55.512830    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:55:04.523390 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:55:04.523353    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:55:15.921028 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:55:15.920988    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:55:26.722467 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:55:26.722438    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:55:38.819980 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:55:38.819944    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:55:49.622779 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:55:49.622746    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:55:59.724584 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:55:59.724549    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:56:25.522717 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:56:25.522636    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:56:33.722545 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:56:33.722507    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:56:58.325796 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:56:58.325762    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:57:09.118281 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:57:09.118239    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:57:24.927924 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:57:24.927891    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:57:34.525907 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:57:34.525869    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:57:44.632691 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:57:44.632655    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:57:54.121521 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:57:54.121432    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:58:03.628831 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:58:03.628794    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 13:59:55.423292 ip-10-0-139-47 kubenswrapper[2559]: I0724 13:59:55.423255    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:00:06.130260 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:00:06.130219    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:00:15.251638 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:00:15.251595    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:00:26.833833 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:00:26.833794    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:00:39.423403 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:00:39.423366    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:00:49.516952 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:00:49.516868    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:00:57.738953 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:00:57.738915    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:01:09.540456 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:01:09.540417    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:01:20.734246 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:01:20.734191    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:01:29.129087 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:01:29.129048    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:01:40.351379 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:01:40.351344    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:02:04.428070 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:02:04.428035    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:02:12.324424 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:02:12.324383    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:02:24.928129 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:02:24.928042    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:02:37.515698 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:02:37.515659    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:02:55.330046 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:02:55.329999    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:03:09.720536 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:03:09.720496    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:03:20.121219 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:03:20.121174    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:03:32.629117 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:03:32.629083    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:03:42.522682 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:03:42.522644    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:03:52.725337 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:03:52.725230    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:04:01.532374 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:04:01.532337    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:04:12.631126 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:04:12.631087    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:04:22.528473 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:04:22.528427    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:04:33.024901 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:04:33.024840    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:04:49.522210 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:04:49.522170    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:04:59.723734 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:04:59.723699    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:05:09.020717 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:05:09.020682    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:05:20.622112 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:05:20.622023    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:05:38.828798 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:05:38.828761    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:05:50.835628 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:05:50.835585    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:06:00.726820 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:06:00.726782    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:06:08.627478 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:06:08.627426    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:06:21.124499 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:06:21.124458    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:06:42.222176 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:06:42.222142    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:06:59.620221 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:06:59.620178    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:07:33.624266 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:07:33.624233    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:07:45.718340 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:07:45.718305    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:08:16.125527 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:08:16.125490    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:08:28.122802 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:08:28.122761    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:09:01.126276 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:09:01.126229    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:09:13.068639 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:09:13.064428    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:09:45.418400 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:09:45.418369    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:11:14.337287 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:11:14.337250    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:11:24.334285 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:11:24.334195    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:11:35.927585 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:11:35.927544    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:11:54.566578 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:11:54.566539    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:12:33.823819 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:12:33.823767    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:12:57.440700 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:12:57.440613    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:13:13.538390 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:13:13.538351    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:13:35.759409 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:13:35.759368    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:13:44.737239 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:13:44.737203    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:14:51.538359 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:14:51.538325    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:15:00.434848 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:15:00.434813    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:15:49.029708 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:15:49.029625    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:16:04.337093 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:04.337056    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:16:10.341580 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.341552    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"]
Jul 24 14:16:10.345145 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.345123    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.348667 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.348633    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6304ef\"/\"test-model-6304ef-kserve-self-signed-certs\""
Jul 24 14:16:10.348667 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.348648    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6304ef\"/\"default-dockercfg-czcn4\""
Jul 24 14:16:10.348867 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.348674    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6304ef\"/\"openshift-service-ca.crt\""
Jul 24 14:16:10.348867 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.348694    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6304ef\"/\"kube-root-ca.crt\""
Jul 24 14:16:10.356525 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.356503    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"]
Jul 24 14:16:10.452509 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.452473    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-home\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.452509 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.452506    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s75nd\" (UniqueName: \"kubernetes.io/projected/9dabf0aa-b8c0-4593-a97b-b516e479a16e-kube-api-access-s75nd\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.452796 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.452561    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-model-cache\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.452796 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.452609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-tmp-dir\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.452796 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.452644    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dabf0aa-b8c0-4593-a97b-b516e479a16e-tls-certs\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.452796 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.452780    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-dshm\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.554129 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.554089    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-model-cache\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.554333 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.554138    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-tmp-dir\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.554333 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.554162    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dabf0aa-b8c0-4593-a97b-b516e479a16e-tls-certs\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.554333 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.554240    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-dshm\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.554333 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.554289    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-home\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.554333 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.554311    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s75nd\" (UniqueName: \"kubernetes.io/projected/9dabf0aa-b8c0-4593-a97b-b516e479a16e-kube-api-access-s75nd\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.554585 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.554556    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-model-cache\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.554742 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.554715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-tmp-dir\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.554998 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.554975    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-home\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.556971 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.556947    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-dshm\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.557255 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.557237    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dabf0aa-b8c0-4593-a97b-b516e479a16e-tls-certs\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.562711 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.562681    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s75nd\" (UniqueName: \"kubernetes.io/projected/9dabf0aa-b8c0-4593-a97b-b516e479a16e-kube-api-access-s75nd\") pod \"test-model-6304ef-kserve-87666bd77-dnmlh\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") " pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.655193 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.655105    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:10.789846 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:10.789809    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"]
Jul 24 14:16:10.792234 ip-10-0-139-47 kubenswrapper[2559]: W0724 14:16:10.792209    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dabf0aa_b8c0_4593_a97b_b516e479a16e.slice/crio-c8f3f742db145ce8c8d8cae8d0c72f8f00140da6349a2dc7226651df640642e0 WatchSource:0}: Error finding container c8f3f742db145ce8c8d8cae8d0c72f8f00140da6349a2dc7226651df640642e0: Status 404 returned error can't find the container with id c8f3f742db145ce8c8d8cae8d0c72f8f00140da6349a2dc7226651df640642e0
Jul 24 14:16:11.348122 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:11.348080    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh" event={"ID":"9dabf0aa-b8c0-4593-a97b-b516e479a16e","Type":"ContainerStarted","Data":"2641ef29c6dcc578aff0a4f94db475b4dc1ca97f8003b59cb81e9dcb720bc9e4"}
Jul 24 14:16:11.348122 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:11.348128    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh" event={"ID":"9dabf0aa-b8c0-4593-a97b-b516e479a16e","Type":"ContainerStarted","Data":"c8f3f742db145ce8c8d8cae8d0c72f8f00140da6349a2dc7226651df640642e0"}
Jul 24 14:16:11.367603 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:11.367549    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh" podStartSLOduration=1.367532718 podStartE2EDuration="1.367532718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:16:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:16:11.366353099 +0000 UTC m=+2266.727726404" watchObservedRunningTime="2026-07-24 14:16:11.367532718 +0000 UTC m=+2266.728906021"
Jul 24 14:16:14.341828 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:14.341713    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:16:20.655883 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:20.655824    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:20.656341 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:20.655912    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:20.673951 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:20.673915    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:21.409931 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:21.409897    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:16:25.728643 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:25.728605    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:16:33.927327 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:33.927294    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"]
Jul 24 14:16:33.930585 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:33.930562    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:33.933238 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:33.933210    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-406bb9\"/\"kube-root-ca.crt\""
Jul 24 14:16:33.934263 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:33.934240    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-406bb9\"/\"default-dockercfg-4sftg\""
Jul 24 14:16:33.934401 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:33.934297    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-406bb9\"/\"test-model-406bb9-kserve-self-signed-certs\""
Jul 24 14:16:33.934401 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:33.934301    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-406bb9\"/\"openshift-service-ca.crt\""
Jul 24 14:16:33.939607 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:33.939578    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"]
Jul 24 14:16:33.972276 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:33.972240    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-home\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:33.972276 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:33.972284    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8260dc4-1e89-4be5-984f-5b042dea2422-tls-certs\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:33.972515 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:33.972303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wktmb\" (UniqueName: \"kubernetes.io/projected/a8260dc4-1e89-4be5-984f-5b042dea2422-kube-api-access-wktmb\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:33.972515 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:33.972324    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-model-cache\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:33.972515 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:33.972422    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-dshm\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:33.972515 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:33.972474    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-tmp-dir\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.073601 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.073562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-dshm\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.073819 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.073636    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-tmp-dir\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.073819 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.073691    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-home\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.073819 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.073721    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8260dc4-1e89-4be5-984f-5b042dea2422-tls-certs\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.073819 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.073746    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wktmb\" (UniqueName: \"kubernetes.io/projected/a8260dc4-1e89-4be5-984f-5b042dea2422-kube-api-access-wktmb\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.073819 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.073770    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-model-cache\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.074142 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.074115    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-tmp-dir\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.074202 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.074157    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-home\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.074202 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.074185    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-model-cache\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.076008 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.075983    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-dshm\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.076202 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.076187    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8260dc4-1e89-4be5-984f-5b042dea2422-tls-certs\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.082615 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.082590    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wktmb\" (UniqueName: \"kubernetes.io/projected/a8260dc4-1e89-4be5-984f-5b042dea2422-kube-api-access-wktmb\") pod \"test-model-406bb9-kserve-6565b76c5-m7vs9\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") " pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.242244 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.242206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:34.385074 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.385047    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"]
Jul 24 14:16:34.387481 ip-10-0-139-47 kubenswrapper[2559]: W0724 14:16:34.387453    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8260dc4_1e89_4be5_984f_5b042dea2422.slice/crio-ce176c2ba3eedf7846870f388786270c017d39b9b2130d2d0fe1cb22e4fcec00 WatchSource:0}: Error finding container ce176c2ba3eedf7846870f388786270c017d39b9b2130d2d0fe1cb22e4fcec00: Status 404 returned error can't find the container with id ce176c2ba3eedf7846870f388786270c017d39b9b2130d2d0fe1cb22e4fcec00
Jul 24 14:16:34.465534 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.465494    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9" event={"ID":"a8260dc4-1e89-4be5-984f-5b042dea2422","Type":"ContainerStarted","Data":"4eadf58927f06167534eed0bea9e695fe1300c2a49ee72f2405c3a724181832c"}
Jul 24 14:16:34.465690 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.465548    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9" event={"ID":"a8260dc4-1e89-4be5-984f-5b042dea2422","Type":"ContainerStarted","Data":"ce176c2ba3eedf7846870f388786270c017d39b9b2130d2d0fe1cb22e4fcec00"}
Jul 24 14:16:34.483142 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:34.483089    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9" podStartSLOduration=1.48307084 podStartE2EDuration="1.48307084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:16:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:16:34.482410485 +0000 UTC m=+2289.843783802" watchObservedRunningTime="2026-07-24 14:16:34.48307084 +0000 UTC m=+2289.844444143"
Jul 24 14:16:36.925006 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:36.924971    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:16:44.242979 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:44.242934    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:44.243494 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:44.242997    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:44.255455 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:44.255426    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:44.528406 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:44.528303    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:16:55.121540 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:16:55.121496    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:17:12.983389 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:12.983356    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"]
Jul 24 14:17:13.907231 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:13.907186    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"]
Jul 24 14:17:20.022268 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:20.022177    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:17:28.002290 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.002248    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh" podUID="9dabf0aa-b8c0-4593-a97b-b516e479a16e" containerName="main" containerID="cri-o://2641ef29c6dcc578aff0a4f94db475b4dc1ca97f8003b59cb81e9dcb720bc9e4" gracePeriod=45
Jul 24 14:17:28.252547 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.252486    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:17:28.382754 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.382717    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-dshm\") pod \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") "
Jul 24 14:17:28.382969 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.382765    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s75nd\" (UniqueName: \"kubernetes.io/projected/9dabf0aa-b8c0-4593-a97b-b516e479a16e-kube-api-access-s75nd\") pod \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") "
Jul 24 14:17:28.382969 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.382814    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-home\") pod \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") "
Jul 24 14:17:28.382969 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.382903    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-model-cache\") pod \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") "
Jul 24 14:17:28.382969 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.382959    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-tmp-dir\") pod \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") "
Jul 24 14:17:28.383171 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.382993    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dabf0aa-b8c0-4593-a97b-b516e479a16e-tls-certs\") pod \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\" (UID: \"9dabf0aa-b8c0-4593-a97b-b516e479a16e\") "
Jul 24 14:17:28.383171 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.383151    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-home" (OuterVolumeSpecName: "home") pod "9dabf0aa-b8c0-4593-a97b-b516e479a16e" (UID: "9dabf0aa-b8c0-4593-a97b-b516e479a16e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:17:28.383275 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.383186    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9dabf0aa-b8c0-4593-a97b-b516e479a16e" (UID: "9dabf0aa-b8c0-4593-a97b-b516e479a16e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:17:28.383275 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.383208    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-model-cache" (OuterVolumeSpecName: "model-cache") pod "9dabf0aa-b8c0-4593-a97b-b516e479a16e" (UID: "9dabf0aa-b8c0-4593-a97b-b516e479a16e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:17:28.383383 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.383343    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-home\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:17:28.383383 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.383357    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-model-cache\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:17:28.383383 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.383369    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-tmp-dir\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:17:28.385209 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.385177    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dabf0aa-b8c0-4593-a97b-b516e479a16e-kube-api-access-s75nd" (OuterVolumeSpecName: "kube-api-access-s75nd") pod "9dabf0aa-b8c0-4593-a97b-b516e479a16e" (UID: "9dabf0aa-b8c0-4593-a97b-b516e479a16e"). InnerVolumeSpecName "kube-api-access-s75nd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:17:28.385209 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.385190    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-dshm" (OuterVolumeSpecName: "dshm") pod "9dabf0aa-b8c0-4593-a97b-b516e479a16e" (UID: "9dabf0aa-b8c0-4593-a97b-b516e479a16e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:17:28.385360 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.385247    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dabf0aa-b8c0-4593-a97b-b516e479a16e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9dabf0aa-b8c0-4593-a97b-b516e479a16e" (UID: "9dabf0aa-b8c0-4593-a97b-b516e479a16e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:17:28.484302 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.484262    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dabf0aa-b8c0-4593-a97b-b516e479a16e-tls-certs\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:17:28.484302 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.484294    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dabf0aa-b8c0-4593-a97b-b516e479a16e-dshm\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:17:28.484302 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.484304    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s75nd\" (UniqueName: \"kubernetes.io/projected/9dabf0aa-b8c0-4593-a97b-b516e479a16e-kube-api-access-s75nd\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:17:28.724214 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.724177    2559 generic.go:356] "Generic (PLEG): container finished" podID="9dabf0aa-b8c0-4593-a97b-b516e479a16e" containerID="2641ef29c6dcc578aff0a4f94db475b4dc1ca97f8003b59cb81e9dcb720bc9e4" exitCode=0
Jul 24 14:17:28.724412 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.724221    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"
Jul 24 14:17:28.724412 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.724263    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh" event={"ID":"9dabf0aa-b8c0-4593-a97b-b516e479a16e","Type":"ContainerDied","Data":"2641ef29c6dcc578aff0a4f94db475b4dc1ca97f8003b59cb81e9dcb720bc9e4"}
Jul 24 14:17:28.724412 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.724303    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh" event={"ID":"9dabf0aa-b8c0-4593-a97b-b516e479a16e","Type":"ContainerDied","Data":"c8f3f742db145ce8c8d8cae8d0c72f8f00140da6349a2dc7226651df640642e0"}
Jul 24 14:17:28.724412 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.724317    2559 scope.go:117] "RemoveContainer" containerID="2641ef29c6dcc578aff0a4f94db475b4dc1ca97f8003b59cb81e9dcb720bc9e4"
Jul 24 14:17:28.733601 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.733582    2559 scope.go:117] "RemoveContainer" containerID="2641ef29c6dcc578aff0a4f94db475b4dc1ca97f8003b59cb81e9dcb720bc9e4"
Jul 24 14:17:28.733838 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:17:28.733820    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2641ef29c6dcc578aff0a4f94db475b4dc1ca97f8003b59cb81e9dcb720bc9e4\": container with ID starting with 2641ef29c6dcc578aff0a4f94db475b4dc1ca97f8003b59cb81e9dcb720bc9e4 not found: ID does not exist" containerID="2641ef29c6dcc578aff0a4f94db475b4dc1ca97f8003b59cb81e9dcb720bc9e4"
Jul 24 14:17:28.733929 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.733845    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2641ef29c6dcc578aff0a4f94db475b4dc1ca97f8003b59cb81e9dcb720bc9e4"} err="failed to get container status \"2641ef29c6dcc578aff0a4f94db475b4dc1ca97f8003b59cb81e9dcb720bc9e4\": rpc error: code = NotFound desc = could not find container \"2641ef29c6dcc578aff0a4f94db475b4dc1ca97f8003b59cb81e9dcb720bc9e4\": container with ID starting with 2641ef29c6dcc578aff0a4f94db475b4dc1ca97f8003b59cb81e9dcb720bc9e4 not found: ID does not exist"
Jul 24 14:17:28.746151 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.746122    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"]
Jul 24 14:17:28.752146 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.752121    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-6304ef/test-model-6304ef-kserve-87666bd77-dnmlh"]
Jul 24 14:17:28.926445 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:28.926400    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9" podUID="a8260dc4-1e89-4be5-984f-5b042dea2422" containerName="main" containerID="cri-o://4eadf58927f06167534eed0bea9e695fe1300c2a49ee72f2405c3a724181832c" gracePeriod=45
Jul 24 14:17:29.181517 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.181488    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:17:29.194909 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.194846    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dabf0aa-b8c0-4593-a97b-b516e479a16e" path="/var/lib/kubelet/pods/9dabf0aa-b8c0-4593-a97b-b516e479a16e/volumes"
Jul 24 14:17:29.292093 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.291994    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-home\") pod \"a8260dc4-1e89-4be5-984f-5b042dea2422\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") "
Jul 24 14:17:29.292093 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.292050    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8260dc4-1e89-4be5-984f-5b042dea2422-tls-certs\") pod \"a8260dc4-1e89-4be5-984f-5b042dea2422\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") "
Jul 24 14:17:29.292329 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.292103    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-tmp-dir\") pod \"a8260dc4-1e89-4be5-984f-5b042dea2422\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") "
Jul 24 14:17:29.292329 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.292132    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-model-cache\") pod \"a8260dc4-1e89-4be5-984f-5b042dea2422\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") "
Jul 24 14:17:29.292329 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.292153    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wktmb\" (UniqueName: \"kubernetes.io/projected/a8260dc4-1e89-4be5-984f-5b042dea2422-kube-api-access-wktmb\") pod \"a8260dc4-1e89-4be5-984f-5b042dea2422\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") "
Jul 24 14:17:29.292329 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.292179    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-dshm\") pod \"a8260dc4-1e89-4be5-984f-5b042dea2422\" (UID: \"a8260dc4-1e89-4be5-984f-5b042dea2422\") "
Jul 24 14:17:29.292520 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.292349    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-home" (OuterVolumeSpecName: "home") pod "a8260dc4-1e89-4be5-984f-5b042dea2422" (UID: "a8260dc4-1e89-4be5-984f-5b042dea2422"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:17:29.292520 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.292455    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8260dc4-1e89-4be5-984f-5b042dea2422" (UID: "a8260dc4-1e89-4be5-984f-5b042dea2422"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:17:29.292520 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.292464    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8260dc4-1e89-4be5-984f-5b042dea2422" (UID: "a8260dc4-1e89-4be5-984f-5b042dea2422"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:17:29.292520 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.292503    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-home\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:17:29.294450 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.294420    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-dshm" (OuterVolumeSpecName: "dshm") pod "a8260dc4-1e89-4be5-984f-5b042dea2422" (UID: "a8260dc4-1e89-4be5-984f-5b042dea2422"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:17:29.294562 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.294470    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8260dc4-1e89-4be5-984f-5b042dea2422-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8260dc4-1e89-4be5-984f-5b042dea2422" (UID: "a8260dc4-1e89-4be5-984f-5b042dea2422"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:17:29.294562 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.294495    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8260dc4-1e89-4be5-984f-5b042dea2422-kube-api-access-wktmb" (OuterVolumeSpecName: "kube-api-access-wktmb") pod "a8260dc4-1e89-4be5-984f-5b042dea2422" (UID: "a8260dc4-1e89-4be5-984f-5b042dea2422"). InnerVolumeSpecName "kube-api-access-wktmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:17:29.393179 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.393137    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8260dc4-1e89-4be5-984f-5b042dea2422-tls-certs\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:17:29.393179 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.393176    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-tmp-dir\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:17:29.393179 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.393185    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-model-cache\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:17:29.393179 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.393195    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wktmb\" (UniqueName: \"kubernetes.io/projected/a8260dc4-1e89-4be5-984f-5b042dea2422-kube-api-access-wktmb\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:17:29.393457 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.393204    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8260dc4-1e89-4be5-984f-5b042dea2422-dshm\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:17:29.730377 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.730337    2559 generic.go:356] "Generic (PLEG): container finished" podID="a8260dc4-1e89-4be5-984f-5b042dea2422" containerID="4eadf58927f06167534eed0bea9e695fe1300c2a49ee72f2405c3a724181832c" exitCode=0
Jul 24 14:17:29.730560 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.730385    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"
Jul 24 14:17:29.730560 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.730406    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9" event={"ID":"a8260dc4-1e89-4be5-984f-5b042dea2422","Type":"ContainerDied","Data":"4eadf58927f06167534eed0bea9e695fe1300c2a49ee72f2405c3a724181832c"}
Jul 24 14:17:29.730560 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.730445    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9" event={"ID":"a8260dc4-1e89-4be5-984f-5b042dea2422","Type":"ContainerDied","Data":"ce176c2ba3eedf7846870f388786270c017d39b9b2130d2d0fe1cb22e4fcec00"}
Jul 24 14:17:29.730560 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.730470    2559 scope.go:117] "RemoveContainer" containerID="4eadf58927f06167534eed0bea9e695fe1300c2a49ee72f2405c3a724181832c"
Jul 24 14:17:29.739519 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.739497    2559 scope.go:117] "RemoveContainer" containerID="4eadf58927f06167534eed0bea9e695fe1300c2a49ee72f2405c3a724181832c"
Jul 24 14:17:29.739826 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:17:29.739806    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eadf58927f06167534eed0bea9e695fe1300c2a49ee72f2405c3a724181832c\": container with ID starting with 4eadf58927f06167534eed0bea9e695fe1300c2a49ee72f2405c3a724181832c not found: ID does not exist" containerID="4eadf58927f06167534eed0bea9e695fe1300c2a49ee72f2405c3a724181832c"
Jul 24 14:17:29.739897 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.739835    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eadf58927f06167534eed0bea9e695fe1300c2a49ee72f2405c3a724181832c"} err="failed to get container status \"4eadf58927f06167534eed0bea9e695fe1300c2a49ee72f2405c3a724181832c\": rpc error: code = NotFound desc = could not find container \"4eadf58927f06167534eed0bea9e695fe1300c2a49ee72f2405c3a724181832c\": container with ID starting with 4eadf58927f06167534eed0bea9e695fe1300c2a49ee72f2405c3a724181832c not found: ID does not exist"
Jul 24 14:17:29.751351 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.751322    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"]
Jul 24 14:17:29.755579 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:29.755554    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-406bb9/test-model-406bb9-kserve-6565b76c5-m7vs9"]
Jul 24 14:17:30.829193 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:30.829157    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:17:31.194623 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:31.194586    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8260dc4-1e89-4be5-984f-5b042dea2422" path="/var/lib/kubelet/pods/a8260dc4-1e89-4be5-984f-5b042dea2422/volumes"
Jul 24 14:17:50.221559 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:17:50.221515    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:18:09.927468 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:18:09.927430    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:18:26.822729 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:18:26.822691    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:18:43.833206 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:18:43.833168    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:19:10.828487 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:10.828404    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:19:27.529018 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:27.528981    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:19:43.528234 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:43.528197    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:19:52.128273 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.128238    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"]
Jul 24 14:19:52.128657 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.128591    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8260dc4-1e89-4be5-984f-5b042dea2422" containerName="main"
Jul 24 14:19:52.128657 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.128602    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8260dc4-1e89-4be5-984f-5b042dea2422" containerName="main"
Jul 24 14:19:52.128657 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.128632    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dabf0aa-b8c0-4593-a97b-b516e479a16e" containerName="main"
Jul 24 14:19:52.128657 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.128638    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dabf0aa-b8c0-4593-a97b-b516e479a16e" containerName="main"
Jul 24 14:19:52.128799 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.128693    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8260dc4-1e89-4be5-984f-5b042dea2422" containerName="main"
Jul 24 14:19:52.128799 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.128700    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dabf0aa-b8c0-4593-a97b-b516e479a16e" containerName="main"
Jul 24 14:19:52.131599 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.131579    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.134620 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.134601    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a26cce\"/\"kube-root-ca.crt\""
Jul 24 14:19:52.135394 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.135376    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a26cce\"/\"default-dockercfg-jtnct\""
Jul 24 14:19:52.135614 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.135598    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a26cce\"/\"openshift-service-ca.crt\""
Jul 24 14:19:52.135694 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.135675    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a26cce\"/\"auth-test-model-a26cce-kserve-self-signed-certs\""
Jul 24 14:19:52.151501 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.151473    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"]
Jul 24 14:19:52.211318 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.211280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-tmp-dir\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.211485 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.211343    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-dshm\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.211485 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.211406    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmz4h\" (UniqueName: \"kubernetes.io/projected/08f7b41e-d81f-4887-80bf-ed62854dc914-kube-api-access-mmz4h\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.211485 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.211443    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-model-cache\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.211485 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.211472    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08f7b41e-d81f-4887-80bf-ed62854dc914-tls-certs\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.211621 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.211508    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-home\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.312298 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.312261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmz4h\" (UniqueName: \"kubernetes.io/projected/08f7b41e-d81f-4887-80bf-ed62854dc914-kube-api-access-mmz4h\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.312495 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.312373    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-model-cache\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.312495 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.312401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08f7b41e-d81f-4887-80bf-ed62854dc914-tls-certs\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.312495 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.312433    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-home\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.312666 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.312521    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-tmp-dir\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.312666 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.312614    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-dshm\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.312893 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.312847    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-home\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.313091 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.313067    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-tmp-dir\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.313091 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.313082    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-model-cache\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.314977 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.314956    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-dshm\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.315370 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.315353    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08f7b41e-d81f-4887-80bf-ed62854dc914-tls-certs\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.320828 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.320803    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmz4h\" (UniqueName: \"kubernetes.io/projected/08f7b41e-d81f-4887-80bf-ed62854dc914-kube-api-access-mmz4h\") pod \"auth-test-model-a26cce-kserve-bd7d9648c-bvztt\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") " pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.441189 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.441155    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:19:52.576155 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:52.576132    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"]
Jul 24 14:19:52.578349 ip-10-0-139-47 kubenswrapper[2559]: W0724 14:19:52.578316    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08f7b41e_d81f_4887_80bf_ed62854dc914.slice/crio-09ffd7c39227d49ba79822da79cd8ca548b4a91d5699a29a58ebc488599e20f4 WatchSource:0}: Error finding container 09ffd7c39227d49ba79822da79cd8ca548b4a91d5699a29a58ebc488599e20f4: Status 404 returned error can't find the container with id 09ffd7c39227d49ba79822da79cd8ca548b4a91d5699a29a58ebc488599e20f4
Jul 24 14:19:53.385163 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:53.385128    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt" event={"ID":"08f7b41e-d81f-4887-80bf-ed62854dc914","Type":"ContainerStarted","Data":"a41bd37e79f39f4faa6a4f09f67a034cebaa87a267840be31a6c0435b64a268e"}
Jul 24 14:19:53.385163 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:53.385171    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt" event={"ID":"08f7b41e-d81f-4887-80bf-ed62854dc914","Type":"ContainerStarted","Data":"09ffd7c39227d49ba79822da79cd8ca548b4a91d5699a29a58ebc488599e20f4"}
Jul 24 14:19:53.404299 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:53.404248    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt" podStartSLOduration=1.404230885 podStartE2EDuration="1.404230885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:19:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:19:53.403159531 +0000 UTC m=+2488.764532837" watchObservedRunningTime="2026-07-24 14:19:53.404230885 +0000 UTC m=+2488.765604188"
Jul 24 14:19:56.625964 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:19:56.625926    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:20:02.442288 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:02.442253    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:20:02.442746 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:02.442312    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:20:02.454824 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:02.454797    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:20:03.440415 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:03.440385    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:20:13.236941 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.236898    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"]
Jul 24 14:20:13.240241 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.240222    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.243850 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.243817    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cb9aa5\"/\"default-dockercfg-5mqp9\""
Jul 24 14:20:13.244020 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.243845    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cb9aa5\"/\"kube-root-ca.crt\""
Jul 24 14:20:13.244020 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.243845    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cb9aa5\"/\"openshift-service-ca.crt\""
Jul 24 14:20:13.244020 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.243818    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cb9aa5\"/\"auth-test-model-cb9aa5-kserve-self-signed-certs\""
Jul 24 14:20:13.251088 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.251066    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"]
Jul 24 14:20:13.302333 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.302298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-tmp-dir\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.302333 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.302341    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5912e176-bbc9-4258-b37a-0ca5d4047b7b-tls-certs\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.302547 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.302358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-dshm\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.302547 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.302435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6b5h\" (UniqueName: \"kubernetes.io/projected/5912e176-bbc9-4258-b37a-0ca5d4047b7b-kube-api-access-h6b5h\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.302547 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.302484    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-home\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.302547 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.302507    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-model-cache\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.403495 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.403462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-dshm\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.403495 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.403506    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6b5h\" (UniqueName: \"kubernetes.io/projected/5912e176-bbc9-4258-b37a-0ca5d4047b7b-kube-api-access-h6b5h\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.403727 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.403540    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-home\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.403727 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.403559    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-model-cache\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.403727 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.403631    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-tmp-dir\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.403727 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.403651    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5912e176-bbc9-4258-b37a-0ca5d4047b7b-tls-certs\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.404041 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.404017    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-home\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.404113 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.404046    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-tmp-dir\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.404113 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.404082    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-model-cache\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.405792 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.405772    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-dshm\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.406066 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.406048    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5912e176-bbc9-4258-b37a-0ca5d4047b7b-tls-certs\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.412164 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.412134    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6b5h\" (UniqueName: \"kubernetes.io/projected/5912e176-bbc9-4258-b37a-0ca5d4047b7b-kube-api-access-h6b5h\") pod \"auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") " pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.550563 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.550464    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:13.683508 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:13.683426    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"]
Jul 24 14:20:13.686316 ip-10-0-139-47 kubenswrapper[2559]: W0724 14:20:13.686279    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5912e176_bbc9_4258_b37a_0ca5d4047b7b.slice/crio-6d1aadcb24c6ba8f9097a0228b7f8c0c2645d998338f191445c6e631c3dd1b9d WatchSource:0}: Error finding container 6d1aadcb24c6ba8f9097a0228b7f8c0c2645d998338f191445c6e631c3dd1b9d: Status 404 returned error can't find the container with id 6d1aadcb24c6ba8f9097a0228b7f8c0c2645d998338f191445c6e631c3dd1b9d
Jul 24 14:20:14.480214 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:14.480176    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc" event={"ID":"5912e176-bbc9-4258-b37a-0ca5d4047b7b","Type":"ContainerStarted","Data":"d4d962520a47ddc3375cc9ce48e79d09097da6b09a467d7ea5d8269af6397f3f"}
Jul 24 14:20:14.480935 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:14.480226    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc" event={"ID":"5912e176-bbc9-4258-b37a-0ca5d4047b7b","Type":"ContainerStarted","Data":"6d1aadcb24c6ba8f9097a0228b7f8c0c2645d998338f191445c6e631c3dd1b9d"}
Jul 24 14:20:14.503174 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:14.503118    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc" podStartSLOduration=1.503102434 podStartE2EDuration="1.503102434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:20:14.501707629 +0000 UTC m=+2509.863080934" watchObservedRunningTime="2026-07-24 14:20:14.503102434 +0000 UTC m=+2509.864475738"
Jul 24 14:20:16.031726 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:16.031689    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:20:23.550896 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:23.550772    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:23.550896 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:23.550848    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:23.563548 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:23.563513    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:24.536422 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:24.536385    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:20:37.926738 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:37.926695    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:20:56.017447 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:20:56.017407    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:21:13.924541 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:21:13.924504    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:21:29.427211 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:21:29.427169    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:21:48.924496 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:21:48.924406    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:22:03.825027 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:03.824984    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:22:19.903466 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:19.903427    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"]
Jul 24 14:22:21.369608 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:21.369559    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"]
Jul 24 14:22:23.028709 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:23.028672    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:22:34.922514 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:34.922441    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt" podUID="08f7b41e-d81f-4887-80bf-ed62854dc914" containerName="main" containerID="cri-o://a41bd37e79f39f4faa6a4f09f67a034cebaa87a267840be31a6c0435b64a268e" gracePeriod=45
Jul 24 14:22:35.159159 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.159125    2559 generic.go:356] "Generic (PLEG): container finished" podID="08f7b41e-d81f-4887-80bf-ed62854dc914" containerID="a41bd37e79f39f4faa6a4f09f67a034cebaa87a267840be31a6c0435b64a268e" exitCode=0
Jul 24 14:22:35.159283 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.159196    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt" event={"ID":"08f7b41e-d81f-4887-80bf-ed62854dc914","Type":"ContainerDied","Data":"a41bd37e79f39f4faa6a4f09f67a034cebaa87a267840be31a6c0435b64a268e"}
Jul 24 14:22:35.178594 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.178530    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:22:35.244257 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.244228    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-model-cache\") pod \"08f7b41e-d81f-4887-80bf-ed62854dc914\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") "
Jul 24 14:22:35.244455 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.244303    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmz4h\" (UniqueName: \"kubernetes.io/projected/08f7b41e-d81f-4887-80bf-ed62854dc914-kube-api-access-mmz4h\") pod \"08f7b41e-d81f-4887-80bf-ed62854dc914\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") "
Jul 24 14:22:35.244455 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.244327    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08f7b41e-d81f-4887-80bf-ed62854dc914-tls-certs\") pod \"08f7b41e-d81f-4887-80bf-ed62854dc914\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") "
Jul 24 14:22:35.244455 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.244352    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-tmp-dir\") pod \"08f7b41e-d81f-4887-80bf-ed62854dc914\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") "
Jul 24 14:22:35.244455 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.244393    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-home\") pod \"08f7b41e-d81f-4887-80bf-ed62854dc914\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") "
Jul 24 14:22:35.244455 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.244456    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-dshm\") pod \"08f7b41e-d81f-4887-80bf-ed62854dc914\" (UID: \"08f7b41e-d81f-4887-80bf-ed62854dc914\") "
Jul 24 14:22:35.244704 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.244553    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-model-cache" (OuterVolumeSpecName: "model-cache") pod "08f7b41e-d81f-4887-80bf-ed62854dc914" (UID: "08f7b41e-d81f-4887-80bf-ed62854dc914"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:22:35.244704 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.244628    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "08f7b41e-d81f-4887-80bf-ed62854dc914" (UID: "08f7b41e-d81f-4887-80bf-ed62854dc914"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:22:35.244809 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.244719    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-home" (OuterVolumeSpecName: "home") pod "08f7b41e-d81f-4887-80bf-ed62854dc914" (UID: "08f7b41e-d81f-4887-80bf-ed62854dc914"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:22:35.244878 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.244808    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-model-cache\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:22:35.244878 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.244827    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-tmp-dir\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:22:35.246674 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.246655    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08f7b41e-d81f-4887-80bf-ed62854dc914-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "08f7b41e-d81f-4887-80bf-ed62854dc914" (UID: "08f7b41e-d81f-4887-80bf-ed62854dc914"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:22:35.246756 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.246717    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08f7b41e-d81f-4887-80bf-ed62854dc914-kube-api-access-mmz4h" (OuterVolumeSpecName: "kube-api-access-mmz4h") pod "08f7b41e-d81f-4887-80bf-ed62854dc914" (UID: "08f7b41e-d81f-4887-80bf-ed62854dc914"). InnerVolumeSpecName "kube-api-access-mmz4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:22:35.246756 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.246744    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-dshm" (OuterVolumeSpecName: "dshm") pod "08f7b41e-d81f-4887-80bf-ed62854dc914" (UID: "08f7b41e-d81f-4887-80bf-ed62854dc914"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:22:35.346387 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.346348    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-home\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:22:35.346387 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.346383    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08f7b41e-d81f-4887-80bf-ed62854dc914-dshm\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:22:35.346585 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.346397    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmz4h\" (UniqueName: \"kubernetes.io/projected/08f7b41e-d81f-4887-80bf-ed62854dc914-kube-api-access-mmz4h\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:22:35.346585 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:35.346410    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08f7b41e-d81f-4887-80bf-ed62854dc914-tls-certs\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:22:36.164807 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.164775    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt" event={"ID":"08f7b41e-d81f-4887-80bf-ed62854dc914","Type":"ContainerDied","Data":"09ffd7c39227d49ba79822da79cd8ca548b4a91d5699a29a58ebc488599e20f4"}
Jul 24 14:22:36.164807 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.164808    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"
Jul 24 14:22:36.165339 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.164824    2559 scope.go:117] "RemoveContainer" containerID="a41bd37e79f39f4faa6a4f09f67a034cebaa87a267840be31a6c0435b64a268e"
Jul 24 14:22:36.186538 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.186506    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"]
Jul 24 14:22:36.191113 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.191085    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a26cce/auth-test-model-a26cce-kserve-bd7d9648c-bvztt"]
Jul 24 14:22:36.390274 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.390239    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc" podUID="5912e176-bbc9-4258-b37a-0ca5d4047b7b" containerName="main" containerID="cri-o://d4d962520a47ddc3375cc9ce48e79d09097da6b09a467d7ea5d8269af6397f3f" gracePeriod=45
Jul 24 14:22:36.643726 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.643701    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:22:36.759706 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.759623    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-tmp-dir\") pod \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") "
Jul 24 14:22:36.759706 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.759655    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5912e176-bbc9-4258-b37a-0ca5d4047b7b-tls-certs\") pod \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") "
Jul 24 14:22:36.759706 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.759686    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6b5h\" (UniqueName: \"kubernetes.io/projected/5912e176-bbc9-4258-b37a-0ca5d4047b7b-kube-api-access-h6b5h\") pod \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") "
Jul 24 14:22:36.759706 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.759707    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-model-cache\") pod \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") "
Jul 24 14:22:36.760057 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.759779    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-home\") pod \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") "
Jul 24 14:22:36.760057 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.759851    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-dshm\") pod \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\" (UID: \"5912e176-bbc9-4258-b37a-0ca5d4047b7b\") "
Jul 24 14:22:36.760057 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.759984    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5912e176-bbc9-4258-b37a-0ca5d4047b7b" (UID: "5912e176-bbc9-4258-b37a-0ca5d4047b7b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:22:36.760057 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.760017    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-model-cache" (OuterVolumeSpecName: "model-cache") pod "5912e176-bbc9-4258-b37a-0ca5d4047b7b" (UID: "5912e176-bbc9-4258-b37a-0ca5d4047b7b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:22:36.760260 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.760108    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-home" (OuterVolumeSpecName: "home") pod "5912e176-bbc9-4258-b37a-0ca5d4047b7b" (UID: "5912e176-bbc9-4258-b37a-0ca5d4047b7b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:22:36.760260 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.760212    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-tmp-dir\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:22:36.760260 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.760230    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-model-cache\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:22:36.760260 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.760243    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-home\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:22:36.762234 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.762183    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-dshm" (OuterVolumeSpecName: "dshm") pod "5912e176-bbc9-4258-b37a-0ca5d4047b7b" (UID: "5912e176-bbc9-4258-b37a-0ca5d4047b7b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:22:36.762234 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.762189    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5912e176-bbc9-4258-b37a-0ca5d4047b7b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5912e176-bbc9-4258-b37a-0ca5d4047b7b" (UID: "5912e176-bbc9-4258-b37a-0ca5d4047b7b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:22:36.762447 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.762313    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5912e176-bbc9-4258-b37a-0ca5d4047b7b-kube-api-access-h6b5h" (OuterVolumeSpecName: "kube-api-access-h6b5h") pod "5912e176-bbc9-4258-b37a-0ca5d4047b7b" (UID: "5912e176-bbc9-4258-b37a-0ca5d4047b7b"). InnerVolumeSpecName "kube-api-access-h6b5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:22:36.861537 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.861499    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5912e176-bbc9-4258-b37a-0ca5d4047b7b-dshm\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:22:36.861537 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.861529    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5912e176-bbc9-4258-b37a-0ca5d4047b7b-tls-certs\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:22:36.861537 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:36.861541    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6b5h\" (UniqueName: \"kubernetes.io/projected/5912e176-bbc9-4258-b37a-0ca5d4047b7b-kube-api-access-h6b5h\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:22:37.171882 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:37.171760    2559 generic.go:356] "Generic (PLEG): container finished" podID="5912e176-bbc9-4258-b37a-0ca5d4047b7b" containerID="d4d962520a47ddc3375cc9ce48e79d09097da6b09a467d7ea5d8269af6397f3f" exitCode=0
Jul 24 14:22:37.171882 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:37.171810    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"
Jul 24 14:22:37.171882 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:37.171841    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc" event={"ID":"5912e176-bbc9-4258-b37a-0ca5d4047b7b","Type":"ContainerDied","Data":"d4d962520a47ddc3375cc9ce48e79d09097da6b09a467d7ea5d8269af6397f3f"}
Jul 24 14:22:37.172549 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:37.171904    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc" event={"ID":"5912e176-bbc9-4258-b37a-0ca5d4047b7b","Type":"ContainerDied","Data":"6d1aadcb24c6ba8f9097a0228b7f8c0c2645d998338f191445c6e631c3dd1b9d"}
Jul 24 14:22:37.172549 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:37.171929    2559 scope.go:117] "RemoveContainer" containerID="d4d962520a47ddc3375cc9ce48e79d09097da6b09a467d7ea5d8269af6397f3f"
Jul 24 14:22:37.181305 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:37.181280    2559 scope.go:117] "RemoveContainer" containerID="d4d962520a47ddc3375cc9ce48e79d09097da6b09a467d7ea5d8269af6397f3f"
Jul 24 14:22:37.181635 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:22:37.181614    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4d962520a47ddc3375cc9ce48e79d09097da6b09a467d7ea5d8269af6397f3f\": container with ID starting with d4d962520a47ddc3375cc9ce48e79d09097da6b09a467d7ea5d8269af6397f3f not found: ID does not exist" containerID="d4d962520a47ddc3375cc9ce48e79d09097da6b09a467d7ea5d8269af6397f3f"
Jul 24 14:22:37.181729 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:37.181640    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4d962520a47ddc3375cc9ce48e79d09097da6b09a467d7ea5d8269af6397f3f"} err="failed to get container status \"d4d962520a47ddc3375cc9ce48e79d09097da6b09a467d7ea5d8269af6397f3f\": rpc error: code = NotFound desc = could not find container \"d4d962520a47ddc3375cc9ce48e79d09097da6b09a467d7ea5d8269af6397f3f\": container with ID starting with d4d962520a47ddc3375cc9ce48e79d09097da6b09a467d7ea5d8269af6397f3f not found: ID does not exist"
Jul 24 14:22:37.195696 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:37.195665    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08f7b41e-d81f-4887-80bf-ed62854dc914" path="/var/lib/kubelet/pods/08f7b41e-d81f-4887-80bf-ed62854dc914/volumes"
Jul 24 14:22:37.195956 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:37.195942    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"]
Jul 24 14:22:37.196010 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:37.195969    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/auth-test-model-cb9aa5-kserve-755fcf8d4c-zpmnc"]
Jul 24 14:22:39.194703 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:39.194670    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5912e176-bbc9-4258-b37a-0ca5d4047b7b" path="/var/lib/kubelet/pods/5912e176-bbc9-4258-b37a-0ca5d4047b7b/volumes"
Jul 24 14:22:41.223815 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:41.223774    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:22:59.425353 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.425321    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"]
Jul 24 14:22:59.425731 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.425717    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08f7b41e-d81f-4887-80bf-ed62854dc914" containerName="main"
Jul 24 14:22:59.425731 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.425728    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="08f7b41e-d81f-4887-80bf-ed62854dc914" containerName="main"
Jul 24 14:22:59.425804 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.425737    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5912e176-bbc9-4258-b37a-0ca5d4047b7b" containerName="main"
Jul 24 14:22:59.425804 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.425742    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5912e176-bbc9-4258-b37a-0ca5d4047b7b" containerName="main"
Jul 24 14:22:59.425804 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.425797    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="08f7b41e-d81f-4887-80bf-ed62854dc914" containerName="main"
Jul 24 14:22:59.425917 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.425806    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5912e176-bbc9-4258-b37a-0ca5d4047b7b" containerName="main"
Jul 24 14:22:59.430483 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.430463    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.433955 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.433929    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cb9aa5\"/\"openshift-service-ca.crt\""
Jul 24 14:22:59.434076 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.433960    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cb9aa5\"/\"kube-root-ca.crt\""
Jul 24 14:22:59.434163 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.434145    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cb9aa5\"/\"sub-test-model-cb9aa5-kserve-self-signed-certs\""
Jul 24 14:22:59.434232 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.434192    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cb9aa5\"/\"default-dockercfg-5mqp9\""
Jul 24 14:22:59.439566 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.439535    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"]
Jul 24 14:22:59.463665 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.463628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-home\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.463665 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.463665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-dshm\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.463901 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.463694    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq5ww\" (UniqueName: \"kubernetes.io/projected/5b757875-37b9-402a-a035-c91a7fa82ec2-kube-api-access-xq5ww\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.463901 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.463817    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b757875-37b9-402a-a035-c91a7fa82ec2-tls-certs\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.463901 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.463865    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-model-cache\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.464006 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.463928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-tmp-dir\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.565017 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.564978    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-dshm\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.565017 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.565020    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq5ww\" (UniqueName: \"kubernetes.io/projected/5b757875-37b9-402a-a035-c91a7fa82ec2-kube-api-access-xq5ww\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.565243 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.565083    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b757875-37b9-402a-a035-c91a7fa82ec2-tls-certs\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.565243 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.565105    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-model-cache\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.565243 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.565130    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-tmp-dir\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.565243 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.565162    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-home\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.565498 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.565476    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-tmp-dir\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.565563 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.565523    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-home\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.565563 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.565526    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-model-cache\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.567426 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.567401    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-dshm\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.567667 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.567649    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b757875-37b9-402a-a035-c91a7fa82ec2-tls-certs\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.572898 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.572873    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq5ww\" (UniqueName: \"kubernetes.io/projected/5b757875-37b9-402a-a035-c91a7fa82ec2-kube-api-access-xq5ww\") pod \"sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") " pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.740776 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.740731    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:22:59.874237 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:22:59.874211    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"]
Jul 24 14:22:59.876474 ip-10-0-139-47 kubenswrapper[2559]: W0724 14:22:59.876438    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b757875_37b9_402a_a035_c91a7fa82ec2.slice/crio-99f51678877b849417e388e70048ce26c838abd1ff5c2cd57019dae1c123a815 WatchSource:0}: Error finding container 99f51678877b849417e388e70048ce26c838abd1ff5c2cd57019dae1c123a815: Status 404 returned error can't find the container with id 99f51678877b849417e388e70048ce26c838abd1ff5c2cd57019dae1c123a815
Jul 24 14:23:00.281894 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:23:00.281837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8" event={"ID":"5b757875-37b9-402a-a035-c91a7fa82ec2","Type":"ContainerStarted","Data":"eab097114346b3ab48420aa6b4f1a6af9f0c0914f497dd11f198852827e2ace9"}
Jul 24 14:23:00.282079 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:23:00.281902    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8" event={"ID":"5b757875-37b9-402a-a035-c91a7fa82ec2","Type":"ContainerStarted","Data":"99f51678877b849417e388e70048ce26c838abd1ff5c2cd57019dae1c123a815"}
Jul 24 14:23:00.301002 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:23:00.300947    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8" podStartSLOduration=1.300931904 podStartE2EDuration="1.300931904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:22:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:23:00.299542419 +0000 UTC m=+2675.660915725" watchObservedRunningTime="2026-07-24 14:23:00.300931904 +0000 UTC m=+2675.662305209"
Jul 24 14:23:03.226633 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:23:03.226596    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:23:09.741658 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:23:09.741615    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:23:09.742251 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:23:09.741673    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:23:09.754373 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:23:09.754346    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:23:10.339988 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:23:10.339957    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:23:21.924906 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:23:21.924801    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:23:38.930473 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:23:38.930430    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:23:47.235556 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:23:47.235510    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"]
Jul 24 14:23:58.531386 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:23:58.531351    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:24:02.254741 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.254687    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8" podUID="5b757875-37b9-402a-a035-c91a7fa82ec2" containerName="main" containerID="cri-o://eab097114346b3ab48420aa6b4f1a6af9f0c0914f497dd11f198852827e2ace9" gracePeriod=45
Jul 24 14:24:02.504660 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.504635    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:24:02.579353 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.579263    2559 generic.go:356] "Generic (PLEG): container finished" podID="5b757875-37b9-402a-a035-c91a7fa82ec2" containerID="eab097114346b3ab48420aa6b4f1a6af9f0c0914f497dd11f198852827e2ace9" exitCode=0
Jul 24 14:24:02.579353 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.579316    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"
Jul 24 14:24:02.579353 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.579344    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8" event={"ID":"5b757875-37b9-402a-a035-c91a7fa82ec2","Type":"ContainerDied","Data":"eab097114346b3ab48420aa6b4f1a6af9f0c0914f497dd11f198852827e2ace9"}
Jul 24 14:24:02.579569 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.579391    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8" event={"ID":"5b757875-37b9-402a-a035-c91a7fa82ec2","Type":"ContainerDied","Data":"99f51678877b849417e388e70048ce26c838abd1ff5c2cd57019dae1c123a815"}
Jul 24 14:24:02.579569 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.579411    2559 scope.go:117] "RemoveContainer" containerID="eab097114346b3ab48420aa6b4f1a6af9f0c0914f497dd11f198852827e2ace9"
Jul 24 14:24:02.587527 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.587508    2559 scope.go:117] "RemoveContainer" containerID="eab097114346b3ab48420aa6b4f1a6af9f0c0914f497dd11f198852827e2ace9"
Jul 24 14:24:02.587776 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:24:02.587752    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab097114346b3ab48420aa6b4f1a6af9f0c0914f497dd11f198852827e2ace9\": container with ID starting with eab097114346b3ab48420aa6b4f1a6af9f0c0914f497dd11f198852827e2ace9 not found: ID does not exist" containerID="eab097114346b3ab48420aa6b4f1a6af9f0c0914f497dd11f198852827e2ace9"
Jul 24 14:24:02.587820 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.587782    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab097114346b3ab48420aa6b4f1a6af9f0c0914f497dd11f198852827e2ace9"} err="failed to get container status \"eab097114346b3ab48420aa6b4f1a6af9f0c0914f497dd11f198852827e2ace9\": rpc error: code = NotFound desc = could not find container \"eab097114346b3ab48420aa6b4f1a6af9f0c0914f497dd11f198852827e2ace9\": container with ID starting with eab097114346b3ab48420aa6b4f1a6af9f0c0914f497dd11f198852827e2ace9 not found: ID does not exist"
Jul 24 14:24:02.633348 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.633318    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-model-cache\") pod \"5b757875-37b9-402a-a035-c91a7fa82ec2\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") "
Jul 24 14:24:02.633466 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.633373    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-home\") pod \"5b757875-37b9-402a-a035-c91a7fa82ec2\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") "
Jul 24 14:24:02.633466 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.633420    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq5ww\" (UniqueName: \"kubernetes.io/projected/5b757875-37b9-402a-a035-c91a7fa82ec2-kube-api-access-xq5ww\") pod \"5b757875-37b9-402a-a035-c91a7fa82ec2\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") "
Jul 24 14:24:02.633466 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.633440    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-tmp-dir\") pod \"5b757875-37b9-402a-a035-c91a7fa82ec2\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") "
Jul 24 14:24:02.633574 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.633467    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-dshm\") pod \"5b757875-37b9-402a-a035-c91a7fa82ec2\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") "
Jul 24 14:24:02.633574 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.633531    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b757875-37b9-402a-a035-c91a7fa82ec2-tls-certs\") pod \"5b757875-37b9-402a-a035-c91a7fa82ec2\" (UID: \"5b757875-37b9-402a-a035-c91a7fa82ec2\") "
Jul 24 14:24:02.633675 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.633635    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-model-cache" (OuterVolumeSpecName: "model-cache") pod "5b757875-37b9-402a-a035-c91a7fa82ec2" (UID: "5b757875-37b9-402a-a035-c91a7fa82ec2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:24:02.633756 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.633726    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5b757875-37b9-402a-a035-c91a7fa82ec2" (UID: "5b757875-37b9-402a-a035-c91a7fa82ec2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:24:02.633756 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.633742    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-home" (OuterVolumeSpecName: "home") pod "5b757875-37b9-402a-a035-c91a7fa82ec2" (UID: "5b757875-37b9-402a-a035-c91a7fa82ec2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:24:02.633912 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.633897    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-tmp-dir\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:24:02.633968 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.633913    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-model-cache\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:24:02.633968 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.633924    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-home\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:24:02.635650 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.635629    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-dshm" (OuterVolumeSpecName: "dshm") pod "5b757875-37b9-402a-a035-c91a7fa82ec2" (UID: "5b757875-37b9-402a-a035-c91a7fa82ec2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:24:02.635650 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.635641    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b757875-37b9-402a-a035-c91a7fa82ec2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5b757875-37b9-402a-a035-c91a7fa82ec2" (UID: "5b757875-37b9-402a-a035-c91a7fa82ec2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:24:02.635750 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.635709    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b757875-37b9-402a-a035-c91a7fa82ec2-kube-api-access-xq5ww" (OuterVolumeSpecName: "kube-api-access-xq5ww") pod "5b757875-37b9-402a-a035-c91a7fa82ec2" (UID: "5b757875-37b9-402a-a035-c91a7fa82ec2"). InnerVolumeSpecName "kube-api-access-xq5ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:24:02.735141 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.735107    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq5ww\" (UniqueName: \"kubernetes.io/projected/5b757875-37b9-402a-a035-c91a7fa82ec2-kube-api-access-xq5ww\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:24:02.735141 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.735136    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b757875-37b9-402a-a035-c91a7fa82ec2-dshm\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:24:02.735141 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.735146    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b757875-37b9-402a-a035-c91a7fa82ec2-tls-certs\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:24:02.900811 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.900772    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"]
Jul 24 14:24:02.904778 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:02.904749    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/sub-test-model-cb9aa5-kserve-5b8d7cbd6f-ccrs8"]
Jul 24 14:24:03.131265 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.131237    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"]
Jul 24 14:24:03.131604 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.131592    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b757875-37b9-402a-a035-c91a7fa82ec2" containerName="main"
Jul 24 14:24:03.131668 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.131604    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b757875-37b9-402a-a035-c91a7fa82ec2" containerName="main"
Jul 24 14:24:03.131668 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.131661    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b757875-37b9-402a-a035-c91a7fa82ec2" containerName="main"
Jul 24 14:24:03.135935 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.135911    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.139372 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.139309    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a26cce\"/\"openshift-service-ca.crt\""
Jul 24 14:24:03.139372 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.139329    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a26cce\"/\"default-dockercfg-jtnct\""
Jul 24 14:24:03.139372 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.139351    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a26cce\"/\"kube-root-ca.crt\""
Jul 24 14:24:03.139617 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.139309    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a26cce\"/\"rate-test-model-a26cce-kserve-self-signed-certs\""
Jul 24 14:24:03.145515 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.145490    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"]
Jul 24 14:24:03.195779 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.195744    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b757875-37b9-402a-a035-c91a7fa82ec2" path="/var/lib/kubelet/pods/5b757875-37b9-402a-a035-c91a7fa82ec2/volumes"
Jul 24 14:24:03.240224 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.240184    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-dshm\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.240503 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.240245    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-tmp-dir\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.240503 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.240302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqqr6\" (UniqueName: \"kubernetes.io/projected/19b682b3-b994-484e-a877-2ec968a94b62-kube-api-access-dqqr6\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.240503 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.240330    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19b682b3-b994-484e-a877-2ec968a94b62-tls-certs\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.240503 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.240420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-home\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.240695 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.240533    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-model-cache\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.341730 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.341685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-model-cache\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.342249 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.341758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-dshm\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.342249 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.341790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-tmp-dir\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.342249 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.341815    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqqr6\" (UniqueName: \"kubernetes.io/projected/19b682b3-b994-484e-a877-2ec968a94b62-kube-api-access-dqqr6\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.342249 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.341848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19b682b3-b994-484e-a877-2ec968a94b62-tls-certs\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.342249 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.341921    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-home\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.342249 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.342197    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-model-cache\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.342249 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.342233    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-tmp-dir\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.342538 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.342298    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-home\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.344041 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.344017    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-dshm\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.344310 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.344293    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19b682b3-b994-484e-a877-2ec968a94b62-tls-certs\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.352279 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.352259    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqqr6\" (UniqueName: \"kubernetes.io/projected/19b682b3-b994-484e-a877-2ec968a94b62-kube-api-access-dqqr6\") pod \"rate-test-model-a26cce-kserve-d577f9df5-24qt5\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") " pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.446210 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.446167    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:03.583281 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:03.583252    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"]
Jul 24 14:24:03.585781 ip-10-0-139-47 kubenswrapper[2559]: W0724 14:24:03.585758    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19b682b3_b994_484e_a877_2ec968a94b62.slice/crio-2d837342f0f7b7313b748eeeaef2c01250a7c9cad1d620f979806f0620a47342 WatchSource:0}: Error finding container 2d837342f0f7b7313b748eeeaef2c01250a7c9cad1d620f979806f0620a47342: Status 404 returned error can't find the container with id 2d837342f0f7b7313b748eeeaef2c01250a7c9cad1d620f979806f0620a47342
Jul 24 14:24:04.591726 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:04.591681    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5" event={"ID":"19b682b3-b994-484e-a877-2ec968a94b62","Type":"ContainerStarted","Data":"02051ed26f501a340087831347beb4d69c138fe48f3bf7d83b321615f2ed61bb"}
Jul 24 14:24:04.592144 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:04.591735    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5" event={"ID":"19b682b3-b994-484e-a877-2ec968a94b62","Type":"ContainerStarted","Data":"2d837342f0f7b7313b748eeeaef2c01250a7c9cad1d620f979806f0620a47342"}
Jul 24 14:24:04.609221 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:04.609168    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5" podStartSLOduration=1.6091512510000001 podStartE2EDuration="1.609151251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:24:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:24:04.607557731 +0000 UTC m=+2739.968931037" watchObservedRunningTime="2026-07-24 14:24:04.609151251 +0000 UTC m=+2739.970524553"
Jul 24 14:24:08.735260 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:08.735223    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:24:13.446724 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:13.446682    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:13.447170 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:13.446756    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:13.459741 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:13.459714    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:13.642531 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:13.642500    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:24:30.707640 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.707604    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"]
Jul 24 14:24:30.712404 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.712371    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.715619 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.715593    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cb9aa5\"/\"rate-test-model-cb9aa5-kserve-self-signed-certs\""
Jul 24 14:24:30.715749 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.715599    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-cb9aa5\"/\"default-dockercfg-5mqp9\""
Jul 24 14:24:30.715749 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.715632    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cb9aa5\"/\"openshift-service-ca.crt\""
Jul 24 14:24:30.715749 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.715645    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-cb9aa5\"/\"kube-root-ca.crt\""
Jul 24 14:24:30.722528 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.722503    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"]
Jul 24 14:24:30.791699 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.791659    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-dshm\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.791699 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.791696    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-model-cache\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.792064 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.791831    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f1e7b1d-9e4c-4547-b987-0278cc4678af-tls-certs\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.792064 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.791922    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbm9z\" (UniqueName: \"kubernetes.io/projected/7f1e7b1d-9e4c-4547-b987-0278cc4678af-kube-api-access-lbm9z\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.792064 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.791959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-tmp-dir\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.792064 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.791984    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-home\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.893289 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.893252    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-dshm\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.893289 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.893290    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-model-cache\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.893556 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.893346    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f1e7b1d-9e4c-4547-b987-0278cc4678af-tls-certs\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.893556 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.893368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbm9z\" (UniqueName: \"kubernetes.io/projected/7f1e7b1d-9e4c-4547-b987-0278cc4678af-kube-api-access-lbm9z\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.893556 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.893393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-tmp-dir\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.893556 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.893417    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-home\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.893887 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.893813    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-model-cache\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.893887 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.893846    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-home\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.894008 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.893926    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-tmp-dir\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.895589 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.895567    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-dshm\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.895915 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.895898    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f1e7b1d-9e4c-4547-b987-0278cc4678af-tls-certs\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:30.900831 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:30.900812    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbm9z\" (UniqueName: \"kubernetes.io/projected/7f1e7b1d-9e4c-4547-b987-0278cc4678af-kube-api-access-lbm9z\") pod \"rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") " pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:31.023266 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:31.023176    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:31.159103 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:31.159077    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"]
Jul 24 14:24:31.161386 ip-10-0-139-47 kubenswrapper[2559]: W0724 14:24:31.161353    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f1e7b1d_9e4c_4547_b987_0278cc4678af.slice/crio-93702a8487cfb5e9f7ae1df493db49e8cd9b5aa0238ef1cdb6cc780a069038f4 WatchSource:0}: Error finding container 93702a8487cfb5e9f7ae1df493db49e8cd9b5aa0238ef1cdb6cc780a069038f4: Status 404 returned error can't find the container with id 93702a8487cfb5e9f7ae1df493db49e8cd9b5aa0238ef1cdb6cc780a069038f4
Jul 24 14:24:31.722958 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:31.722916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc" event={"ID":"7f1e7b1d-9e4c-4547-b987-0278cc4678af","Type":"ContainerStarted","Data":"daf45faf95d580297dad2db7e6dca58045545c73f5cff7409a23a4ecc9707c25"}
Jul 24 14:24:31.723404 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:31.722972    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc" event={"ID":"7f1e7b1d-9e4c-4547-b987-0278cc4678af","Type":"ContainerStarted","Data":"93702a8487cfb5e9f7ae1df493db49e8cd9b5aa0238ef1cdb6cc780a069038f4"}
Jul 24 14:24:31.741330 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:31.741272    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc" podStartSLOduration=1.741257063 podStartE2EDuration="1.741257063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:24:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:24:31.740188644 +0000 UTC m=+2767.101561962" watchObservedRunningTime="2026-07-24 14:24:31.741257063 +0000 UTC m=+2767.102630364"
Jul 24 14:24:34.829047 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:34.829005    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:24:41.024209 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:41.024168    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:41.024209 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:41.024218    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:41.037141 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:41.037107    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:41.784257 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:41.784222    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:24:52.539645 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:24:52.539563    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:25:07.539779 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:07.539744    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:25:14.542729 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:14.542694    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"]
Jul 24 14:25:15.542385 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:15.542342    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"]
Jul 24 14:25:23.141555 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:23.141519    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:25:25.854507 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:25.854470    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7778-139958971850592"]
Jul 24 14:25:25.857921 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:25.857903    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-139958971850592"
Jul 24 14:25:25.860704 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:25.860683    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fnfwz\""
Jul 24 14:25:25.866942 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:25.866920    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7778-139958971850592"]
Jul 24 14:25:25.907969 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:25.907932    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmkcw\" (UniqueName: \"kubernetes.io/projected/7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4-kube-api-access-gmkcw\") pod \"test-curl-7778-139958971850592\" (UID: \"7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4\") " pod="opendatahub/test-curl-7778-139958971850592"
Jul 24 14:25:26.008906 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:26.008842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmkcw\" (UniqueName: \"kubernetes.io/projected/7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4-kube-api-access-gmkcw\") pod \"test-curl-7778-139958971850592\" (UID: \"7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4\") " pod="opendatahub/test-curl-7778-139958971850592"
Jul 24 14:25:26.017339 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:26.017306    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmkcw\" (UniqueName: \"kubernetes.io/projected/7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4-kube-api-access-gmkcw\") pod \"test-curl-7778-139958971850592\" (UID: \"7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4\") " pod="opendatahub/test-curl-7778-139958971850592"
Jul 24 14:25:26.168283 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:26.168184    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-139958971850592"
Jul 24 14:25:26.300764 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:26.300601    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7778-139958971850592"]
Jul 24 14:25:26.303081 ip-10-0-139-47 kubenswrapper[2559]: W0724 14:25:26.303050    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ef38c89_dee3_4c63_9c4f_3b2428ffc5f4.slice/crio-688746f3c64057c67103566c1ffd50976035a287e2b93ba37858990510d5df06 WatchSource:0}: Error finding container 688746f3c64057c67103566c1ffd50976035a287e2b93ba37858990510d5df06: Status 404 returned error can't find the container with id 688746f3c64057c67103566c1ffd50976035a287e2b93ba37858990510d5df06
Jul 24 14:25:26.304573 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:26.304553    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 24 14:25:26.979631 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:26.979598    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7778-139958971850592" event={"ID":"7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4","Type":"ContainerStarted","Data":"688746f3c64057c67103566c1ffd50976035a287e2b93ba37858990510d5df06"}
Jul 24 14:25:27.986309 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:27.986274    2559 generic.go:356] "Generic (PLEG): container finished" podID="7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4" containerID="966f712ad25ada8f8b72b0d7bcd85d9e4546e794690fc8abbf937a872aa8f04a" exitCode=0
Jul 24 14:25:27.986726 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:27.986370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7778-139958971850592" event={"ID":"7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4","Type":"ContainerDied","Data":"966f712ad25ada8f8b72b0d7bcd85d9e4546e794690fc8abbf937a872aa8f04a"}
Jul 24 14:25:29.130787 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.130764    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-139958971850592"
Jul 24 14:25:29.168350 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.168319    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7778-139958971850592_7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4/test-curl-7778-139958971850592/0.log"
Jul 24 14:25:29.196085 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.196060    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7778-139958971850592"]
Jul 24 14:25:29.203313 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.203284    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7778-139958971850592"]
Jul 24 14:25:29.241614 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.241580    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmkcw\" (UniqueName: \"kubernetes.io/projected/7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4-kube-api-access-gmkcw\") pod \"7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4\" (UID: \"7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4\") "
Jul 24 14:25:29.243845 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.243771    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4-kube-api-access-gmkcw" (OuterVolumeSpecName: "kube-api-access-gmkcw") pod "7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4" (UID: "7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4"). InnerVolumeSpecName "kube-api-access-gmkcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:25:29.343556 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.343518    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmkcw\" (UniqueName: \"kubernetes.io/projected/7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4-kube-api-access-gmkcw\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:29.561598 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.561509    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5" podUID="19b682b3-b994-484e-a877-2ec968a94b62" containerName="main" containerID="cri-o://02051ed26f501a340087831347beb4d69c138fe48f3bf7d83b321615f2ed61bb" gracePeriod=45
Jul 24 14:25:29.800954 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.800929    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:25:29.847383 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.847285    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-model-cache\") pod \"19b682b3-b994-484e-a877-2ec968a94b62\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") "
Jul 24 14:25:29.847383 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.847331    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19b682b3-b994-484e-a877-2ec968a94b62-tls-certs\") pod \"19b682b3-b994-484e-a877-2ec968a94b62\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") "
Jul 24 14:25:29.847383 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.847370    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-home\") pod \"19b682b3-b994-484e-a877-2ec968a94b62\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") "
Jul 24 14:25:29.847664 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.847413    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-tmp-dir\") pod \"19b682b3-b994-484e-a877-2ec968a94b62\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") "
Jul 24 14:25:29.847664 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.847472    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqqr6\" (UniqueName: \"kubernetes.io/projected/19b682b3-b994-484e-a877-2ec968a94b62-kube-api-access-dqqr6\") pod \"19b682b3-b994-484e-a877-2ec968a94b62\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") "
Jul 24 14:25:29.847664 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.847517    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-dshm\") pod \"19b682b3-b994-484e-a877-2ec968a94b62\" (UID: \"19b682b3-b994-484e-a877-2ec968a94b62\") "
Jul 24 14:25:29.847804 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.847744    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-model-cache" (OuterVolumeSpecName: "model-cache") pod "19b682b3-b994-484e-a877-2ec968a94b62" (UID: "19b682b3-b994-484e-a877-2ec968a94b62"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:25:29.847804 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.847754    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-home" (OuterVolumeSpecName: "home") pod "19b682b3-b994-484e-a877-2ec968a94b62" (UID: "19b682b3-b994-484e-a877-2ec968a94b62"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:25:29.847963 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.847919    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "19b682b3-b994-484e-a877-2ec968a94b62" (UID: "19b682b3-b994-484e-a877-2ec968a94b62"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:25:29.848016 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.848002    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-model-cache\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:29.848062 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.848028    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-home\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:29.849712 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.849676    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-dshm" (OuterVolumeSpecName: "dshm") pod "19b682b3-b994-484e-a877-2ec968a94b62" (UID: "19b682b3-b994-484e-a877-2ec968a94b62"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:25:29.849712 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.849705    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b682b3-b994-484e-a877-2ec968a94b62-kube-api-access-dqqr6" (OuterVolumeSpecName: "kube-api-access-dqqr6") pod "19b682b3-b994-484e-a877-2ec968a94b62" (UID: "19b682b3-b994-484e-a877-2ec968a94b62"). InnerVolumeSpecName "kube-api-access-dqqr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:25:29.849875 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.849718    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19b682b3-b994-484e-a877-2ec968a94b62-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "19b682b3-b994-484e-a877-2ec968a94b62" (UID: "19b682b3-b994-484e-a877-2ec968a94b62"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:25:29.949045 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.949011    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqqr6\" (UniqueName: \"kubernetes.io/projected/19b682b3-b994-484e-a877-2ec968a94b62-kube-api-access-dqqr6\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:29.949045 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.949041    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-dshm\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:29.949045 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.949050    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19b682b3-b994-484e-a877-2ec968a94b62-tls-certs\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:29.949261 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.949059    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19b682b3-b994-484e-a877-2ec968a94b62-tmp-dir\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:29.998171 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.998144    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="688746f3c64057c67103566c1ffd50976035a287e2b93ba37858990510d5df06"
Jul 24 14:25:29.998171 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.998158    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-139958971850592"
Jul 24 14:25:29.999589 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.999561    2559 generic.go:356] "Generic (PLEG): container finished" podID="19b682b3-b994-484e-a877-2ec968a94b62" containerID="02051ed26f501a340087831347beb4d69c138fe48f3bf7d83b321615f2ed61bb" exitCode=0
Jul 24 14:25:29.999589 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.999589    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"
Jul 24 14:25:29.999754 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.999589    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5" event={"ID":"19b682b3-b994-484e-a877-2ec968a94b62","Type":"ContainerDied","Data":"02051ed26f501a340087831347beb4d69c138fe48f3bf7d83b321615f2ed61bb"}
Jul 24 14:25:29.999754 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.999630    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5" event={"ID":"19b682b3-b994-484e-a877-2ec968a94b62","Type":"ContainerDied","Data":"2d837342f0f7b7313b748eeeaef2c01250a7c9cad1d620f979806f0620a47342"}
Jul 24 14:25:29.999754 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:29.999647    2559 scope.go:117] "RemoveContainer" containerID="02051ed26f501a340087831347beb4d69c138fe48f3bf7d83b321615f2ed61bb"
Jul 24 14:25:30.008828 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.008808    2559 scope.go:117] "RemoveContainer" containerID="02051ed26f501a340087831347beb4d69c138fe48f3bf7d83b321615f2ed61bb"
Jul 24 14:25:30.009896 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:25:30.009566    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02051ed26f501a340087831347beb4d69c138fe48f3bf7d83b321615f2ed61bb\": container with ID starting with 02051ed26f501a340087831347beb4d69c138fe48f3bf7d83b321615f2ed61bb not found: ID does not exist" containerID="02051ed26f501a340087831347beb4d69c138fe48f3bf7d83b321615f2ed61bb"
Jul 24 14:25:30.009896 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.009629    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02051ed26f501a340087831347beb4d69c138fe48f3bf7d83b321615f2ed61bb"} err="failed to get container status \"02051ed26f501a340087831347beb4d69c138fe48f3bf7d83b321615f2ed61bb\": rpc error: code = NotFound desc = could not find container \"02051ed26f501a340087831347beb4d69c138fe48f3bf7d83b321615f2ed61bb\": container with ID starting with 02051ed26f501a340087831347beb4d69c138fe48f3bf7d83b321615f2ed61bb not found: ID does not exist"
Jul 24 14:25:30.019130 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:25:30.019102    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-139958971850592\" is forbidden: User \"system:node:ip-10-0-139-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-47.ec2.internal' and this object" podUID="7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4" pod="opendatahub/test-curl-7778-139958971850592"
Jul 24 14:25:30.032724 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.032687    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"]
Jul 24 14:25:30.036017 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.035994    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a26cce/rate-test-model-a26cce-kserve-d577f9df5-24qt5"]
Jul 24 14:25:30.036158 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:25:30.036130    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-139958971850592\" is forbidden: User \"system:node:ip-10-0-139-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-47.ec2.internal' and this object" podUID="7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4" pod="opendatahub/test-curl-7778-139958971850592"
Jul 24 14:25:30.561228 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.561183    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc" podUID="7f1e7b1d-9e4c-4547-b987-0278cc4678af" containerName="main" containerID="cri-o://daf45faf95d580297dad2db7e6dca58045545c73f5cff7409a23a4ecc9707c25" gracePeriod=45
Jul 24 14:25:30.816659 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.816591    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:25:30.819051 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:25:30.819023    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-139958971850592\" is forbidden: User \"system:node:ip-10-0-139-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-47.ec2.internal' and this object" podUID="7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4" pod="opendatahub/test-curl-7778-139958971850592"
Jul 24 14:25:30.958843 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.958811    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f1e7b1d-9e4c-4547-b987-0278cc4678af-tls-certs\") pod \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") "
Jul 24 14:25:30.959058 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.958922    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-model-cache\") pod \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") "
Jul 24 14:25:30.959058 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.958980    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-home\") pod \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") "
Jul 24 14:25:30.959058 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.959007    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-tmp-dir\") pod \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") "
Jul 24 14:25:30.959213 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.959060    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-dshm\") pod \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") "
Jul 24 14:25:30.959213 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.959091    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbm9z\" (UniqueName: \"kubernetes.io/projected/7f1e7b1d-9e4c-4547-b987-0278cc4678af-kube-api-access-lbm9z\") pod \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\" (UID: \"7f1e7b1d-9e4c-4547-b987-0278cc4678af\") "
Jul 24 14:25:30.959317 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.959241    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-model-cache" (OuterVolumeSpecName: "model-cache") pod "7f1e7b1d-9e4c-4547-b987-0278cc4678af" (UID: "7f1e7b1d-9e4c-4547-b987-0278cc4678af"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:25:30.959317 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.959261    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-home" (OuterVolumeSpecName: "home") pod "7f1e7b1d-9e4c-4547-b987-0278cc4678af" (UID: "7f1e7b1d-9e4c-4547-b987-0278cc4678af"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:25:30.959317 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.959273    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7f1e7b1d-9e4c-4547-b987-0278cc4678af" (UID: "7f1e7b1d-9e4c-4547-b987-0278cc4678af"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:25:30.959472 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.959382    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-model-cache\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:30.959472 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.959396    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-home\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:30.959472 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.959405    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-tmp-dir\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:30.961104 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.961075    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f1e7b1d-9e4c-4547-b987-0278cc4678af-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7f1e7b1d-9e4c-4547-b987-0278cc4678af" (UID: "7f1e7b1d-9e4c-4547-b987-0278cc4678af"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:25:30.961198 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.961118    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-dshm" (OuterVolumeSpecName: "dshm") pod "7f1e7b1d-9e4c-4547-b987-0278cc4678af" (UID: "7f1e7b1d-9e4c-4547-b987-0278cc4678af"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:25:30.961295 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:30.961274    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f1e7b1d-9e4c-4547-b987-0278cc4678af-kube-api-access-lbm9z" (OuterVolumeSpecName: "kube-api-access-lbm9z") pod "7f1e7b1d-9e4c-4547-b987-0278cc4678af" (UID: "7f1e7b1d-9e4c-4547-b987-0278cc4678af"). InnerVolumeSpecName "kube-api-access-lbm9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:25:31.006349 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.006317    2559 generic.go:356] "Generic (PLEG): container finished" podID="7f1e7b1d-9e4c-4547-b987-0278cc4678af" containerID="daf45faf95d580297dad2db7e6dca58045545c73f5cff7409a23a4ecc9707c25" exitCode=0
Jul 24 14:25:31.006547 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.006353    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"
Jul 24 14:25:31.006547 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.006395    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc" event={"ID":"7f1e7b1d-9e4c-4547-b987-0278cc4678af","Type":"ContainerDied","Data":"daf45faf95d580297dad2db7e6dca58045545c73f5cff7409a23a4ecc9707c25"}
Jul 24 14:25:31.006547 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.006442    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc" event={"ID":"7f1e7b1d-9e4c-4547-b987-0278cc4678af","Type":"ContainerDied","Data":"93702a8487cfb5e9f7ae1df493db49e8cd9b5aa0238ef1cdb6cc780a069038f4"}
Jul 24 14:25:31.006547 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.006464    2559 scope.go:117] "RemoveContainer" containerID="daf45faf95d580297dad2db7e6dca58045545c73f5cff7409a23a4ecc9707c25"
Jul 24 14:25:31.008890 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:25:31.008842    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-139958971850592\" is forbidden: User \"system:node:ip-10-0-139-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-47.ec2.internal' and this object" podUID="7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4" pod="opendatahub/test-curl-7778-139958971850592"
Jul 24 14:25:31.015114 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.015096    2559 scope.go:117] "RemoveContainer" containerID="daf45faf95d580297dad2db7e6dca58045545c73f5cff7409a23a4ecc9707c25"
Jul 24 14:25:31.015358 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:25:31.015343    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daf45faf95d580297dad2db7e6dca58045545c73f5cff7409a23a4ecc9707c25\": container with ID starting with daf45faf95d580297dad2db7e6dca58045545c73f5cff7409a23a4ecc9707c25 not found: ID does not exist" containerID="daf45faf95d580297dad2db7e6dca58045545c73f5cff7409a23a4ecc9707c25"
Jul 24 14:25:31.015422 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.015365    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daf45faf95d580297dad2db7e6dca58045545c73f5cff7409a23a4ecc9707c25"} err="failed to get container status \"daf45faf95d580297dad2db7e6dca58045545c73f5cff7409a23a4ecc9707c25\": rpc error: code = NotFound desc = could not find container \"daf45faf95d580297dad2db7e6dca58045545c73f5cff7409a23a4ecc9707c25\": container with ID starting with daf45faf95d580297dad2db7e6dca58045545c73f5cff7409a23a4ecc9707c25 not found: ID does not exist"
Jul 24 14:25:31.026899 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.026876    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"]
Jul 24 14:25:31.030446 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.030422    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-cb9aa5/rate-test-model-cb9aa5-kserve-779d5bc867-5x9bc"]
Jul 24 14:25:31.030639 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:25:31.030621    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-139958971850592\" is forbidden: User \"system:node:ip-10-0-139-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-47.ec2.internal' and this object" podUID="7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4" pod="opendatahub/test-curl-7778-139958971850592"
Jul 24 14:25:31.060153 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.060128    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f1e7b1d-9e4c-4547-b987-0278cc4678af-tls-certs\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:31.060153 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.060153    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f1e7b1d-9e4c-4547-b987-0278cc4678af-dshm\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:31.060318 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.060162    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbm9z\" (UniqueName: \"kubernetes.io/projected/7f1e7b1d-9e4c-4547-b987-0278cc4678af-kube-api-access-lbm9z\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:31.195014 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.194975    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19b682b3-b994-484e-a877-2ec968a94b62" path="/var/lib/kubelet/pods/19b682b3-b994-484e-a877-2ec968a94b62/volumes"
Jul 24 14:25:31.195332 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.195319    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4" path="/var/lib/kubelet/pods/7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4/volumes"
Jul 24 14:25:31.195656 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.195645    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f1e7b1d-9e4c-4547-b987-0278cc4678af" path="/var/lib/kubelet/pods/7f1e7b1d-9e4c-4547-b987-0278cc4678af/volumes"
Jul 24 14:25:31.912313 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.912272    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7778-139958971889104"]
Jul 24 14:25:31.912815 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.912795    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f1e7b1d-9e4c-4547-b987-0278cc4678af" containerName="main"
Jul 24 14:25:31.912921 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.912818    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f1e7b1d-9e4c-4547-b987-0278cc4678af" containerName="main"
Jul 24 14:25:31.912921 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.912851    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b682b3-b994-484e-a877-2ec968a94b62" containerName="main"
Jul 24 14:25:31.912921 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.912877    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b682b3-b994-484e-a877-2ec968a94b62" containerName="main"
Jul 24 14:25:31.912921 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.912887    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4" containerName="test-curl-7778-139958971850592"
Jul 24 14:25:31.912921 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.912899    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4" containerName="test-curl-7778-139958971850592"
Jul 24 14:25:31.913156 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.913010    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b682b3-b994-484e-a877-2ec968a94b62" containerName="main"
Jul 24 14:25:31.913156 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.913022    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f1e7b1d-9e4c-4547-b987-0278cc4678af" containerName="main"
Jul 24 14:25:31.913156 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.913031    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ef38c89-dee3-4c63-9c4f-3b2428ffc5f4" containerName="test-curl-7778-139958971850592"
Jul 24 14:25:31.917397 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.917375    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-139958971889104"
Jul 24 14:25:31.920315 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.920286    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fnfwz\""
Jul 24 14:25:31.922176 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.922145    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7778-139958971889104"]
Jul 24 14:25:31.966503 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:31.966464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v88p\" (UniqueName: \"kubernetes.io/projected/9db40e90-25fd-4842-a57d-697ee30b785c-kube-api-access-4v88p\") pod \"test-curl-7778-139958971889104\" (UID: \"9db40e90-25fd-4842-a57d-697ee30b785c\") " pod="opendatahub/test-curl-7778-139958971889104"
Jul 24 14:25:32.067271 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:32.067229    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v88p\" (UniqueName: \"kubernetes.io/projected/9db40e90-25fd-4842-a57d-697ee30b785c-kube-api-access-4v88p\") pod \"test-curl-7778-139958971889104\" (UID: \"9db40e90-25fd-4842-a57d-697ee30b785c\") " pod="opendatahub/test-curl-7778-139958971889104"
Jul 24 14:25:32.075557 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:32.075525    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v88p\" (UniqueName: \"kubernetes.io/projected/9db40e90-25fd-4842-a57d-697ee30b785c-kube-api-access-4v88p\") pod \"test-curl-7778-139958971889104\" (UID: \"9db40e90-25fd-4842-a57d-697ee30b785c\") " pod="opendatahub/test-curl-7778-139958971889104"
Jul 24 14:25:32.229206 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:32.229165    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-139958971889104"
Jul 24 14:25:32.570911 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:32.570885    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7778-139958971889104"]
Jul 24 14:25:32.573245 ip-10-0-139-47 kubenswrapper[2559]: W0724 14:25:32.573212    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9db40e90_25fd_4842_a57d_697ee30b785c.slice/crio-50044fcacb633ea5a25961d15b8cd31c9ec11e3920fbdafe1cc35f59c877cec4 WatchSource:0}: Error finding container 50044fcacb633ea5a25961d15b8cd31c9ec11e3920fbdafe1cc35f59c877cec4: Status 404 returned error can't find the container with id 50044fcacb633ea5a25961d15b8cd31c9ec11e3920fbdafe1cc35f59c877cec4
Jul 24 14:25:33.018814 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:33.018784    2559 generic.go:356] "Generic (PLEG): container finished" podID="9db40e90-25fd-4842-a57d-697ee30b785c" containerID="da7f609b1fd011c29221c3b0fde9f76f55dc7f1233bb2bdc56d1e4c25e68f490" exitCode=0
Jul 24 14:25:33.019251 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:33.018885    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7778-139958971889104" event={"ID":"9db40e90-25fd-4842-a57d-697ee30b785c","Type":"ContainerDied","Data":"da7f609b1fd011c29221c3b0fde9f76f55dc7f1233bb2bdc56d1e4c25e68f490"}
Jul 24 14:25:33.019251 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:33.018921    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7778-139958971889104" event={"ID":"9db40e90-25fd-4842-a57d-697ee30b785c","Type":"ContainerStarted","Data":"50044fcacb633ea5a25961d15b8cd31c9ec11e3920fbdafe1cc35f59c877cec4"}
Jul 24 14:25:34.152926 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:34.152901    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-139958971889104"
Jul 24 14:25:34.173705 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:34.173680    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7778-139958971889104_9db40e90-25fd-4842-a57d-697ee30b785c/test-curl-7778-139958971889104/0.log"
Jul 24 14:25:34.197532 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:34.197496    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7778-139958971889104"]
Jul 24 14:25:34.201487 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:34.201458    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7778-139958971889104"]
Jul 24 14:25:34.288779 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:34.288693    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v88p\" (UniqueName: \"kubernetes.io/projected/9db40e90-25fd-4842-a57d-697ee30b785c-kube-api-access-4v88p\") pod \"9db40e90-25fd-4842-a57d-697ee30b785c\" (UID: \"9db40e90-25fd-4842-a57d-697ee30b785c\") "
Jul 24 14:25:34.295654 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:34.295613    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9db40e90-25fd-4842-a57d-697ee30b785c-kube-api-access-4v88p" (OuterVolumeSpecName: "kube-api-access-4v88p") pod "9db40e90-25fd-4842-a57d-697ee30b785c" (UID: "9db40e90-25fd-4842-a57d-697ee30b785c"). InnerVolumeSpecName "kube-api-access-4v88p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:25:34.390945 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:34.390892    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v88p\" (UniqueName: \"kubernetes.io/projected/9db40e90-25fd-4842-a57d-697ee30b785c-kube-api-access-4v88p\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:25:35.030748 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.030713    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50044fcacb633ea5a25961d15b8cd31c9ec11e3920fbdafe1cc35f59c877cec4"
Jul 24 14:25:35.030748 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.030733    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7778-139958971889104"
Jul 24 14:25:35.041721 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:25:35.041683    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-139958971889104\" is forbidden: User \"system:node:ip-10-0-139-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-47.ec2.internal' and this object" podUID="9db40e90-25fd-4842-a57d-697ee30b785c" pod="opendatahub/test-curl-7778-139958971889104"
Jul 24 14:25:35.129535 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.129495    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"]
Jul 24 14:25:35.129979 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.129962    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9db40e90-25fd-4842-a57d-697ee30b785c" containerName="test-curl-7778-139958971889104"
Jul 24 14:25:35.130085 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.129981    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9db40e90-25fd-4842-a57d-697ee30b785c" containerName="test-curl-7778-139958971889104"
Jul 24 14:25:35.130085 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.130066    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9db40e90-25fd-4842-a57d-697ee30b785c" containerName="test-curl-7778-139958971889104"
Jul 24 14:25:35.133024 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.133004    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.135606 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.135584    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-15e86b-openshift-default-dockercfg-gbgdb\""
Jul 24 14:25:35.146330 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.146305    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"]
Jul 24 14:25:35.173764 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:25:35.173728    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-139958971889104\" is forbidden: User \"system:node:ip-10-0-139-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-47.ec2.internal' and this object" podUID="9db40e90-25fd-4842-a57d-697ee30b785c" pod="opendatahub/test-curl-7778-139958971889104"
Jul 24 14:25:35.194612 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:25:35.194572    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7778-139958971889104\" is forbidden: User \"system:node:ip-10-0-139-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-47.ec2.internal' and this object" podUID="9db40e90-25fd-4842-a57d-697ee30b785c" pod="opendatahub/test-curl-7778-139958971889104"
Jul 24 14:25:35.197393 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.197370    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9db40e90-25fd-4842-a57d-697ee30b785c" path="/var/lib/kubelet/pods/9db40e90-25fd-4842-a57d-697ee30b785c/volumes"
Jul 24 14:25:35.199110 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.199089    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-data\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.199171 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.199125    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-credential-socket\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.199171 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.199148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-token\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.199285 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.199243    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-workload-certs\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.199341 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.199281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-envoy\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.199341 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.199313    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8367ea1-52ee-4672-b877-2f67586aaa03-istiod-ca-cert\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.199444 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.199349    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-workload-socket\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.199444 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.199374    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-podinfo\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.199444 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.199417    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8fkk\" (UniqueName: \"kubernetes.io/projected/a8367ea1-52ee-4672-b877-2f67586aaa03-kube-api-access-k8fkk\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.300528 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.300427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-data\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.300528 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.300478    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-credential-socket\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.300528 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.300504    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-token\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.300809 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.300550    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-workload-certs\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.300809 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.300574    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-envoy\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.300809 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.300604    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8367ea1-52ee-4672-b877-2f67586aaa03-istiod-ca-cert\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.300809 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.300634    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-workload-socket\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.300809 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.300655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-podinfo\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.300809 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.300696    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8fkk\" (UniqueName: \"kubernetes.io/projected/a8367ea1-52ee-4672-b877-2f67586aaa03-kube-api-access-k8fkk\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.301166 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.300954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-data\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.301166 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.301056    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-workload-certs\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.301166 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.301108    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-workload-socket\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.301331 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.301230    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-credential-socket\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.301377 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.301327    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8367ea1-52ee-4672-b877-2f67586aaa03-istiod-ca-cert\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.302915 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.302894    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-envoy\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.303216 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.303196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-podinfo\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.309636 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.309611    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-token\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.310163 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.310143    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8fkk\" (UniqueName: \"kubernetes.io/projected/a8367ea1-52ee-4672-b877-2f67586aaa03-kube-api-access-k8fkk\") pod \"e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") " pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.443659 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.443599    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:35.594014 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.593963    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"]
Jul 24 14:25:35.596157 ip-10-0-139-47 kubenswrapper[2559]: W0724 14:25:35.596129    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8367ea1_52ee_4672_b877_2f67586aaa03.slice/crio-e52ada630ee87bf2f6c19340d329de7f8f6f373661d90b58313fd83aab98e658 WatchSource:0}: Error finding container e52ada630ee87bf2f6c19340d329de7f8f6f373661d90b58313fd83aab98e658: Status 404 returned error can't find the container with id e52ada630ee87bf2f6c19340d329de7f8f6f373661d90b58313fd83aab98e658
Jul 24 14:25:35.598335 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.598301    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:25:35.598429 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.598365    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:25:35.598429 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:35.598396    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:25:36.038240 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:36.038205    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2" event={"ID":"a8367ea1-52ee-4672-b877-2f67586aaa03","Type":"ContainerStarted","Data":"caeb08d4b718e4c6e6c9cccb99d003caf56a57aa10892ccd8d97cd669bbf9447"}
Jul 24 14:25:36.038445 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:36.038264    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2" event={"ID":"a8367ea1-52ee-4672-b877-2f67586aaa03","Type":"ContainerStarted","Data":"e52ada630ee87bf2f6c19340d329de7f8f6f373661d90b58313fd83aab98e658"}
Jul 24 14:25:36.071384 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:36.071326    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2" podStartSLOduration=1.071306969 podStartE2EDuration="1.071306969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:25:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:36.070260319 +0000 UTC m=+2831.431633624" watchObservedRunningTime="2026-07-24 14:25:36.071306969 +0000 UTC m=+2831.432680271"
Jul 24 14:25:36.444779 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:36.444743    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:36.449763 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:36.449738    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:37.043035 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:37.043004    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:37.044088 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:37.044064    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:47.328801 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:47.328768    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:25:54.031292 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.031255    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"]
Jul 24 14:25:54.035634 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.035596    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.038208 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.038188    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-03c962-openshift-default-dockercfg-glfv4\""
Jul 24 14:25:54.050726 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.050692    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"]
Jul 24 14:25:54.086780 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.086733    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv9gj\" (UniqueName: \"kubernetes.io/projected/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-kube-api-access-mv9gj\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.086984 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.086788    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-workload-certs\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.086984 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.086869    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-credential-socket\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.086984 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.086928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-envoy\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.086984 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.086977    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-workload-socket\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.087175 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.087029    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-podinfo\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.087175 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.087064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-token\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.087175 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.087095    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istiod-ca-cert\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.087269 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.087174    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-data\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.188098 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.188056    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-workload-socket\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.188310 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.188120    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-podinfo\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.188310 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.188146    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-token\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.188310 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.188177    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istiod-ca-cert\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.188310 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.188240    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-data\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.188310 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.188296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv9gj\" (UniqueName: \"kubernetes.io/projected/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-kube-api-access-mv9gj\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.188581 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.188328    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-workload-certs\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.188581 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.188361    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-credential-socket\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.188581 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.188398    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-envoy\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.188752 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.188595    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-workload-socket\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.188891 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.188846    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-data\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.189077 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.189057    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istiod-ca-cert\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.189163 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.189142    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-credential-socket\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.189256 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.189233    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-workload-certs\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.191072 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.191047    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-envoy\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.191207 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.191173    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-podinfo\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.196998 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.196971    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-token\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.197098 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.197036    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv9gj\" (UniqueName: \"kubernetes.io/projected/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-kube-api-access-mv9gj\") pod \"e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") " pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.347681 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.347596    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:54.493094 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.493043    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"]
Jul 24 14:25:54.495970 ip-10-0-139-47 kubenswrapper[2559]: W0724 14:25:54.495939    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea2e7d87_2b87_4d5c_9986_6b16b75862f7.slice/crio-a366111cb7a266ef00969fd9537959e8b051b5771e1e3ca40401989cfdd3926b WatchSource:0}: Error finding container a366111cb7a266ef00969fd9537959e8b051b5771e1e3ca40401989cfdd3926b: Status 404 returned error can't find the container with id a366111cb7a266ef00969fd9537959e8b051b5771e1e3ca40401989cfdd3926b
Jul 24 14:25:54.498399 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.498360    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:25:54.498479 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.498447    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:25:54.498522 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:54.498489    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:25:55.129515 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:55.129477    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz" event={"ID":"ea2e7d87-2b87-4d5c-9986-6b16b75862f7","Type":"ContainerStarted","Data":"f88699151f3a8e46771adbee4c47c3317caa3892f7bd83ca1bd848147c175e3f"}
Jul 24 14:25:55.129935 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:55.129534    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz" event={"ID":"ea2e7d87-2b87-4d5c-9986-6b16b75862f7","Type":"ContainerStarted","Data":"a366111cb7a266ef00969fd9537959e8b051b5771e1e3ca40401989cfdd3926b"}
Jul 24 14:25:55.152169 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:55.152081    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz" podStartSLOduration=1.152027519 podStartE2EDuration="1.152027519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:25:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:25:55.15155168 +0000 UTC m=+2850.512924994" watchObservedRunningTime="2026-07-24 14:25:55.152027519 +0000 UTC m=+2850.513400827"
Jul 24 14:25:55.348818 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:55.348772    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:55.354328 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:55.354299    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:56.136400 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:56.136370    2559 generic.go:356] "Generic (PLEG): container finished" podID="a8367ea1-52ee-4672-b877-2f67586aaa03" containerID="caeb08d4b718e4c6e6c9cccb99d003caf56a57aa10892ccd8d97cd669bbf9447" exitCode=0
Jul 24 14:25:56.136940 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:56.136454    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2" event={"ID":"a8367ea1-52ee-4672-b877-2f67586aaa03","Type":"ContainerDied","Data":"caeb08d4b718e4c6e6c9cccb99d003caf56a57aa10892ccd8d97cd669bbf9447"}
Jul 24 14:25:56.136940 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:56.136832    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:56.137061 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:56.137036    2559 scope.go:117] "RemoveContainer" containerID="caeb08d4b718e4c6e6c9cccb99d003caf56a57aa10892ccd8d97cd669bbf9447"
Jul 24 14:25:56.137836 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:56.137821    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:25:56.138074 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:56.138048    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:25:56.138127 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:56.138115    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:25:56.138174 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:56.138162    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:25:57.143752 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:57.143707    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2" event={"ID":"a8367ea1-52ee-4672-b877-2f67586aaa03","Type":"ContainerStarted","Data":"f074bd621053fab7d3abae7df850e720c4f9e2f2acadbf4c434b0056f42473ab"}
Jul 24 14:25:57.444210 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:57.444173    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:25:57.444402 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:57.444367    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 24 14:25:57.444457 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:57.444416    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2" podUID="a8367ea1-52ee-4672-b877-2f67586aaa03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 24 14:25:58.444614 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:58.444570    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 24 14:25:58.445058 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:58.444633    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2" podUID="a8367ea1-52ee-4672-b877-2f67586aaa03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 24 14:25:59.444719 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:59.444678    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 24 14:25:59.445203 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:25:59.444769    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2" podUID="a8367ea1-52ee-4672-b877-2f67586aaa03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 24 14:26:00.444356 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:00.444313    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 24 14:26:00.444557 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:00.444390    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2" podUID="a8367ea1-52ee-4672-b877-2f67586aaa03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 24 14:26:01.447433 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:01.447399    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:26:01.447808 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:01.447762    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:26:01.448460 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:01.448444    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:26:07.329753 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:07.329712    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:26:15.229820 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:15.229781    2559 generic.go:356] "Generic (PLEG): container finished" podID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" containerID="f88699151f3a8e46771adbee4c47c3317caa3892f7bd83ca1bd848147c175e3f" exitCode=0
Jul 24 14:26:15.230300 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:15.229866    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz" event={"ID":"ea2e7d87-2b87-4d5c-9986-6b16b75862f7","Type":"ContainerDied","Data":"f88699151f3a8e46771adbee4c47c3317caa3892f7bd83ca1bd848147c175e3f"}
Jul 24 14:26:15.230300 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:15.230274    2559 scope.go:117] "RemoveContainer" containerID="f88699151f3a8e46771adbee4c47c3317caa3892f7bd83ca1bd848147c175e3f"
Jul 24 14:26:15.231382 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:15.231353    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:26:15.231485 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:15.231436    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:26:15.231547 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:15.231484    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 24 14:26:16.239547 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:16.239509    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz" event={"ID":"ea2e7d87-2b87-4d5c-9986-6b16b75862f7","Type":"ContainerStarted","Data":"b12cbbb7ad295ebc9919f7be3caeddfba7509fb3d99726a94e518e044ed458d6"}
Jul 24 14:26:16.348673 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:16.348634    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:26:16.348935 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:16.348915    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 24 14:26:16.348989 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:16.348967    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz" podUID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 24 14:26:17.347979 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:17.347942    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 24 14:26:17.348412 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:17.347998    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz" podUID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 24 14:26:18.348454 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:18.348410    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 24 14:26:18.349009 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:18.348475    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz" podUID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 24 14:26:19.348533 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:19.348493    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 24 14:26:19.348984 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:19.348558    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz" podUID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 24 14:26:20.351883 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:20.351836    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:26:20.352359 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:20.352331    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:26:20.353073 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:20.353055    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:26:25.469304 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.469270    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"]
Jul 24 14:26:25.474149 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.474119    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.476686 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.476665    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-15e86b\"/\"openshift-service-ca.crt\""
Jul 24 14:26:25.476940 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.476921    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-15e86b\"/\"ipp-route-15e86b-kserve-self-signed-certs\""
Jul 24 14:26:25.478030 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.478012    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-15e86b\"/\"default-dockercfg-qwgd2\""
Jul 24 14:26:25.478120 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.478084    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-15e86b\"/\"kube-root-ca.crt\""
Jul 24 14:26:25.483501 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.483479    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"]
Jul 24 14:26:25.500499 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.500460    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-dshm\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.500661 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.500530    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-tls-certs\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.500661 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.500568    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-tmp-dir\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.500751 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.500699    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-home\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.500789 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.500768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6c2f\" (UniqueName: \"kubernetes.io/projected/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-kube-api-access-t6c2f\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.500880 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.500835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-model-cache\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.601528 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.601489    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-tls-certs\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.601528 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.601533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-tmp-dir\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.601801 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.601587    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-home\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.601801 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.601739    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6c2f\" (UniqueName: \"kubernetes.io/projected/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-kube-api-access-t6c2f\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.601950 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.601809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-model-cache\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.601950 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.601852    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-dshm\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.602159 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.602136    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-tmp-dir\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.602231 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.602145    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-model-cache\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.602286 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.602278    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-home\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.604101 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.604080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-dshm\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.604468 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.604451    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-tls-certs\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.610815 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.610783    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6c2f\" (UniqueName: \"kubernetes.io/projected/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-kube-api-access-t6c2f\") pod \"ipp-route-15e86b-kserve-76545647f9-h7dsh\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") " pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.786044 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.786011    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:25.926169 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:25.926141    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"]
Jul 24 14:26:25.927911 ip-10-0-139-47 kubenswrapper[2559]: W0724 14:26:25.927882    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34dc23be_0c84_4b7e_a128_ed8d6fe91f13.slice/crio-f9f10109c4e06e3c77f23ba0fde2109960c0ec7e175171c805a3295673c780b2 WatchSource:0}: Error finding container f9f10109c4e06e3c77f23ba0fde2109960c0ec7e175171c805a3295673c780b2: Status 404 returned error can't find the container with id f9f10109c4e06e3c77f23ba0fde2109960c0ec7e175171c805a3295673c780b2
Jul 24 14:26:26.289342 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:26.289308    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh" event={"ID":"34dc23be-0c84-4b7e-a128-ed8d6fe91f13","Type":"ContainerStarted","Data":"6b97751bd854837c563805bea58265ba3282267dfffb475843403d913732730d"}
Jul 24 14:26:26.289342 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:26.289349    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh" event={"ID":"34dc23be-0c84-4b7e-a128-ed8d6fe91f13","Type":"ContainerStarted","Data":"f9f10109c4e06e3c77f23ba0fde2109960c0ec7e175171c805a3295673c780b2"}
Jul 24 14:26:26.308243 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:26.308192    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh" podStartSLOduration=1.308175888 podStartE2EDuration="1.308175888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 14:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:26:26.306314067 +0000 UTC m=+2881.667687369" watchObservedRunningTime="2026-07-24 14:26:26.308175888 +0000 UTC m=+2881.669549191"
Jul 24 14:26:29.531814 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:29.531778    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:26:35.786875 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:35.786811    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:35.787300 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:35.786900    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:35.800249 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:35.800217    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:36.349761 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:36.349726    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:26:45.042211 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:26:45.042170    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:27:06.024106 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:27:06.024065    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:27:33.921219 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:27:33.921178    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:27:58.334049 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:27:58.333948    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:28:06.814642 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:06.814603    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"]
Jul 24 14:28:08.920173 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:08.920143    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:28:21.834359 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:21.834292    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh" podUID="34dc23be-0c84-4b7e-a128-ed8d6fe91f13" containerName="main" containerID="cri-o://6b97751bd854837c563805bea58265ba3282267dfffb475843403d913732730d" gracePeriod=45
Jul 24 14:28:22.093066 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.093001    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:28:22.159803 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.159772    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6c2f\" (UniqueName: \"kubernetes.io/projected/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-kube-api-access-t6c2f\") pod \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") "
Jul 24 14:28:22.160002 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.159880    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-tls-certs\") pod \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") "
Jul 24 14:28:22.160002 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.159917    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-tmp-dir\") pod \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") "
Jul 24 14:28:22.160002 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.159942    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-home\") pod \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") "
Jul 24 14:28:22.160002 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.159980    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-dshm\") pod \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") "
Jul 24 14:28:22.160225 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.160056    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-model-cache\") pod \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\" (UID: \"34dc23be-0c84-4b7e-a128-ed8d6fe91f13\") "
Jul 24 14:28:22.160225 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.160205    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "34dc23be-0c84-4b7e-a128-ed8d6fe91f13" (UID: "34dc23be-0c84-4b7e-a128-ed8d6fe91f13"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:28:22.160337 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.160245    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-home" (OuterVolumeSpecName: "home") pod "34dc23be-0c84-4b7e-a128-ed8d6fe91f13" (UID: "34dc23be-0c84-4b7e-a128-ed8d6fe91f13"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:28:22.160424 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.160393    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-tmp-dir\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.160424 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.160417    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-home\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.160633 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.160595    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-model-cache" (OuterVolumeSpecName: "model-cache") pod "34dc23be-0c84-4b7e-a128-ed8d6fe91f13" (UID: "34dc23be-0c84-4b7e-a128-ed8d6fe91f13"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:28:22.162305 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.162273    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-kube-api-access-t6c2f" (OuterVolumeSpecName: "kube-api-access-t6c2f") pod "34dc23be-0c84-4b7e-a128-ed8d6fe91f13" (UID: "34dc23be-0c84-4b7e-a128-ed8d6fe91f13"). InnerVolumeSpecName "kube-api-access-t6c2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:28:22.162407 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.162321    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-dshm" (OuterVolumeSpecName: "dshm") pod "34dc23be-0c84-4b7e-a128-ed8d6fe91f13" (UID: "34dc23be-0c84-4b7e-a128-ed8d6fe91f13"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:28:22.162407 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.162354    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "34dc23be-0c84-4b7e-a128-ed8d6fe91f13" (UID: "34dc23be-0c84-4b7e-a128-ed8d6fe91f13"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 24 14:28:22.261177 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.261146    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-model-cache\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.261177 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.261173    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6c2f\" (UniqueName: \"kubernetes.io/projected/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-kube-api-access-t6c2f\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.261177 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.261183    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-tls-certs\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.261177 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.261196    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34dc23be-0c84-4b7e-a128-ed8d6fe91f13-dshm\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:22.848457 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.848421    2559 generic.go:356] "Generic (PLEG): container finished" podID="34dc23be-0c84-4b7e-a128-ed8d6fe91f13" containerID="6b97751bd854837c563805bea58265ba3282267dfffb475843403d913732730d" exitCode=0
Jul 24 14:28:22.848942 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.848466    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"
Jul 24 14:28:22.848942 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.848480    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh" event={"ID":"34dc23be-0c84-4b7e-a128-ed8d6fe91f13","Type":"ContainerDied","Data":"6b97751bd854837c563805bea58265ba3282267dfffb475843403d913732730d"}
Jul 24 14:28:22.848942 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.848522    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh" event={"ID":"34dc23be-0c84-4b7e-a128-ed8d6fe91f13","Type":"ContainerDied","Data":"f9f10109c4e06e3c77f23ba0fde2109960c0ec7e175171c805a3295673c780b2"}
Jul 24 14:28:22.848942 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.848544    2559 scope.go:117] "RemoveContainer" containerID="6b97751bd854837c563805bea58265ba3282267dfffb475843403d913732730d"
Jul 24 14:28:22.857549 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.857527    2559 scope.go:117] "RemoveContainer" containerID="6b97751bd854837c563805bea58265ba3282267dfffb475843403d913732730d"
Jul 24 14:28:22.857820 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:28:22.857801    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b97751bd854837c563805bea58265ba3282267dfffb475843403d913732730d\": container with ID starting with 6b97751bd854837c563805bea58265ba3282267dfffb475843403d913732730d not found: ID does not exist" containerID="6b97751bd854837c563805bea58265ba3282267dfffb475843403d913732730d"
Jul 24 14:28:22.857901 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.857832    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b97751bd854837c563805bea58265ba3282267dfffb475843403d913732730d"} err="failed to get container status \"6b97751bd854837c563805bea58265ba3282267dfffb475843403d913732730d\": rpc error: code = NotFound desc = could not find container \"6b97751bd854837c563805bea58265ba3282267dfffb475843403d913732730d\": container with ID starting with 6b97751bd854837c563805bea58265ba3282267dfffb475843403d913732730d not found: ID does not exist"
Jul 24 14:28:22.870132 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.870106    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"]
Jul 24 14:28:22.875151 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:22.875127    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-15e86b/ipp-route-15e86b-kserve-76545647f9-h7dsh"]
Jul 24 14:28:23.194798 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:23.194764    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34dc23be-0c84-4b7e-a128-ed8d6fe91f13" path="/var/lib/kubelet/pods/34dc23be-0c84-4b7e-a128-ed8d6fe91f13/volumes"
Jul 24 14:28:50.312344 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:50.312307    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"]
Jul 24 14:28:50.312873 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:50.312523    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2" podUID="a8367ea1-52ee-4672-b877-2f67586aaa03" containerName="istio-proxy" containerID="cri-o://f074bd621053fab7d3abae7df850e720c4f9e2f2acadbf4c434b0056f42473ab" gracePeriod=30
Jul 24 14:28:55.570204 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.570176    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:28:55.679479 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.679379    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-workload-socket\") pod \"a8367ea1-52ee-4672-b877-2f67586aaa03\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") "
Jul 24 14:28:55.679479 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.679426    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-data\") pod \"a8367ea1-52ee-4672-b877-2f67586aaa03\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") "
Jul 24 14:28:55.679479 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.679462    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8fkk\" (UniqueName: \"kubernetes.io/projected/a8367ea1-52ee-4672-b877-2f67586aaa03-kube-api-access-k8fkk\") pod \"a8367ea1-52ee-4672-b877-2f67586aaa03\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") "
Jul 24 14:28:55.679773 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.679491    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-workload-certs\") pod \"a8367ea1-52ee-4672-b877-2f67586aaa03\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") "
Jul 24 14:28:55.679773 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.679518    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-credential-socket\") pod \"a8367ea1-52ee-4672-b877-2f67586aaa03\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") "
Jul 24 14:28:55.679773 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.679538    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-podinfo\") pod \"a8367ea1-52ee-4672-b877-2f67586aaa03\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") "
Jul 24 14:28:55.679773 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.679577    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-envoy\") pod \"a8367ea1-52ee-4672-b877-2f67586aaa03\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") "
Jul 24 14:28:55.679773 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.679624    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-token\") pod \"a8367ea1-52ee-4672-b877-2f67586aaa03\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") "
Jul 24 14:28:55.679773 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.679659    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8367ea1-52ee-4672-b877-2f67586aaa03-istiod-ca-cert\") pod \"a8367ea1-52ee-4672-b877-2f67586aaa03\" (UID: \"a8367ea1-52ee-4672-b877-2f67586aaa03\") "
Jul 24 14:28:55.679773 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.679741    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a8367ea1-52ee-4672-b877-2f67586aaa03" (UID: "a8367ea1-52ee-4672-b877-2f67586aaa03"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:28:55.680144 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.679881    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a8367ea1-52ee-4672-b877-2f67586aaa03" (UID: "a8367ea1-52ee-4672-b877-2f67586aaa03"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:28:55.680144 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.679932    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a8367ea1-52ee-4672-b877-2f67586aaa03" (UID: "a8367ea1-52ee-4672-b877-2f67586aaa03"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:28:55.680144 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.680096    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-workload-socket\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:55.680144 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.680117    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-workload-certs\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:55.680144 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.680132    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-credential-socket\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:55.680461 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.680438    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8367ea1-52ee-4672-b877-2f67586aaa03-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a8367ea1-52ee-4672-b877-2f67586aaa03" (UID: "a8367ea1-52ee-4672-b877-2f67586aaa03"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:28:55.680643 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.680615    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-data" (OuterVolumeSpecName: "istio-data") pod "a8367ea1-52ee-4672-b877-2f67586aaa03" (UID: "a8367ea1-52ee-4672-b877-2f67586aaa03"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:28:55.682115 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.682087    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a8367ea1-52ee-4672-b877-2f67586aaa03" (UID: "a8367ea1-52ee-4672-b877-2f67586aaa03"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:28:55.682372 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.682151    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a8367ea1-52ee-4672-b877-2f67586aaa03" (UID: "a8367ea1-52ee-4672-b877-2f67586aaa03"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 14:28:55.682372 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.682265    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-token" (OuterVolumeSpecName: "istio-token") pod "a8367ea1-52ee-4672-b877-2f67586aaa03" (UID: "a8367ea1-52ee-4672-b877-2f67586aaa03"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:28:55.682372 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.682286    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8367ea1-52ee-4672-b877-2f67586aaa03-kube-api-access-k8fkk" (OuterVolumeSpecName: "kube-api-access-k8fkk") pod "a8367ea1-52ee-4672-b877-2f67586aaa03" (UID: "a8367ea1-52ee-4672-b877-2f67586aaa03"). InnerVolumeSpecName "kube-api-access-k8fkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:28:55.780772 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.780735    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-data\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:55.780772 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.780766    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8fkk\" (UniqueName: \"kubernetes.io/projected/a8367ea1-52ee-4672-b877-2f67586aaa03-kube-api-access-k8fkk\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:55.780772 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.780776    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-podinfo\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:55.781058 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.780786    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-envoy\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:55.781058 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.780795    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8367ea1-52ee-4672-b877-2f67586aaa03-istio-token\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:55.781058 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:55.780802    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8367ea1-52ee-4672-b877-2f67586aaa03-istiod-ca-cert\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:28:56.014478 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:56.014444    2559 generic.go:356] "Generic (PLEG): container finished" podID="a8367ea1-52ee-4672-b877-2f67586aaa03" containerID="f074bd621053fab7d3abae7df850e720c4f9e2f2acadbf4c434b0056f42473ab" exitCode=0
Jul 24 14:28:56.014694 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:56.014496    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"
Jul 24 14:28:56.014694 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:56.014539    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2" event={"ID":"a8367ea1-52ee-4672-b877-2f67586aaa03","Type":"ContainerDied","Data":"f074bd621053fab7d3abae7df850e720c4f9e2f2acadbf4c434b0056f42473ab"}
Jul 24 14:28:56.014694 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:56.014603    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2" event={"ID":"a8367ea1-52ee-4672-b877-2f67586aaa03","Type":"ContainerDied","Data":"e52ada630ee87bf2f6c19340d329de7f8f6f373661d90b58313fd83aab98e658"}
Jul 24 14:28:56.014694 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:56.014634    2559 scope.go:117] "RemoveContainer" containerID="f074bd621053fab7d3abae7df850e720c4f9e2f2acadbf4c434b0056f42473ab"
Jul 24 14:28:56.024172 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:56.024157    2559 scope.go:117] "RemoveContainer" containerID="caeb08d4b718e4c6e6c9cccb99d003caf56a57aa10892ccd8d97cd669bbf9447"
Jul 24 14:28:56.038139 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:56.038106    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"]
Jul 24 14:28:56.038202 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:56.038184    2559 scope.go:117] "RemoveContainer" containerID="f074bd621053fab7d3abae7df850e720c4f9e2f2acadbf4c434b0056f42473ab"
Jul 24 14:28:56.038469 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:28:56.038453    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f074bd621053fab7d3abae7df850e720c4f9e2f2acadbf4c434b0056f42473ab\": container with ID starting with f074bd621053fab7d3abae7df850e720c4f9e2f2acadbf4c434b0056f42473ab not found: ID does not exist" containerID="f074bd621053fab7d3abae7df850e720c4f9e2f2acadbf4c434b0056f42473ab"
Jul 24 14:28:56.038514 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:56.038477    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f074bd621053fab7d3abae7df850e720c4f9e2f2acadbf4c434b0056f42473ab"} err="failed to get container status \"f074bd621053fab7d3abae7df850e720c4f9e2f2acadbf4c434b0056f42473ab\": rpc error: code = NotFound desc = could not find container \"f074bd621053fab7d3abae7df850e720c4f9e2f2acadbf4c434b0056f42473ab\": container with ID starting with f074bd621053fab7d3abae7df850e720c4f9e2f2acadbf4c434b0056f42473ab not found: ID does not exist"
Jul 24 14:28:56.038514 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:56.038496    2559 scope.go:117] "RemoveContainer" containerID="caeb08d4b718e4c6e6c9cccb99d003caf56a57aa10892ccd8d97cd669bbf9447"
Jul 24 14:28:56.038717 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:28:56.038701    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caeb08d4b718e4c6e6c9cccb99d003caf56a57aa10892ccd8d97cd669bbf9447\": container with ID starting with caeb08d4b718e4c6e6c9cccb99d003caf56a57aa10892ccd8d97cd669bbf9447 not found: ID does not exist" containerID="caeb08d4b718e4c6e6c9cccb99d003caf56a57aa10892ccd8d97cd669bbf9447"
Jul 24 14:28:56.038759 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:56.038723    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caeb08d4b718e4c6e6c9cccb99d003caf56a57aa10892ccd8d97cd669bbf9447"} err="failed to get container status \"caeb08d4b718e4c6e6c9cccb99d003caf56a57aa10892ccd8d97cd669bbf9447\": rpc error: code = NotFound desc = could not find container \"caeb08d4b718e4c6e6c9cccb99d003caf56a57aa10892ccd8d97cd669bbf9447\": container with ID starting with caeb08d4b718e4c6e6c9cccb99d003caf56a57aa10892ccd8d97cd669bbf9447 not found: ID does not exist"
Jul 24 14:28:56.041194 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:56.041175    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-15e86b-openshift-default-6b5f4ccf44-sg9t2"]
Jul 24 14:28:57.194921 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:28:57.194884    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8367ea1-52ee-4672-b877-2f67586aaa03" path="/var/lib/kubelet/pods/a8367ea1-52ee-4672-b877-2f67586aaa03/volumes"
Jul 24 14:29:04.528553 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:04.528511    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:29:12.585321 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:12.585283    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"]
Jul 24 14:29:12.585776 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:12.585518    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz" podUID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" containerName="istio-proxy" containerID="cri-o://b12cbbb7ad295ebc9919f7be3caeddfba7509fb3d99726a94e518e044ed458d6" gracePeriod=30
Jul 24 14:29:17.836202 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.836175    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:29:17.984090 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.984054    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-token\") pod \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") "
Jul 24 14:29:17.984090 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.984102    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-credential-socket\") pod \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") "
Jul 24 14:29:17.984351 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.984145    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-podinfo\") pod \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") "
Jul 24 14:29:17.984351 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.984173    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-workload-certs\") pod \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") "
Jul 24 14:29:17.984351 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.984198    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-workload-socket\") pod \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") "
Jul 24 14:29:17.984351 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.984225    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-data\") pod \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") "
Jul 24 14:29:17.984351 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.984252    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv9gj\" (UniqueName: \"kubernetes.io/projected/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-kube-api-access-mv9gj\") pod \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") "
Jul 24 14:29:17.984351 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.984284    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-envoy\") pod \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") "
Jul 24 14:29:17.984351 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.984322    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istiod-ca-cert\") pod \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\" (UID: \"ea2e7d87-2b87-4d5c-9986-6b16b75862f7\") "
Jul 24 14:29:17.984717 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.984395    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ea2e7d87-2b87-4d5c-9986-6b16b75862f7" (UID: "ea2e7d87-2b87-4d5c-9986-6b16b75862f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:29:17.984717 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.984668    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-credential-socket\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:29:17.984874 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.984830    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ea2e7d87-2b87-4d5c-9986-6b16b75862f7" (UID: "ea2e7d87-2b87-4d5c-9986-6b16b75862f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 24 14:29:17.984994 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.984959    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ea2e7d87-2b87-4d5c-9986-6b16b75862f7" (UID: "ea2e7d87-2b87-4d5c-9986-6b16b75862f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:29:17.985076 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.985039    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ea2e7d87-2b87-4d5c-9986-6b16b75862f7" (UID: "ea2e7d87-2b87-4d5c-9986-6b16b75862f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:29:17.985351 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.985313    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "ea2e7d87-2b87-4d5c-9986-6b16b75862f7" (UID: "ea2e7d87-2b87-4d5c-9986-6b16b75862f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:29:17.986532 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.986506    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ea2e7d87-2b87-4d5c-9986-6b16b75862f7" (UID: "ea2e7d87-2b87-4d5c-9986-6b16b75862f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 24 14:29:17.986634 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.986557    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-kube-api-access-mv9gj" (OuterVolumeSpecName: "kube-api-access-mv9gj") pod "ea2e7d87-2b87-4d5c-9986-6b16b75862f7" (UID: "ea2e7d87-2b87-4d5c-9986-6b16b75862f7"). InnerVolumeSpecName "kube-api-access-mv9gj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:29:17.986634 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.986574    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "ea2e7d87-2b87-4d5c-9986-6b16b75862f7" (UID: "ea2e7d87-2b87-4d5c-9986-6b16b75862f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 24 14:29:17.986718 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:17.986670    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ea2e7d87-2b87-4d5c-9986-6b16b75862f7" (UID: "ea2e7d87-2b87-4d5c-9986-6b16b75862f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 24 14:29:18.085581 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.085538    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-podinfo\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:29:18.085581 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.085573    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-workload-certs\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:29:18.085581 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.085582    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-workload-socket\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:29:18.085581 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.085590    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-data\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:29:18.085905 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.085599    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv9gj\" (UniqueName: \"kubernetes.io/projected/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-kube-api-access-mv9gj\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:29:18.085905 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.085607    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-envoy\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:29:18.085905 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.085617    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istiod-ca-cert\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:29:18.085905 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.085624    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea2e7d87-2b87-4d5c-9986-6b16b75862f7-istio-token\") on node \"ip-10-0-139-47.ec2.internal\" DevicePath \"\""
Jul 24 14:29:18.130993 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.130962    2559 generic.go:356] "Generic (PLEG): container finished" podID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" containerID="b12cbbb7ad295ebc9919f7be3caeddfba7509fb3d99726a94e518e044ed458d6" exitCode=0
Jul 24 14:29:18.131175 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.131015    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"
Jul 24 14:29:18.131175 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.131045    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz" event={"ID":"ea2e7d87-2b87-4d5c-9986-6b16b75862f7","Type":"ContainerDied","Data":"b12cbbb7ad295ebc9919f7be3caeddfba7509fb3d99726a94e518e044ed458d6"}
Jul 24 14:29:18.131175 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.131098    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz" event={"ID":"ea2e7d87-2b87-4d5c-9986-6b16b75862f7","Type":"ContainerDied","Data":"a366111cb7a266ef00969fd9537959e8b051b5771e1e3ca40401989cfdd3926b"}
Jul 24 14:29:18.131175 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.131120    2559 scope.go:117] "RemoveContainer" containerID="b12cbbb7ad295ebc9919f7be3caeddfba7509fb3d99726a94e518e044ed458d6"
Jul 24 14:29:18.140730 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.140705    2559 scope.go:117] "RemoveContainer" containerID="f88699151f3a8e46771adbee4c47c3317caa3892f7bd83ca1bd848147c175e3f"
Jul 24 14:29:18.148792 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.148771    2559 scope.go:117] "RemoveContainer" containerID="b12cbbb7ad295ebc9919f7be3caeddfba7509fb3d99726a94e518e044ed458d6"
Jul 24 14:29:18.149138 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:29:18.149117    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b12cbbb7ad295ebc9919f7be3caeddfba7509fb3d99726a94e518e044ed458d6\": container with ID starting with b12cbbb7ad295ebc9919f7be3caeddfba7509fb3d99726a94e518e044ed458d6 not found: ID does not exist" containerID="b12cbbb7ad295ebc9919f7be3caeddfba7509fb3d99726a94e518e044ed458d6"
Jul 24 14:29:18.149192 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.149148    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b12cbbb7ad295ebc9919f7be3caeddfba7509fb3d99726a94e518e044ed458d6"} err="failed to get container status \"b12cbbb7ad295ebc9919f7be3caeddfba7509fb3d99726a94e518e044ed458d6\": rpc error: code = NotFound desc = could not find container \"b12cbbb7ad295ebc9919f7be3caeddfba7509fb3d99726a94e518e044ed458d6\": container with ID starting with b12cbbb7ad295ebc9919f7be3caeddfba7509fb3d99726a94e518e044ed458d6 not found: ID does not exist"
Jul 24 14:29:18.149192 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.149167    2559 scope.go:117] "RemoveContainer" containerID="f88699151f3a8e46771adbee4c47c3317caa3892f7bd83ca1bd848147c175e3f"
Jul 24 14:29:18.149432 ip-10-0-139-47 kubenswrapper[2559]: E0724 14:29:18.149414    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f88699151f3a8e46771adbee4c47c3317caa3892f7bd83ca1bd848147c175e3f\": container with ID starting with f88699151f3a8e46771adbee4c47c3317caa3892f7bd83ca1bd848147c175e3f not found: ID does not exist" containerID="f88699151f3a8e46771adbee4c47c3317caa3892f7bd83ca1bd848147c175e3f"
Jul 24 14:29:18.149478 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.149438    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f88699151f3a8e46771adbee4c47c3317caa3892f7bd83ca1bd848147c175e3f"} err="failed to get container status \"f88699151f3a8e46771adbee4c47c3317caa3892f7bd83ca1bd848147c175e3f\": rpc error: code = NotFound desc = could not find container \"f88699151f3a8e46771adbee4c47c3317caa3892f7bd83ca1bd848147c175e3f\": container with ID starting with f88699151f3a8e46771adbee4c47c3317caa3892f7bd83ca1bd848147c175e3f not found: ID does not exist"
Jul 24 14:29:18.155262 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.155237    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"]
Jul 24 14:29:18.160623 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:18.160597    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-03c962-openshift-default-6557c476db-kzblz"]
Jul 24 14:29:19.194901 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:19.194851    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" path="/var/lib/kubelet/pods/ea2e7d87-2b87-4d5c-9986-6b16b75862f7/volumes"
Jul 24 14:29:26.740785 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:26.740743    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:29:49.130164 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:49.130123    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-h9g72"]
Jul 24 14:29:58.671914 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:29:58.671850    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-668f95b49b-zz72f_864a241c-4f2f-4820-ad07-f6380bfb0a15/authorino/0.log"
Jul 24 14:30:05.370535 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:05.370499    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c96dc84dd-s68bf_4fa3eda8-be09-4596-82ef-06eda0b4f541/copy-manifests/0.log"
Jul 24 14:30:05.385760 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:05.385721    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c96dc84dd-s68bf_4fa3eda8-be09-4596-82ef-06eda0b4f541/manager/0.log"
Jul 24 14:30:08.035134 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:08.035099    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-668f95b49b-zz72f_864a241c-4f2f-4820-ad07-f6380bfb0a15/authorino/0.log"
Jul 24 14:30:08.794572 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:08.794543    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-h9g72_d819deb4-d003-48ae-82b6-667ba08f30f9/limitador/0.log"
Jul 24 14:30:09.307009 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:09.306983    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl_9b96e249-442e-4b3b-bb8f-6c3c43e36f48/istio-proxy/0.log"
Jul 24 14:30:09.696287 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:09.696260    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8885cbd9-x48rw_56045d8f-d165-4ee9-9791-0da40f1a1b0b/kube-auth-proxy/0.log"
Jul 24 14:30:09.822514 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:09.822482    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4pp26_908772b2-f9e5-4479-b7c9-ed4049b624a4/istio-proxy/1.log"
Jul 24 14:30:10.201379 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:10.201351    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-844758777-vlhpj_2c34fa6e-abb0-45d7-9ba6-5da2efa8388b/router/0.log"
Jul 24 14:30:10.964198 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:10.964166    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhb4w4_35fb468d-1c01-4946-ac32-ba8be76ff277/main/0.log"
Jul 24 14:30:11.217330 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:11.217246    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-wknxh_f5eeed37-5a64-4591-be7c-7f37bbf04ce8/main/0.log"
Jul 24 14:30:21.727753 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:21.727724    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-djnpp_98ca09e8-a638-4eba-a4d8-49c66f7b4a37/global-pull-secret-syncer/0.log"
Jul 24 14:30:21.944842 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:21.944814    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vlwcz_5b3224c7-2679-4a70-a014-1db9085c4982/konnectivity-agent/0.log"
Jul 24 14:30:21.995621 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:21.995535    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-47.ec2.internal_7597d384bc0b2108c01c0cc49001edde/haproxy/0.log"
Jul 24 14:30:27.390632 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:27.390598    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-668f95b49b-zz72f_864a241c-4f2f-4820-ad07-f6380bfb0a15/authorino/0.log"
Jul 24 14:30:27.911236 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:27.911207    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-h9g72_d819deb4-d003-48ae-82b6-667ba08f30f9/limitador/0.log"
Jul 24 14:30:29.912001 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:29.911970    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-t6gbv_3b2f7fb2-4227-4b29-a184-f96807d92797/kube-state-metrics/0.log"
Jul 24 14:30:29.937810 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:29.937783    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-t6gbv_3b2f7fb2-4227-4b29-a184-f96807d92797/kube-rbac-proxy-main/0.log"
Jul 24 14:30:29.971450 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:29.971423    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-t6gbv_3b2f7fb2-4227-4b29-a184-f96807d92797/kube-rbac-proxy-self/0.log"
Jul 24 14:30:30.156179 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.156107    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g8br8_c90e2a9a-1707-4b8c-ac09-356ecbf9252a/node-exporter/0.log"
Jul 24 14:30:30.183010 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.182983    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g8br8_c90e2a9a-1707-4b8c-ac09-356ecbf9252a/kube-rbac-proxy/0.log"
Jul 24 14:30:30.221993 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.221963    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g8br8_c90e2a9a-1707-4b8c-ac09-356ecbf9252a/init-textfile/0.log"
Jul 24 14:30:30.375703 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.375670    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-98mvw_a5d7d804-a7f1-4a2f-aea0-2306aafca41e/kube-rbac-proxy-main/0.log"
Jul 24 14:30:30.406905 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.406802    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-98mvw_a5d7d804-a7f1-4a2f-aea0-2306aafca41e/kube-rbac-proxy-self/0.log"
Jul 24 14:30:30.451467 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.451434    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-98mvw_a5d7d804-a7f1-4a2f-aea0-2306aafca41e/openshift-state-metrics/0.log"
Jul 24 14:30:30.498195 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.498163    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d1c927b-0936-458a-b704-b817b42c82b5/prometheus/0.log"
Jul 24 14:30:30.525463 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.525410    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d1c927b-0936-458a-b704-b817b42c82b5/config-reloader/0.log"
Jul 24 14:30:30.551609 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.551581    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d1c927b-0936-458a-b704-b817b42c82b5/thanos-sidecar/0.log"
Jul 24 14:30:30.578794 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.578758    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d1c927b-0936-458a-b704-b817b42c82b5/kube-rbac-proxy-web/0.log"
Jul 24 14:30:30.632952 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.632910    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d1c927b-0936-458a-b704-b817b42c82b5/kube-rbac-proxy/0.log"
Jul 24 14:30:30.669817 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.667642    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d1c927b-0936-458a-b704-b817b42c82b5/kube-rbac-proxy-thanos/0.log"
Jul 24 14:30:30.695436 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.695406    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d1c927b-0936-458a-b704-b817b42c82b5/init-config-reloader/0.log"
Jul 24 14:30:30.730164 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.730134    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-qqbqm_44de8ee9-714e-4dc1-af88-550c58cf190d/prometheus-operator/0.log"
Jul 24 14:30:30.763984 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.763957    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-qqbqm_44de8ee9-714e-4dc1-af88-550c58cf190d/kube-rbac-proxy/0.log"
Jul 24 14:30:30.920729 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.920643    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865d599f6f-tzz29_7e2c8b54-473b-4257-867a-7ed3c486a299/thanos-query/0.log"
Jul 24 14:30:30.949602 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.949573    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865d599f6f-tzz29_7e2c8b54-473b-4257-867a-7ed3c486a299/kube-rbac-proxy-web/0.log"
Jul 24 14:30:30.989555 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:30.989526    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865d599f6f-tzz29_7e2c8b54-473b-4257-867a-7ed3c486a299/kube-rbac-proxy/0.log"
Jul 24 14:30:31.040713 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:31.040686    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865d599f6f-tzz29_7e2c8b54-473b-4257-867a-7ed3c486a299/prom-label-proxy/0.log"
Jul 24 14:30:31.085040 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:31.085014    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865d599f6f-tzz29_7e2c8b54-473b-4257-867a-7ed3c486a299/kube-rbac-proxy-rules/0.log"
Jul 24 14:30:31.119499 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:31.119466    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865d599f6f-tzz29_7e2c8b54-473b-4257-867a-7ed3c486a299/kube-rbac-proxy-metrics/0.log"
Jul 24 14:30:32.552690 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.552656    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"]
Jul 24 14:30:32.553096 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.553049    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" containerName="istio-proxy"
Jul 24 14:30:32.553096 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.553061    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" containerName="istio-proxy"
Jul 24 14:30:32.553096 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.553081    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" containerName="istio-proxy"
Jul 24 14:30:32.553096 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.553087    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" containerName="istio-proxy"
Jul 24 14:30:32.553230 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.553098    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8367ea1-52ee-4672-b877-2f67586aaa03" containerName="istio-proxy"
Jul 24 14:30:32.553230 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.553105    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8367ea1-52ee-4672-b877-2f67586aaa03" containerName="istio-proxy"
Jul 24 14:30:32.553230 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.553119    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34dc23be-0c84-4b7e-a128-ed8d6fe91f13" containerName="main"
Jul 24 14:30:32.553230 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.553124    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="34dc23be-0c84-4b7e-a128-ed8d6fe91f13" containerName="main"
Jul 24 14:30:32.553230 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.553189    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" containerName="istio-proxy"
Jul 24 14:30:32.553230 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.553197    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8367ea1-52ee-4672-b877-2f67586aaa03" containerName="istio-proxy"
Jul 24 14:30:32.553230 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.553203    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea2e7d87-2b87-4d5c-9986-6b16b75862f7" containerName="istio-proxy"
Jul 24 14:30:32.553230 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.553211    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="34dc23be-0c84-4b7e-a128-ed8d6fe91f13" containerName="main"
Jul 24 14:30:32.556228 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.556206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.558656 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.558630    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-njvgn\"/\"default-dockercfg-bdtjz\""
Jul 24 14:30:32.558765 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.558744    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-njvgn\"/\"openshift-service-ca.crt\""
Jul 24 14:30:32.559513 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.559496    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-njvgn\"/\"kube-root-ca.crt\""
Jul 24 14:30:32.571680 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.571660    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"]
Jul 24 14:30:32.689285 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.689247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66866022-11f7-4b7d-9cf0-d4b68ab235d6-sys\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.689445 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.689368    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h96gh\" (UniqueName: \"kubernetes.io/projected/66866022-11f7-4b7d-9cf0-d4b68ab235d6-kube-api-access-h96gh\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.689445 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.689424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66866022-11f7-4b7d-9cf0-d4b68ab235d6-proc\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.689544 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.689456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66866022-11f7-4b7d-9cf0-d4b68ab235d6-lib-modules\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.689544 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.689477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66866022-11f7-4b7d-9cf0-d4b68ab235d6-podres\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.790225 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.790194    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66866022-11f7-4b7d-9cf0-d4b68ab235d6-sys\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.790409 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.790258    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h96gh\" (UniqueName: \"kubernetes.io/projected/66866022-11f7-4b7d-9cf0-d4b68ab235d6-kube-api-access-h96gh\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.790409 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.790295    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66866022-11f7-4b7d-9cf0-d4b68ab235d6-proc\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.790409 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.790321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66866022-11f7-4b7d-9cf0-d4b68ab235d6-lib-modules\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.790409 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.790321    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66866022-11f7-4b7d-9cf0-d4b68ab235d6-sys\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.790409 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.790339    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66866022-11f7-4b7d-9cf0-d4b68ab235d6-podres\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.790609 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.790425    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/66866022-11f7-4b7d-9cf0-d4b68ab235d6-proc\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.790609 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.790453    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/66866022-11f7-4b7d-9cf0-d4b68ab235d6-lib-modules\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.790609 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.790453    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/66866022-11f7-4b7d-9cf0-d4b68ab235d6-podres\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.799049 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.799028    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h96gh\" (UniqueName: \"kubernetes.io/projected/66866022-11f7-4b7d-9cf0-d4b68ab235d6-kube-api-access-h96gh\") pod \"perf-node-gather-daemonset-t8r48\" (UID: \"66866022-11f7-4b7d-9cf0-d4b68ab235d6\") " pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:32.866517 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:32.866419    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:33.001113 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:33.001086    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"]
Jul 24 14:30:33.003691 ip-10-0-139-47 kubenswrapper[2559]: W0724 14:30:33.003662    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod66866022_11f7_4b7d_9cf0_d4b68ab235d6.slice/crio-e68d73f8eb01d69dc398ec00ae9f5be495d15143f7f051f3db396f5c43239224 WatchSource:0}: Error finding container e68d73f8eb01d69dc398ec00ae9f5be495d15143f7f051f3db396f5c43239224: Status 404 returned error can't find the container with id e68d73f8eb01d69dc398ec00ae9f5be495d15143f7f051f3db396f5c43239224
Jul 24 14:30:33.473406 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:33.473368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48" event={"ID":"66866022-11f7-4b7d-9cf0-d4b68ab235d6","Type":"ContainerStarted","Data":"a0e911232ad36f5049720e3f67e44a8731889d3eae3b07077684550d95d9c2af"}
Jul 24 14:30:33.473634 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:33.473451    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48" event={"ID":"66866022-11f7-4b7d-9cf0-d4b68ab235d6","Type":"ContainerStarted","Data":"e68d73f8eb01d69dc398ec00ae9f5be495d15143f7f051f3db396f5c43239224"}
Jul 24 14:30:33.473634 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:33.473558    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:33.493392 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:33.493336    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48" podStartSLOduration=1.493320213 podStartE2EDuration="1.493320213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 14:30:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 14:30:33.491727607 +0000 UTC m=+3128.853100946" watchObservedRunningTime="2026-07-24 14:30:33.493320213 +0000 UTC m=+3128.854693516"
Jul 24 14:30:35.304433 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:35.304406    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j9254_4cf4108d-bdcb-4215-bc72-22f3d28211c6/dns/0.log"
Jul 24 14:30:35.328600 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:35.328565    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j9254_4cf4108d-bdcb-4215-bc72-22f3d28211c6/kube-rbac-proxy/0.log"
Jul 24 14:30:35.521324 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:35.521292    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dlfwk_6fc9b45b-0545-43b7-8054-c134b3145ab3/dns-node-resolver/0.log"
Jul 24 14:30:36.128992 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:36.128961    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fwzrj_1bc58137-000f-4dc7-8ced-06ec20f72052/node-ca/0.log"
Jul 24 14:30:37.206921 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:37.206895    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl_9b96e249-442e-4b3b-bb8f-6c3c43e36f48/istio-proxy/0.log"
Jul 24 14:30:37.435228 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:37.435199    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8885cbd9-x48rw_56045d8f-d165-4ee9-9791-0da40f1a1b0b/kube-auth-proxy/0.log"
Jul 24 14:30:37.468596 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:37.468518    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4pp26_908772b2-f9e5-4479-b7c9-ed4049b624a4/istio-proxy/0.log"
Jul 24 14:30:37.496458 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:37.496425    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4pp26_908772b2-f9e5-4479-b7c9-ed4049b624a4/istio-proxy/1.log"
Jul 24 14:30:37.594837 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:37.594806    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-844758777-vlhpj_2c34fa6e-abb0-45d7-9ba6-5da2efa8388b/router/0.log"
Jul 24 14:30:38.486037 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:38.486005    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xlhvh_92ef8199-a528-4240-b439-f7ea2a677307/serve-healthcheck-canary/0.log"
Jul 24 14:30:39.244949 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:39.244912    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q8w4g_76db45b2-91ed-4a49-9db7-3d01bacf33ce/kube-rbac-proxy/0.log"
Jul 24 14:30:39.288004 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:39.287978    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q8w4g_76db45b2-91ed-4a49-9db7-3d01bacf33ce/exporter/0.log"
Jul 24 14:30:39.323278 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:39.323248    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q8w4g_76db45b2-91ed-4a49-9db7-3d01bacf33ce/extractor/0.log"
Jul 24 14:30:39.487227 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:39.487200    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-njvgn/perf-node-gather-daemonset-t8r48"
Jul 24 14:30:42.683920 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:42.683850    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c96dc84dd-s68bf_4fa3eda8-be09-4596-82ef-06eda0b4f541/manager/0.log"
Jul 24 14:30:42.726734 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:42.726710    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c96dc84dd-s68bf_4fa3eda8-be09-4596-82ef-06eda0b4f541/copy-manifests/0.log"
Jul 24 14:30:42.871141 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:42.871115    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl_9b96e249-442e-4b3b-bb8f-6c3c43e36f48/istio-proxy/0.log"
Jul 24 14:30:43.077018 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:43.076927    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8885cbd9-x48rw_56045d8f-d165-4ee9-9791-0da40f1a1b0b/kube-auth-proxy/0.log"
Jul 24 14:30:43.106713 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:43.106680    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4pp26_908772b2-f9e5-4479-b7c9-ed4049b624a4/istio-proxy/0.log"
Jul 24 14:30:43.135293 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:43.135249    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4pp26_908772b2-f9e5-4479-b7c9-ed4049b624a4/istio-proxy/1.log"
Jul 24 14:30:43.208515 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:43.208490    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-844758777-vlhpj_2c34fa6e-abb0-45d7-9ba6-5da2efa8388b/router/0.log"
Jul 24 14:30:44.204722 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:44.204690    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7f486947b8-zqnxm_ce526fee-4295-49d3-8506-c76bca20bd98/manager/0.log"
Jul 24 14:30:44.575548 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:44.575465    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-x5lsl_9b96e249-442e-4b3b-bb8f-6c3c43e36f48/istio-proxy/0.log"
Jul 24 14:30:44.759084 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:44.759057    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f8885cbd9-x48rw_56045d8f-d165-4ee9-9791-0da40f1a1b0b/kube-auth-proxy/0.log"
Jul 24 14:30:44.784224 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:44.784192    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4pp26_908772b2-f9e5-4479-b7c9-ed4049b624a4/istio-proxy/0.log"
Jul 24 14:30:44.810330 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:44.810286    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-4pp26_908772b2-f9e5-4479-b7c9-ed4049b624a4/istio-proxy/1.log"
Jul 24 14:30:44.895846 ip-10-0-139-47 kubenswrapper[2559]: I0724 14:30:44.895750    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-844758777-vlhpj_2c34fa6e-abb0-45d7-9ba6-5da2efa8388b/router/0.log"