Jul 14 21:50:39.574164 ip-10-0-142-126 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.033382    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039153    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039165    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039169    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039172    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039175    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039178    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039181    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 21:50:40.040797 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039185    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039187    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039190    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039193    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039196    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039198    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039201    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039203    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039206    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039209    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039211    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039219    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039222    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039226    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039229    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039233    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039237    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039240    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039243    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039246    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 21:50:40.055628 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039249    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039252    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039255    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039258    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039261    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039264    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039267    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039270    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039273    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039276    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039278    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039281    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039284    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039287    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039289    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039292    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039295    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039297    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039300    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039303    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 21:50:40.104534 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039305    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039308    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039311    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039313    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039316    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039318    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039321    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039323    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039326    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039328    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039331    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039333    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039336    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039339    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039341    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039344    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039346    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039349    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039351    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 21:50:40.138588 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039354    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 21:50:40.117260 ip-10-0-142-126 systemd[1]: Started Kubernetes Kubelet.
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039357    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039360    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039362    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039365    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039368    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039370    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039373    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039376    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039378    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039381    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039384    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039387    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039390    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039393    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039395    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039398    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039401    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039403    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039406    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 21:50:40.376891 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039409    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039411    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039416    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039419    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039422    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039427    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039431    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039435    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039438    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039440    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039443    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039446    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.039449    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040175    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040181    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040184    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040187    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040190    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040194    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 21:50:40.385392 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040197    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040199    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040202    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040205    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040207    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040210    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040213    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040216    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040219    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040221    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040224    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040227    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040229    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040232    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040234    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040240    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040243    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040245    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040248    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040251    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 21:50:40.386309 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040253    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040256    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040259    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040264    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040268    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040271    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040273    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040276    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040279    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040282    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040284    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040287    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040291    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040293    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040296    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040298    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040300    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040303    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040305    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 21:50:40.387506 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040308    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040311    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040315    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040318    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040321    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040324    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040326    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040329    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040347    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040351    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040355    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040358    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040361    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040364    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040367    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040370    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040372    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040375    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040378    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 21:50:40.388298 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040380    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040383    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040387    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040389    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040392    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040395    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040398    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040401    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040404    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040407    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040409    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040414    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040417    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040421    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040424    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040426    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040429    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040431    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040434    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040437    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 21:50:40.388929 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040439    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040443    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040446    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040450    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040453    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040455    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040458    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040460    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040463    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040466    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040468    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040471    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040473    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040476    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040479    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040902    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040919    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040922    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040925    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040929    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 21:50:40.389561 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040931    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040934    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040937    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040941    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040945    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040947    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040950    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040953    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040955    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040958    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040960    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040963    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040965    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040968    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040972    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040977    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040981    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040984    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040987    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 21:50:40.390219 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040990    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040993    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040995    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.040998    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041000    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041003    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041005    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041008    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041010    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041013    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041015    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041018    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041020    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041024    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041026    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041029    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041031    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041034    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041036    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041039    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 21:50:40.390771 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041041    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041044    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041046    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041049    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041051    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041054    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041058    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041063    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041067    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041070    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041073    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041076    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041079    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041081    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041084    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041087    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041090    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041092    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041095    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 21:50:40.391388 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041097    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041100    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041103    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041106    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041108    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041110    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041113    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041116    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041118    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041121    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041123    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041126    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041130    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041132    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041135    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041137    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041139    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041142    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041145    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041147    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 21:50:40.392004 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041151    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041156    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041159    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041161    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041164    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041166    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041169    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041172    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041174    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041177    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041179    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041182    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041185    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041187    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041190    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041192    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041262    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041268    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041274    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041281    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041286    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 21:50:40.392609 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041289    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041293    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041298    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041301    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041304    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041307    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041311    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041314    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041317    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041320    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041323    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041328    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041332    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041337    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041340    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041343    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041346    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041349    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041353    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041368    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041372    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041376    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041379    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041382    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 21:50:40.393241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041385    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041389    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041392    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041396    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041399    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041402    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041405    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041408    2583 flags.go:64] FLAG: --enable-server="true"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041411    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041416    2583 flags.go:64] FLAG: --event-burst="100"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041419    2583 flags.go:64] FLAG: --event-qps="50"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041422    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041425    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041428    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041432    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041434    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041437    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041440    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041444    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041448    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041452    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041455    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041458    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041462    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041464    2583 flags.go:64] FLAG: --feature-gates=""
Jul 14 21:50:40.393996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041469    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041472    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041475    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041478    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041481    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041484    2583 flags.go:64] FLAG: --help="false"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041487    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-142-126.ec2.internal"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041490    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041493    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041496    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041499    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041502    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041505    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041508    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041510    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041513    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041516    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041520    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041523    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041526    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041528    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041531    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041534    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041537    2583 flags.go:64] FLAG: --lock-file=""
Jul 14 21:50:40.394801 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041540    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041542    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041547    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041555    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041558    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041561    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041564    2583 flags.go:64] FLAG: --logging-format="text"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041567    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041570    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041573    2583 flags.go:64] FLAG: --manifest-url=""
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041576    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041580    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041583    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041587    2583 flags.go:64] FLAG: --max-pods="110"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041590    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041593    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041596    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041599    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041602    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041605    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041608    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041615    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041618    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041621    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 21:50:40.395542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041624    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041628    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041633    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041636    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041639    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041642    2583 flags.go:64] FLAG: --port="10250"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041645    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041648    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0394c94a2abaa6115"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041651    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041654    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041658    2583 flags.go:64] FLAG: --register-node="true"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041661    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041666    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041669    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041672    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041675    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041679    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041683    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041686    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041688    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041692    2583 flags.go:64] FLAG: --runonce="false"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041695    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041698    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041701    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041704    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 21:50:40.396193 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041707    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041710    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041713    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041716    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041718    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041721    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041724    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041727    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041730    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041734    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041736    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041742    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041744    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041747    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041777    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041780    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041783    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041788    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041791    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041795    2583 flags.go:64] FLAG: --v="2"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041799    2583 flags.go:64] FLAG: --version="false"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041803    2583 flags.go:64] FLAG: --vmodule=""
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041808    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.041811    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 21:50:40.396901 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041952    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041958    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041962    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041965    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041969    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041972    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041975    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041977    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041980    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041983    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041986    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041989    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041992    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041995    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.041998    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042001    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042003    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042006    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042009    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 21:50:40.397524 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042011    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042014    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042016    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042019    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042021    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042024    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042028    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042030    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042034    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042037    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042040    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042042    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042045    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042049    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042052    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042055    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042058    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042061    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042063    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 21:50:40.398095 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042066    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042069    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042072    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042074    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042078    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042082    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042085    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042088    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042091    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042093    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042096    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042098    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042101    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042104    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042106    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042108    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042111    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042114    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042116    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 21:50:40.398927 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042120    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042123    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042126    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042129    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042131    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042134    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042136    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042139    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042141    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042144    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042146    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042149    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042152    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042154    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042157    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042159    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042162    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042164    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042167    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042169    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 21:50:40.399510 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042172    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042174    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042177    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042180    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042182    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042185    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042187    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042190    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042192    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042195    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042197    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042200    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042203    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042206    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042210    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042213    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042216    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042219    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042222    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042224    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 21:50:40.629692 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042227    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.042229    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.042235    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.049690    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.049708    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.049728    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.049737    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049811    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049818    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049822    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049841    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049847    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049850    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049853    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049856    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 21:50:40.630357 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049859    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049862    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049865    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049867    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049879    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049884    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049888    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049891    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049894    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049897    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049900    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049903    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049905    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049908    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049911    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049913    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049916    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049918    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049921    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 21:50:40.630780 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049923    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049926    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049929    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049932    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049934    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049937    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049940    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049943    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049945    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049949    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049953    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049956    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049958    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049961    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049964    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049966    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049969    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049972    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049980    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049983    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 21:50:40.631330 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049986    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049989    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049992    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049995    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.049997    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050000    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050002    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050005    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050007    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050010    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050012    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050015    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050017    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050019    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050022    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050024    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050027    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050030    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050032    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050035    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 21:50:40.631888 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050038    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050040    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050043    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050045    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050048    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050051    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050057    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050060    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050063    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050065    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050068    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050077    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050080    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050082    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050085    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050088    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050090    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050093    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050096    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050098    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 21:50:40.632435 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050101    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050103    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050105    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050108    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050110    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050113    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050115    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050118    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050120    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050123    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050125    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050128    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.050133    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050299    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050303    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 21:50:40.632982 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050307    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050309    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050312    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050315    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050321    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050323    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050326    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050328    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050331    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050339    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050342    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050345    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050348    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050352    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050355    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050358    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050362    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050365    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050368    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 21:50:40.633427 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050371    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050373    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050376    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050378    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050381    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050383    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050386    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050388    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050391    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050393    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050396    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050398    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050401    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050403    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050406    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050408    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050411    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050416    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050418    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050421    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 21:50:40.634246 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050423    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050426    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050428    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050437    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050440    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050442    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050445    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050447    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050450    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050453    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050455    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050458    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050460    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050463    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050465    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050468    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050470    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050473    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050476    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 21:50:40.635268 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050478    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050481    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050484    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050488    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050491    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050493    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050496    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050498    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050501    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050503    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050509    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050511    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050514    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050517    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050519    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050521    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050524    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050532    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050535    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 21:50:40.636086 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050537    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050540    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050543    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050545    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050548    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050551    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050553    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050555    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050558    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050566    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050569    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050571    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050574    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050576    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050578    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050581    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050584    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050586    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050589    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 21:50:40.636676 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:40.050591    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 21:50:40.637204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.050596    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 21:50:40.637204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.050729    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 21:50:40.637204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.053674    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 21:50:40.637204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.059580    2583 server.go:1019] "Starting client certificate rotation"
Jul 14 21:50:40.637204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.059692    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 21:50:40.637204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.059726    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 21:50:40.637204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.063765    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 21:50:40.637204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.067394    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 21:50:40.637204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.079898    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 14 21:50:40.637204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.082879    2583 log.go:25] "Validated CRI v1 image API"
Jul 14 21:50:40.637204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.083652    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 21:50:40.637204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.087405    2583 fs.go:135] Filesystem UUIDs: map[371ff5a1-3b87-4032-bc16-afbbc663a602:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 91ed5ac4-9905-4e4f-ae7e-9608af21246d:/dev/nvme0n1p4]
Jul 14 21:50:40.637606 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.087433    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 21:50:40.637680 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.094018    2583 manager.go:216] Machine: {Timestamp:2026-07-14 21:50:40.092247533 +0000 UTC m=+0.382249669 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100460 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24532c27a54774492656cbe7a538fc SystemUUID:ec24532c-27a5-4774-4926-56cbe7a538fc BootID:6a86302d-b4aa-4329-b788-4548ee4e9e93 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0f:0e:82:35:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0f:0e:82:35:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:9f:4a:0d:d5:17 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 21:50:40.637680 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.094128    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 21:50:40.637680 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.094221    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 21:50:40.637680 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.097156    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 21:50:40.637680 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.097378    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 21:50:40.637680 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.097405    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-126.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 21:50:40.637680 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.098216    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.098226    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.098238    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.098740    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.099822    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.104503    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.104616    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.104645    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.104659    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.104681    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.104718    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.104728    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.105263    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.105285    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.108625    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111004    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111119    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111641    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111661    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111671    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111681    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111693    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111703    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111861    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111870    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111905    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111921    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111935    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.111948    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.112819    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.112882    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.116418    2583 server.go:1268] "Started kubelet"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.116485    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.116511    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.116612    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.117561    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.119908    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.122293    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.123651    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-126.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 21:50:40.637996 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.123652    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.123765    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.123870    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-126.ec2.internal.18c2466de00bd142  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-126.ec2.internal,UID:ip-10-0-142-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-126.ec2.internal,},FirstTimestamp:2026-07-14 21:50:40.116388162 +0000 UTC m=+0.406390296,LastTimestamp:2026-07-14 21:50:40.116388162 +0000 UTC m=+0.406390296,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-126.ec2.internal,}"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.125427    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.125443    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.125597    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.126083    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.126099    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.126256    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.126266    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.126377    2583 factory.go:55] Registering systemd factory
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.126391    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.126474    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.126600    2583 factory.go:153] Registering CRI-O factory
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.126612    2583 factory.go:223] Registration of the crio container factory successfully
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.126666    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.126690    2583 factory.go:103] Registering Raw factory
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.126703    2583 manager.go:1196] Started watching for new ooms in manager
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.128401    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.128436    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.128465    2583 manager.go:349] Starting recovery of all containers
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.136095    2583 manager.go:354] Recovery completed
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.141443    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.142765    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7t8pl"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.143800    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.143857    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.143873    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.144529    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.144541    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.144560    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.144567    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:50:40.639006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.145312    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.145335    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.145346    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.145805    2583 policy_none.go:49] "None policy: Start"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.145820    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.145855    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.145824    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-126.ec2.internal.18c2466de1ae67de  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-126.ec2.internal,UID:ip-10-0-142-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-126.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-126.ec2.internal,},FirstTimestamp:2026-07-14 21:50:40.143820766 +0000 UTC m=+0.433822912,LastTimestamp:2026-07-14 21:50:40.143820766 +0000 UTC m=+0.433822912,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-126.ec2.internal,}"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.146873    2583 policy_none.go:47] "Start"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.150663    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7t8pl"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.198789    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.200025    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.200067    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.200089    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.200132    2583 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.202529    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.224046    2583 manager.go:337] "Starting Device Plugin manager"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.224079    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.224089    2583 server.go:87] "Starting device plugin registration server"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.224382    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.224397    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.224483    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.224569    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.224578    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.225119    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.225177    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-126.ec2.internal\" not found"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.300568    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal"]
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.300662    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.302288    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.302321    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.302336    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.303588    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.303758    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:40.639894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.303797    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.304353    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.304383    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.304399    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.304972    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.305002    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.305019    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.306206    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.306233    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.306910    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.306935    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.306944    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.325123    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.325933    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.325964    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.325979    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeHasSufficientPID"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.326008    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-126.ec2.internal"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.336616    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-126.ec2.internal\" not found" node="ip-10-0-142-126.ec2.internal"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.336916    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-126.ec2.internal"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.336931    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-126.ec2.internal\": node \"ip-10-0-142-126.ec2.internal\" not found"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.341182    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-126.ec2.internal\" not found" node="ip-10-0-142-126.ec2.internal"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.366085    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.427940    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0679c59103ee362599b21375dbd0b93a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-126.ec2.internal\" (UID: \"0679c59103ee362599b21375dbd0b93a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.427968    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e856a531b29482c4ea43eb88a22001bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"e856a531b29482c4ea43eb88a22001bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.427989    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e856a531b29482c4ea43eb88a22001bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"e856a531b29482c4ea43eb88a22001bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.467053    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found"
Jul 14 21:50:40.640809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.528422    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e856a531b29482c4ea43eb88a22001bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"e856a531b29482c4ea43eb88a22001bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:42.246357 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.528454    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e856a531b29482c4ea43eb88a22001bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"e856a531b29482c4ea43eb88a22001bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:42.246357 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.528476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0679c59103ee362599b21375dbd0b93a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-126.ec2.internal\" (UID: \"0679c59103ee362599b21375dbd0b93a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:42.246357 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.528540    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e856a531b29482c4ea43eb88a22001bd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"e856a531b29482c4ea43eb88a22001bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:42.246357 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.528540    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e856a531b29482c4ea43eb88a22001bd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal\" (UID: \"e856a531b29482c4ea43eb88a22001bd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:42.246357 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.528591    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0679c59103ee362599b21375dbd0b93a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-126.ec2.internal\" (UID: \"0679c59103ee362599b21375dbd0b93a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:42.246357 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.567673    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found"
Jul 14 21:50:42.246357 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.639621    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:42.246357 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:40.644349    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:42.246357 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.669327    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found"
Jul 14 21:50:42.246357 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:40.772888    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found"
Jul 14 21:50:42.477390 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:42.251580    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found"
Jul 14 21:50:42.477390 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.327775    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 21:50:42.477390 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:42.351968    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found"
Jul 14 21:50:42.477390 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.434416    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 21:50:42.477390 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.434564    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 21:50:42.477390 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.434583    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 21:50:42.477390 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:42.452703    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-126.ec2.internal\" not found"
Jul 14 21:50:42.664728 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.485825    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 21:50:42.664728 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.504591    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:42.664728 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.504592    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 21:50:42.664728 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.517597    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 21:50:42.664728 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.520728    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 21:50:42.664728 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.522703    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal"
Jul 14 21:50:42.664728 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.531853    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 21:45:41 +0000 UTC" deadline="2028-01-02 16:14:20.641140849 +0000 UTC"
Jul 14 21:50:42.664728 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.531879    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12882h23m38.109265369s"
Jul 14 21:50:42.664728 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.532906    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 21:50:42.664728 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.540910    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-882vl"
Jul 14 21:50:42.664728 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.550718    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-882vl"
Jul 14 21:50:42.900610 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:42.666800    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode856a531b29482c4ea43eb88a22001bd.slice/crio-d3704315c8e8737abeef3c122d1f25232db2b918b5e3c3974b67a6663b5ecf0e WatchSource:0}: Error finding container d3704315c8e8737abeef3c122d1f25232db2b918b5e3c3974b67a6663b5ecf0e: Status 404 returned error can't find the container with id d3704315c8e8737abeef3c122d1f25232db2b918b5e3c3974b67a6663b5ecf0e
Jul 14 21:50:42.900610 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:42.667073    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0679c59103ee362599b21375dbd0b93a.slice/crio-9ec3136e1101b310c55b0edbd35c0d7918f51a940343bd17381b8076bae1e30e WatchSource:0}: Error finding container 9ec3136e1101b310c55b0edbd35c0d7918f51a940343bd17381b8076bae1e30e: Status 404 returned error can't find the container with id 9ec3136e1101b310c55b0edbd35c0d7918f51a940343bd17381b8076bae1e30e
Jul 14 21:50:42.900610 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:42.672098    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 21:50:43.123335 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.106734    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 21:50:43.470625 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.431980    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 21:50:43.486334 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.483559    2583 apiserver.go:52] "Watching apiserver"
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.498379    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.498842    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-qh9ns","openshift-multus/multus-4swhd","openshift-multus/multus-additional-cni-plugins-hd2n4","openshift-image-registry/node-ca-4ctzt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal","openshift-multus/network-metrics-daemon-dnx2s","openshift-network-diagnostics/network-check-target-dqdq4","openshift-network-operator/iptables-alerter-nt879","openshift-ovn-kubernetes/ovnkube-node-mx67w","kube-system/global-pull-secret-syncer-4g2l8","kube-system/konnectivity-agent-jjhrt","kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww","openshift-cluster-node-tuning-operator/tuned-2hw88"]
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.500583    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:43.500667    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.501659    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.502894    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.504389    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.504400    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-58c7n\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.504655    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.506610    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.506617    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fstfb\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.506843    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.506957    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.507070    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.507082    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.507171    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.507398    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qh9ns"
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.508424    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nt879"
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.509690    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gdxrb\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.509870    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.510146    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4ctzt"
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.510148    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.510795    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.511822    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n6wxj\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.511891    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 21:50:43.570469 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.511913    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.512413    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.512909    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.513108    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:43.513191    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.513872    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.514357    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.514391    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n79fv\""
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515264    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:43.515329    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-systemd\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515463    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-run\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515486    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfjb8\" (UniqueName: \"kubernetes.io/projected/f2a9a89b-e8f4-4073-960f-51e3693744a2-kube-api-access-wfjb8\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515512    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-host\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515535    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-run-netns\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515556    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-run-ovn\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-run-ovn-kubernetes\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.572698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515615    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-cni-netd\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515666    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/471d7d22-f3fb-409a-9f56-076ce8317934-ovn-node-metrics-cert\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515688    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-tuned\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515732    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-kubelet\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515762    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-systemd-units\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515778    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-run-systemd\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515813    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/471d7d22-f3fb-409a-9f56-076ce8317934-ovnkube-config\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515836    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq5hv\" (UniqueName: \"kubernetes.io/projected/471d7d22-f3fb-409a-9f56-076ce8317934-kube-api-access-tq5hv\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515854    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce0c7cdb-5105-4e28-acc6-f4ce42c233ec-tmp-dir\") pod \"node-resolver-qh9ns\" (UID: \"ce0c7cdb-5105-4e28-acc6-f4ce42c233ec\") " pod="openshift-dns/node-resolver-qh9ns"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515878    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-slash\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515918    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-run-openvswitch\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.515969    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/471d7d22-f3fb-409a-9f56-076ce8317934-ovnkube-script-lib\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516017    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-sysconfig\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.573931 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516053    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-kubernetes\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516080    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-sys\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516105    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-etc-openvswitch\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-log-socket\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516189    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/471d7d22-f3fb-409a-9f56-076ce8317934-env-overrides\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516214    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-sysctl-d\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516239    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-sysctl-conf\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516261    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-lib-modules\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2a9a89b-e8f4-4073-960f-51e3693744a2-tmp\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516327    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-cni-bin\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516353    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mnwj\" (UniqueName: \"kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj\") pod \"network-check-target-dqdq4\" (UID: \"1032b119-d5ba-458f-94cf-784b5ed1e33f\") " pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516376    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-var-lib-kubelet\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516398    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-var-lib-openvswitch\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-node-log\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.575426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516441    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce0c7cdb-5105-4e28-acc6-f4ce42c233ec-hosts-file\") pod \"node-resolver-qh9ns\" (UID: \"ce0c7cdb-5105-4e28-acc6-f4ce42c233ec\") " pod="openshift-dns/node-resolver-qh9ns"
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516464    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mwkd\" (UniqueName: \"kubernetes.io/projected/ce0c7cdb-5105-4e28-acc6-f4ce42c233ec-kube-api-access-9mwkd\") pod \"node-resolver-qh9ns\" (UID: \"ce0c7cdb-5105-4e28-acc6-f4ce42c233ec\") " pod="openshift-dns/node-resolver-qh9ns"
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516488    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-modprobe-d\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516523    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516672    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jjhrt"
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.516523    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.517369    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.517668    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.517790    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mwdtm\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.517908    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.518369    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.519377    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zk6j6\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.519398    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.519614    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.519736    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.520541    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.520548    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.521095    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kq9lm\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.521396    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.522466    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6bdc7\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.522483    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.552750    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 21:45:42 +0000 UTC" deadline="2027-12-12 01:02:32.011161342 +0000 UTC"
Jul 14 21:50:43.576494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.552780    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12363h11m48.458386129s"
Jul 14 21:50:43.584476 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.583742    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" event={"ID":"e856a531b29482c4ea43eb88a22001bd","Type":"ContainerStarted","Data":"d3704315c8e8737abeef3c122d1f25232db2b918b5e3c3974b67a6663b5ecf0e"}
Jul 14 21:50:43.585584 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.584800    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" event={"ID":"0679c59103ee362599b21375dbd0b93a","Type":"ContainerStarted","Data":"9ec3136e1101b310c55b0edbd35c0d7918f51a940343bd17381b8076bae1e30e"}
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.605731    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617429    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617471    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-var-lib-kubelet\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-var-lib-openvswitch\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce0c7cdb-5105-4e28-acc6-f4ce42c233ec-hosts-file\") pod \"node-resolver-qh9ns\" (UID: \"ce0c7cdb-5105-4e28-acc6-f4ce42c233ec\") " pod="openshift-dns/node-resolver-qh9ns"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-system-cni-dir\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617574    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecbb0cab-8220-46af-97e1-0af94c7040ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617577    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-var-lib-kubelet\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617596    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-systemd\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617607    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-var-lib-openvswitch\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617641    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ce0c7cdb-5105-4e28-acc6-f4ce42c233ec-hosts-file\") pod \"node-resolver-qh9ns\" (UID: \"ce0c7cdb-5105-4e28-acc6-f4ce42c233ec\") " pod="openshift-dns/node-resolver-qh9ns"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617679    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-systemd\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617684    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-run\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfjb8\" (UniqueName: \"kubernetes.io/projected/f2a9a89b-e8f4-4073-960f-51e3693744a2-kube-api-access-wfjb8\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.699611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617754    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grgfp\" (UniqueName: \"kubernetes.io/projected/9e728bee-45ad-401c-a4e2-96307e102e2b-kube-api-access-grgfp\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617778    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb27746a-6dd7-46ad-b732-296937a92989-iptables-alerter-script\") pod \"iptables-alerter-nt879\" (UID: \"bb27746a-6dd7-46ad-b732-296937a92989\") " pod="openshift-network-operator/iptables-alerter-nt879"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-run\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617805    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617844    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5npz\" (UniqueName: \"kubernetes.io/projected/675d03c4-b4d9-4d6f-8114-fde0d6206464-kube-api-access-z5npz\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617879    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-multus-socket-dir-parent\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-run-netns\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617941    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-var-lib-cni-multus\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.617985    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e728bee-45ad-401c-a4e2-96307e102e2b-multus-daemon-config\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-run-netns\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618096    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/471d7d22-f3fb-409a-9f56-076ce8317934-ovn-node-metrics-cert\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618127    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-run-netns\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618142    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-var-lib-kubelet\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.701278 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618201    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618208    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecbb0cab-8220-46af-97e1-0af94c7040ca-cnibin\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618294    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecbb0cab-8220-46af-97e1-0af94c7040ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecbb0cab-8220-46af-97e1-0af94c7040ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-systemd-units\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618370    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-run-systemd\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618411    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-run-systemd\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618411    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-systemd-units\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618434    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/471d7d22-f3fb-409a-9f56-076ce8317934-ovnkube-config\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618458    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq5hv\" (UniqueName: \"kubernetes.io/projected/471d7d22-f3fb-409a-9f56-076ce8317934-kube-api-access-tq5hv\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618483    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-os-release\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618551    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c91692a9-5187-4ef7-ab60-702349a28c5b-serviceca\") pod \"node-ca-4ctzt\" (UID: \"c91692a9-5187-4ef7-ab60-702349a28c5b\") " pod="openshift-image-registry/node-ca-4ctzt"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618577    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-run-openvswitch\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618600    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618603    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecbb0cab-8220-46af-97e1-0af94c7040ca-os-release\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618691    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-run-openvswitch\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-etc-openvswitch\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618739    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-log-socket\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618763    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/471d7d22-f3fb-409a-9f56-076ce8317934-env-overrides\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618781    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-etc-openvswitch\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618802    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-run-k8s-cni-cncf-io\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618820    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-log-socket\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618830    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-multus-conf-dir\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7985261-d01a-4a06-9a47-7e92ce099f3f-konnectivity-ca\") pod \"konnectivity-agent-jjhrt\" (UID: \"d7985261-d01a-4a06-9a47-7e92ce099f3f\") " pod="kube-system/konnectivity-agent-jjhrt"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618877    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-sysctl-conf\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618902    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-lib-modules\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618924    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-cni-bin\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.702921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.618964    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-cnibin\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619007    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-468sl\" (UniqueName: \"kubernetes.io/projected/bb27746a-6dd7-46ad-b732-296937a92989-kube-api-access-468sl\") pod \"iptables-alerter-nt879\" (UID: \"bb27746a-6dd7-46ad-b732-296937a92989\") " pod="openshift-network-operator/iptables-alerter-nt879"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnwj\" (UniqueName: \"kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj\") pod \"network-check-target-dqdq4\" (UID: \"1032b119-d5ba-458f-94cf-784b5ed1e33f\") " pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619056    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-sysctl-conf\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619111    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-node-log\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-node-log\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619163    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/471d7d22-f3fb-409a-9f56-076ce8317934-ovnkube-config\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619184    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-lib-modules\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619199    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/471d7d22-f3fb-409a-9f56-076ce8317934-env-overrides\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mwkd\" (UniqueName: \"kubernetes.io/projected/ce0c7cdb-5105-4e28-acc6-f4ce42c233ec-kube-api-access-9mwkd\") pod \"node-resolver-qh9ns\" (UID: \"ce0c7cdb-5105-4e28-acc6-f4ce42c233ec\") " pod="openshift-dns/node-resolver-qh9ns"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619242    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-sys-fs\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e728bee-45ad-401c-a4e2-96307e102e2b-cni-binary-copy\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-modprobe-d\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619329    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-cni-bin\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.703734 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619369    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-device-dir\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619394    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-var-lib-cni-bin\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c91692a9-5187-4ef7-ab60-702349a28c5b-host\") pod \"node-ca-4ctzt\" (UID: \"c91692a9-5187-4ef7-ab60-702349a28c5b\") " pod="openshift-image-registry/node-ca-4ctzt"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619448    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzzkq\" (UniqueName: \"kubernetes.io/projected/c91692a9-5187-4ef7-ab60-702349a28c5b-kube-api-access-xzzkq\") pod \"node-ca-4ctzt\" (UID: \"c91692a9-5187-4ef7-ab60-702349a28c5b\") " pod="openshift-image-registry/node-ca-4ctzt"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619463    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-modprobe-d\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619471    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7985261-d01a-4a06-9a47-7e92ce099f3f-agent-certs\") pod \"konnectivity-agent-jjhrt\" (UID: \"d7985261-d01a-4a06-9a47-7e92ce099f3f\") " pod="kube-system/konnectivity-agent-jjhrt"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-etc-selinux\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-host\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619564    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-run-ovn\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-run-ovn-kubernetes\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619602    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-run-ovn\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619610    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-cni-netd\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619626    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-run-ovn-kubernetes\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619604    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-host\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.706761 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-registration-dir\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619651    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-cni-netd\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619679    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-run-multus-certs\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-tuned\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619741    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-kubelet\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce0c7cdb-5105-4e28-acc6-f4ce42c233ec-tmp-dir\") pod \"node-resolver-qh9ns\" (UID: \"ce0c7cdb-5105-4e28-acc6-f4ce42c233ec\") " pod="openshift-dns/node-resolver-qh9ns"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619789    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb27746a-6dd7-46ad-b732-296937a92989-host-slash\") pod \"iptables-alerter-nt879\" (UID: \"bb27746a-6dd7-46ad-b732-296937a92989\") " pod="openshift-network-operator/iptables-alerter-nt879"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-kubelet\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-slash\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619886    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/471d7d22-f3fb-409a-9f56-076ce8317934-ovnkube-script-lib\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-multus-cni-dir\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619916    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/471d7d22-f3fb-409a-9f56-076ce8317934-host-slash\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619945    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-etc-kubernetes\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.619971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-sysconfig\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620010    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-kubernetes\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.707620 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620033    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-sys\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j6km\" (UniqueName: \"kubernetes.io/projected/86a5bdce-880f-4d54-8676-2ad252e6cd32-kube-api-access-6j6km\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620083    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-hostroot\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620109    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-kubelet-config\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620135    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-dbus\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620140    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce0c7cdb-5105-4e28-acc6-f4ce42c233ec-tmp-dir\") pod \"node-resolver-qh9ns\" (UID: \"ce0c7cdb-5105-4e28-acc6-f4ce42c233ec\") " pod="openshift-dns/node-resolver-qh9ns"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620162    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-sysctl-d\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2a9a89b-e8f4-4073-960f-51e3693744a2-tmp\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620192    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-sysconfig\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620212    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-socket-dir\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620228    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-sys\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620237    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecbb0cab-8220-46af-97e1-0af94c7040ca-system-cni-dir\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620280    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-kubernetes\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620285    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecbb0cab-8220-46af-97e1-0af94c7040ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.709324 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9jtq\" (UniqueName: \"kubernetes.io/projected/ecbb0cab-8220-46af-97e1-0af94c7040ca-kube-api-access-h9jtq\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.710175 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620400    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/471d7d22-f3fb-409a-9f56-076ce8317934-ovnkube-script-lib\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.710175 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.620406    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-sysctl-d\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.710175 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.622203    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f2a9a89b-e8f4-4073-960f-51e3693744a2-etc-tuned\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.710175 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.622323    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/471d7d22-f3fb-409a-9f56-076ce8317934-ovn-node-metrics-cert\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.710175 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.622465    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2a9a89b-e8f4-4073-960f-51e3693744a2-tmp\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.710175 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:43.624568    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:50:43.710175 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:43.624583    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:50:43.710175 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:43.624594    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2mnwj for pod openshift-network-diagnostics/network-check-target-dqdq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:50:43.710175 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:43.624648    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj podName:1032b119-d5ba-458f-94cf-784b5ed1e33f nodeName:}" failed. No retries permitted until 2026-07-14 21:50:44.124634726 +0000 UTC m=+3.036474164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2mnwj" (UniqueName: "kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj") pod "network-check-target-dqdq4" (UID: "1032b119-d5ba-458f-94cf-784b5ed1e33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:50:43.710175 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.626630    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfjb8\" (UniqueName: \"kubernetes.io/projected/f2a9a89b-e8f4-4073-960f-51e3693744a2-kube-api-access-wfjb8\") pod \"tuned-2hw88\" (UID: \"f2a9a89b-e8f4-4073-960f-51e3693744a2\") " pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.710175 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.626669    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq5hv\" (UniqueName: \"kubernetes.io/projected/471d7d22-f3fb-409a-9f56-076ce8317934-kube-api-access-tq5hv\") pod \"ovnkube-node-mx67w\" (UID: \"471d7d22-f3fb-409a-9f56-076ce8317934\") " pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.710175 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.626811    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mwkd\" (UniqueName: \"kubernetes.io/projected/ce0c7cdb-5105-4e28-acc6-f4ce42c233ec-kube-api-access-9mwkd\") pod \"node-resolver-qh9ns\" (UID: \"ce0c7cdb-5105-4e28-acc6-f4ce42c233ec\") " pod="openshift-dns/node-resolver-qh9ns"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721597    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c91692a9-5187-4ef7-ab60-702349a28c5b-host\") pod \"node-ca-4ctzt\" (UID: \"c91692a9-5187-4ef7-ab60-702349a28c5b\") " pod="openshift-image-registry/node-ca-4ctzt"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzzkq\" (UniqueName: \"kubernetes.io/projected/c91692a9-5187-4ef7-ab60-702349a28c5b-kube-api-access-xzzkq\") pod \"node-ca-4ctzt\" (UID: \"c91692a9-5187-4ef7-ab60-702349a28c5b\") " pod="openshift-image-registry/node-ca-4ctzt"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7985261-d01a-4a06-9a47-7e92ce099f3f-agent-certs\") pod \"konnectivity-agent-jjhrt\" (UID: \"d7985261-d01a-4a06-9a47-7e92ce099f3f\") " pod="kube-system/konnectivity-agent-jjhrt"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721670    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-etc-selinux\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721703    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-registration-dir\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-run-multus-certs\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721747    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb27746a-6dd7-46ad-b732-296937a92989-host-slash\") pod \"iptables-alerter-nt879\" (UID: \"bb27746a-6dd7-46ad-b732-296937a92989\") " pod="openshift-network-operator/iptables-alerter-nt879"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-multus-cni-dir\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-etc-kubernetes\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721820    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j6km\" (UniqueName: \"kubernetes.io/projected/86a5bdce-880f-4d54-8676-2ad252e6cd32-kube-api-access-6j6km\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721841    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-hostroot\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-kubelet-config\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721877    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-dbus\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:43.729859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721896    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-socket-dir\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721920    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecbb0cab-8220-46af-97e1-0af94c7040ca-system-cni-dir\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721946    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecbb0cab-8220-46af-97e1-0af94c7040ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9jtq\" (UniqueName: \"kubernetes.io/projected/ecbb0cab-8220-46af-97e1-0af94c7040ca-kube-api-access-h9jtq\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722029    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-system-cni-dir\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722048    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecbb0cab-8220-46af-97e1-0af94c7040ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grgfp\" (UniqueName: \"kubernetes.io/projected/9e728bee-45ad-401c-a4e2-96307e102e2b-kube-api-access-grgfp\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722089    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb27746a-6dd7-46ad-b732-296937a92989-iptables-alerter-script\") pod \"iptables-alerter-nt879\" (UID: \"bb27746a-6dd7-46ad-b732-296937a92989\") " pod="openshift-network-operator/iptables-alerter-nt879"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722129    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5npz\" (UniqueName: \"kubernetes.io/projected/675d03c4-b4d9-4d6f-8114-fde0d6206464-kube-api-access-z5npz\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722148    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-multus-socket-dir-parent\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722168    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-run-netns\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722186    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-var-lib-cni-multus\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.733274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722205    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e728bee-45ad-401c-a4e2-96307e102e2b-multus-daemon-config\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722228    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-var-lib-kubelet\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722247    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecbb0cab-8220-46af-97e1-0af94c7040ca-cnibin\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecbb0cab-8220-46af-97e1-0af94c7040ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722287    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecbb0cab-8220-46af-97e1-0af94c7040ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722327    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722348    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-os-release\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c91692a9-5187-4ef7-ab60-702349a28c5b-serviceca\") pod \"node-ca-4ctzt\" (UID: \"c91692a9-5187-4ef7-ab60-702349a28c5b\") " pod="openshift-image-registry/node-ca-4ctzt"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722391    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecbb0cab-8220-46af-97e1-0af94c7040ca-os-release\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722418    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-run-k8s-cni-cncf-io\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-multus-conf-dir\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722461    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7985261-d01a-4a06-9a47-7e92ce099f3f-konnectivity-ca\") pod \"konnectivity-agent-jjhrt\" (UID: \"d7985261-d01a-4a06-9a47-7e92ce099f3f\") " pod="kube-system/konnectivity-agent-jjhrt"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722484    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-cnibin\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722517    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-468sl\" (UniqueName: \"kubernetes.io/projected/bb27746a-6dd7-46ad-b732-296937a92989-kube-api-access-468sl\") pod \"iptables-alerter-nt879\" (UID: \"bb27746a-6dd7-46ad-b732-296937a92989\") " pod="openshift-network-operator/iptables-alerter-nt879"
Jul 14 21:50:43.734318 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-sys-fs\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e728bee-45ad-401c-a4e2-96307e102e2b-cni-binary-copy\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-device-dir\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-var-lib-cni-bin\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722716    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-var-lib-cni-bin\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722816    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-etc-selinux\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722865    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-multus-socket-dir-parent\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722875    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-registration-dir\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722906    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-run-netns\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.722941    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-var-lib-cni-multus\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.723089    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-run-multus-certs\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.721720    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c91692a9-5187-4ef7-ab60-702349a28c5b-host\") pod \"node-ca-4ctzt\" (UID: \"c91692a9-5187-4ef7-ab60-702349a28c5b\") " pod="openshift-image-registry/node-ca-4ctzt"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.723137    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb27746a-6dd7-46ad-b732-296937a92989-host-slash\") pod \"iptables-alerter-nt879\" (UID: \"bb27746a-6dd7-46ad-b732-296937a92989\") " pod="openshift-network-operator/iptables-alerter-nt879"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.723296    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-var-lib-kubelet\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.723342    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecbb0cab-8220-46af-97e1-0af94c7040ca-cnibin\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.739229 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.723732    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-kubelet-config\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.723775    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-etc-kubernetes\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.723807    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ecbb0cab-8220-46af-97e1-0af94c7040ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.723852    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ecbb0cab-8220-46af-97e1-0af94c7040ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.723876    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d7985261-d01a-4a06-9a47-7e92ce099f3f-konnectivity-ca\") pod \"konnectivity-agent-jjhrt\" (UID: \"d7985261-d01a-4a06-9a47-7e92ce099f3f\") " pod="kube-system/konnectivity-agent-jjhrt"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.723884    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecbb0cab-8220-46af-97e1-0af94c7040ca-os-release\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724003    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-multus-conf-dir\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724029    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-system-cni-dir\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724040    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecbb0cab-8220-46af-97e1-0af94c7040ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724143    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-cnibin\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724261    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-dbus\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724281    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-multus-cni-dir\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724287    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9e728bee-45ad-401c-a4e2-96307e102e2b-multus-daemon-config\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724324    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-sys-fs\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724339    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-os-release\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.740190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724368    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecbb0cab-8220-46af-97e1-0af94c7040ca-system-cni-dir\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724403    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-device-dir\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724432    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-hostroot\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724458    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecbb0cab-8220-46af-97e1-0af94c7040ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:43.724526    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724553    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-socket-dir\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:43.724587    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs podName:675d03c4-b4d9-4d6f-8114-fde0d6206464 nodeName:}" failed. No retries permitted until 2026-07-14 21:50:44.224569789 +0000 UTC m=+3.136409244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs") pod "network-metrics-daemon-dnx2s" (UID: "675d03c4-b4d9-4d6f-8114-fde0d6206464") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724591    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9e728bee-45ad-401c-a4e2-96307e102e2b-host-run-k8s-cni-cncf-io\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724633    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/86a5bdce-880f-4d54-8676-2ad252e6cd32-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724789    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9e728bee-45ad-401c-a4e2-96307e102e2b-cni-binary-copy\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.724841    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb27746a-6dd7-46ad-b732-296937a92989-iptables-alerter-script\") pod \"iptables-alerter-nt879\" (UID: \"bb27746a-6dd7-46ad-b732-296937a92989\") " pod="openshift-network-operator/iptables-alerter-nt879"
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.725102    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c91692a9-5187-4ef7-ab60-702349a28c5b-serviceca\") pod \"node-ca-4ctzt\" (UID: \"c91692a9-5187-4ef7-ab60-702349a28c5b\") " pod="openshift-image-registry/node-ca-4ctzt"
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:43.725147    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:43.725201    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret podName:8b178bec-d3fb-425d-bf9b-e7a9c57d559e nodeName:}" failed. No retries permitted until 2026-07-14 21:50:44.22518476 +0000 UTC m=+3.137024203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret") pod "global-pull-secret-syncer-4g2l8" (UID: "8b178bec-d3fb-425d-bf9b-e7a9c57d559e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:50:43.743437 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.725328    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d7985261-d01a-4a06-9a47-7e92ce099f3f-agent-certs\") pod \"konnectivity-agent-jjhrt\" (UID: \"d7985261-d01a-4a06-9a47-7e92ce099f3f\") " pod="kube-system/konnectivity-agent-jjhrt"
Jul 14 21:50:43.745212 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.731696    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzzkq\" (UniqueName: \"kubernetes.io/projected/c91692a9-5187-4ef7-ab60-702349a28c5b-kube-api-access-xzzkq\") pod \"node-ca-4ctzt\" (UID: \"c91692a9-5187-4ef7-ab60-702349a28c5b\") " pod="openshift-image-registry/node-ca-4ctzt"
Jul 14 21:50:43.745212 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.732017    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9jtq\" (UniqueName: \"kubernetes.io/projected/ecbb0cab-8220-46af-97e1-0af94c7040ca-kube-api-access-h9jtq\") pod \"multus-additional-cni-plugins-hd2n4\" (UID: \"ecbb0cab-8220-46af-97e1-0af94c7040ca\") " pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.745212 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.732129    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j6km\" (UniqueName: \"kubernetes.io/projected/86a5bdce-880f-4d54-8676-2ad252e6cd32-kube-api-access-6j6km\") pod \"aws-ebs-csi-driver-node-fzsww\" (UID: \"86a5bdce-880f-4d54-8676-2ad252e6cd32\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.745212 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.733373    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5npz\" (UniqueName: \"kubernetes.io/projected/675d03c4-b4d9-4d6f-8114-fde0d6206464-kube-api-access-z5npz\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:43.745212 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.740150    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grgfp\" (UniqueName: \"kubernetes.io/projected/9e728bee-45ad-401c-a4e2-96307e102e2b-kube-api-access-grgfp\") pod \"multus-4swhd\" (UID: \"9e728bee-45ad-401c-a4e2-96307e102e2b\") " pod="openshift-multus/multus-4swhd"
Jul 14 21:50:43.745212 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.740216    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-468sl\" (UniqueName: \"kubernetes.io/projected/bb27746a-6dd7-46ad-b732-296937a92989-kube-api-access-468sl\") pod \"iptables-alerter-nt879\" (UID: \"bb27746a-6dd7-46ad-b732-296937a92989\") " pod="openshift-network-operator/iptables-alerter-nt879"
Jul 14 21:50:43.853723 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.814780    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hw88"
Jul 14 21:50:43.853723 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.823850    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:50:43.853723 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.831907    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qh9ns"
Jul 14 21:50:43.853723 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.839042    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nt879"
Jul 14 21:50:43.853723 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.848172    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4ctzt"
Jul 14 21:50:43.853723 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.853317    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hd2n4"
Jul 14 21:50:43.866521 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.863632    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jjhrt"
Jul 14 21:50:43.872868 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.871723    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww"
Jul 14 21:50:43.981883 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:43.881002    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4swhd"
Jul 14 21:50:44.217059 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.125178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnwj\" (UniqueName: \"kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj\") pod \"network-check-target-dqdq4\" (UID: \"1032b119-d5ba-458f-94cf-784b5ed1e33f\") " pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:44.217059 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:44.125344    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:50:44.217059 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:44.125364    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:50:44.217059 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:44.125374    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2mnwj for pod openshift-network-diagnostics/network-check-target-dqdq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:50:44.217059 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:44.125429    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj podName:1032b119-d5ba-458f-94cf-784b5ed1e33f nodeName:}" failed. No retries permitted until 2026-07-14 21:50:45.125415638 +0000 UTC m=+4.037255077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2mnwj" (UniqueName: "kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj") pod "network-check-target-dqdq4" (UID: "1032b119-d5ba-458f-94cf-784b5ed1e33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:50:44.226494 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.226468    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:44.226568 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.226505    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:44.226631 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:44.226618    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:50:44.226681 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:44.226672    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs podName:675d03c4-b4d9-4d6f-8114-fde0d6206464 nodeName:}" failed. No retries permitted until 2026-07-14 21:50:45.226658343 +0000 UTC m=+4.138497785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs") pod "network-metrics-daemon-dnx2s" (UID: "675d03c4-b4d9-4d6f-8114-fde0d6206464") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:50:44.226728 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:44.226619    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:50:44.226770 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:44.226758    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret podName:8b178bec-d3fb-425d-bf9b-e7a9c57d559e nodeName:}" failed. No retries permitted until 2026-07-14 21:50:45.226744653 +0000 UTC m=+4.138584091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret") pod "global-pull-secret-syncer-4g2l8" (UID: "8b178bec-d3fb-425d-bf9b-e7a9c57d559e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:50:44.268731 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.268701    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 21:50:44.312500 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:44.312468    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a9a89b_e8f4_4073_960f_51e3693744a2.slice/crio-10ca1a6cea331c8b1b582f12742c3f41f7ee0b27d7324647ce1c1fa94b038e47 WatchSource:0}: Error finding container 10ca1a6cea331c8b1b582f12742c3f41f7ee0b27d7324647ce1c1fa94b038e47: Status 404 returned error can't find the container with id 10ca1a6cea331c8b1b582f12742c3f41f7ee0b27d7324647ce1c1fa94b038e47
Jul 14 21:50:44.320904 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:44.320872    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91692a9_5187_4ef7_ab60_702349a28c5b.slice/crio-84b0decad11757e2837e4c7b5b050d52b34b55ee9ee430415fb872aa131e4b16 WatchSource:0}: Error finding container 84b0decad11757e2837e4c7b5b050d52b34b55ee9ee430415fb872aa131e4b16: Status 404 returned error can't find the container with id 84b0decad11757e2837e4c7b5b050d52b34b55ee9ee430415fb872aa131e4b16
Jul 14 21:50:44.323167 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:44.322379    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbb0cab_8220_46af_97e1_0af94c7040ca.slice/crio-d563abfef99e3683c32e1b385e705ff32485e6c2ec2e6de7dbff4893b3789a58 WatchSource:0}: Error finding container d563abfef99e3683c32e1b385e705ff32485e6c2ec2e6de7dbff4893b3789a58: Status 404 returned error can't find the container with id d563abfef99e3683c32e1b385e705ff32485e6c2ec2e6de7dbff4893b3789a58
Jul 14 21:50:44.328744 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:44.328717    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7985261_d01a_4a06_9a47_7e92ce099f3f.slice/crio-7a30ecfba477d77dfdcdf6b63e51aaa6a12ea98c934fdee465c83cafffdd9253 WatchSource:0}: Error finding container 7a30ecfba477d77dfdcdf6b63e51aaa6a12ea98c934fdee465c83cafffdd9253: Status 404 returned error can't find the container with id 7a30ecfba477d77dfdcdf6b63e51aaa6a12ea98c934fdee465c83cafffdd9253
Jul 14 21:50:44.330093 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:44.330071    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce0c7cdb_5105_4e28_acc6_f4ce42c233ec.slice/crio-3919c9754d2ed55e1b578b8112ab56db287e4639ab3ea3e9363afa4a5eef6903 WatchSource:0}: Error finding container 3919c9754d2ed55e1b578b8112ab56db287e4639ab3ea3e9363afa4a5eef6903: Status 404 returned error can't find the container with id 3919c9754d2ed55e1b578b8112ab56db287e4639ab3ea3e9363afa4a5eef6903
Jul 14 21:50:44.331903 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:44.330840    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e728bee_45ad_401c_a4e2_96307e102e2b.slice/crio-c89defa432c9f128ef11f35df7568b7172a9a99665f4ff95dd2315ed0731f3a6 WatchSource:0}: Error finding container c89defa432c9f128ef11f35df7568b7172a9a99665f4ff95dd2315ed0731f3a6: Status 404 returned error can't find the container with id c89defa432c9f128ef11f35df7568b7172a9a99665f4ff95dd2315ed0731f3a6
Jul 14 21:50:44.336832 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:44.335315    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471d7d22_f3fb_409a_9f56_076ce8317934.slice/crio-a4b53e3fa36be24bd06ab3be41d45e8ea4090726781255c06e4d5ac22ef2508b WatchSource:0}: Error finding container a4b53e3fa36be24bd06ab3be41d45e8ea4090726781255c06e4d5ac22ef2508b: Status 404 returned error can't find the container with id a4b53e3fa36be24bd06ab3be41d45e8ea4090726781255c06e4d5ac22ef2508b
Jul 14 21:50:44.553847 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.553728    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 21:45:42 +0000 UTC" deadline="2028-02-07 16:11:11.316958375 +0000 UTC"
Jul 14 21:50:44.553847 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.553783    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13746h20m26.763179334s"
Jul 14 21:50:44.587491 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.587439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4swhd" event={"ID":"9e728bee-45ad-401c-a4e2-96307e102e2b","Type":"ContainerStarted","Data":"c89defa432c9f128ef11f35df7568b7172a9a99665f4ff95dd2315ed0731f3a6"}
Jul 14 21:50:44.588762 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.588731    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qh9ns" event={"ID":"ce0c7cdb-5105-4e28-acc6-f4ce42c233ec","Type":"ContainerStarted","Data":"3919c9754d2ed55e1b578b8112ab56db287e4639ab3ea3e9363afa4a5eef6903"}
Jul 14 21:50:44.590019 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.589969    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4ctzt" event={"ID":"c91692a9-5187-4ef7-ab60-702349a28c5b","Type":"ContainerStarted","Data":"84b0decad11757e2837e4c7b5b050d52b34b55ee9ee430415fb872aa131e4b16"}
Jul 14 21:50:44.591391 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.591359    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hw88" event={"ID":"f2a9a89b-e8f4-4073-960f-51e3693744a2","Type":"ContainerStarted","Data":"10ca1a6cea331c8b1b582f12742c3f41f7ee0b27d7324647ce1c1fa94b038e47"}
Jul 14 21:50:44.592867 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.592846    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w" event={"ID":"471d7d22-f3fb-409a-9f56-076ce8317934","Type":"ContainerStarted","Data":"a4b53e3fa36be24bd06ab3be41d45e8ea4090726781255c06e4d5ac22ef2508b"}
Jul 14 21:50:44.594111 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.594076    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww" event={"ID":"86a5bdce-880f-4d54-8676-2ad252e6cd32","Type":"ContainerStarted","Data":"08d391de43873eac86190ce7fe0dd9e8a2e574f89335be431cd047292f87a983"}
Jul 14 21:50:44.595367 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.595343    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jjhrt" event={"ID":"d7985261-d01a-4a06-9a47-7e92ce099f3f","Type":"ContainerStarted","Data":"7a30ecfba477d77dfdcdf6b63e51aaa6a12ea98c934fdee465c83cafffdd9253"}
Jul 14 21:50:44.596588 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:44.596566    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd2n4" event={"ID":"ecbb0cab-8220-46af-97e1-0af94c7040ca","Type":"ContainerStarted","Data":"d563abfef99e3683c32e1b385e705ff32485e6c2ec2e6de7dbff4893b3789a58"}
Jul 14 21:50:44.662581 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:50:44.662542    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb27746a_6dd7_46ad_b732_296937a92989.slice/crio-96a2f29d710ca490b597aed390b90fec8c349bed9a17e08d56f0af21cfc4c4c4 WatchSource:0}: Error finding container 96a2f29d710ca490b597aed390b90fec8c349bed9a17e08d56f0af21cfc4c4c4: Status 404 returned error can't find the container with id 96a2f29d710ca490b597aed390b90fec8c349bed9a17e08d56f0af21cfc4c4c4
Jul 14 21:50:45.134259 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:45.133575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnwj\" (UniqueName: \"kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj\") pod \"network-check-target-dqdq4\" (UID: \"1032b119-d5ba-458f-94cf-784b5ed1e33f\") " pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:45.134259 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:45.133799    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:50:45.134259 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:45.133818    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:50:45.134259 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:45.133831    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2mnwj for pod openshift-network-diagnostics/network-check-target-dqdq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:50:45.134259 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:45.133891    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj podName:1032b119-d5ba-458f-94cf-784b5ed1e33f nodeName:}" failed. No retries permitted until 2026-07-14 21:50:47.133873572 +0000 UTC m=+6.045713014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2mnwj" (UniqueName: "kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj") pod "network-check-target-dqdq4" (UID: "1032b119-d5ba-458f-94cf-784b5ed1e33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:50:45.235005 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:45.234945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:45.235187 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:45.235024    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:45.235247 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:45.235208    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:50:45.235304 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:45.235276    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs podName:675d03c4-b4d9-4d6f-8114-fde0d6206464 nodeName:}" failed. No retries permitted until 2026-07-14 21:50:47.235255909 +0000 UTC m=+6.147095364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs") pod "network-metrics-daemon-dnx2s" (UID: "675d03c4-b4d9-4d6f-8114-fde0d6206464") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:50:45.235700 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:45.235680    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:50:45.235777 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:45.235742    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret podName:8b178bec-d3fb-425d-bf9b-e7a9c57d559e nodeName:}" failed. No retries permitted until 2026-07-14 21:50:47.235723027 +0000 UTC m=+6.147562536 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret") pod "global-pull-secret-syncer-4g2l8" (UID: "8b178bec-d3fb-425d-bf9b-e7a9c57d559e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:50:45.579378 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:45.579149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:45.579768 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:45.579346    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:45.579768 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:45.579496    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:50:45.579768 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:45.579557    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:50:45.579768 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:45.579618    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:45.579768 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:45.579679    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:50:45.603568 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:45.603535    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nt879" event={"ID":"bb27746a-6dd7-46ad-b732-296937a92989","Type":"ContainerStarted","Data":"96a2f29d710ca490b597aed390b90fec8c349bed9a17e08d56f0af21cfc4c4c4"}
Jul 14 21:50:46.620932 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:46.620847    2583 generic.go:356] "Generic (PLEG): container finished" podID="e856a531b29482c4ea43eb88a22001bd" containerID="33764bbd46a598858db1738a458f396b55bb96e89d6cc4f276c65c9952bdc2ba" exitCode=0
Jul 14 21:50:46.621386 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:46.620943    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" event={"ID":"e856a531b29482c4ea43eb88a22001bd","Type":"ContainerDied","Data":"33764bbd46a598858db1738a458f396b55bb96e89d6cc4f276c65c9952bdc2ba"}
Jul 14 21:50:46.646957 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:46.646920    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" event={"ID":"0679c59103ee362599b21375dbd0b93a","Type":"ContainerStarted","Data":"06102e1580fd7579f34af2fcdbeffbd79772cdfb693758287f1aab8fe345f41d"}
Jul 14 21:50:46.679051 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:46.676522    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-126.ec2.internal" podStartSLOduration=4.676499015 podStartE2EDuration="4.676499015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:50:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:50:46.667338386 +0000 UTC m=+5.579177873" watchObservedRunningTime="2026-07-14 21:50:46.676499015 +0000 UTC m=+5.588338477"
Jul 14 21:50:47.151437 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:47.151386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnwj\" (UniqueName: \"kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj\") pod \"network-check-target-dqdq4\" (UID: \"1032b119-d5ba-458f-94cf-784b5ed1e33f\") " pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:47.151671 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:47.151627    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:50:47.151671 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:47.151650    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:50:47.151671 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:47.151664    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2mnwj for pod openshift-network-diagnostics/network-check-target-dqdq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:50:47.151848 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:47.151724    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj podName:1032b119-d5ba-458f-94cf-784b5ed1e33f nodeName:}" failed. No retries permitted until 2026-07-14 21:50:51.151706007 +0000 UTC m=+10.063545461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2mnwj" (UniqueName: "kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj") pod "network-check-target-dqdq4" (UID: "1032b119-d5ba-458f-94cf-784b5ed1e33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:50:47.252579 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:47.252535    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:47.252755 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:47.252604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:47.252755 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:47.252735    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:50:47.252883 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:47.252804    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs podName:675d03c4-b4d9-4d6f-8114-fde0d6206464 nodeName:}" failed. No retries permitted until 2026-07-14 21:50:51.252783899 +0000 UTC m=+10.164623341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs") pod "network-metrics-daemon-dnx2s" (UID: "675d03c4-b4d9-4d6f-8114-fde0d6206464") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:50:47.254244 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:47.253225    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:50:47.254244 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:47.253284    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret podName:8b178bec-d3fb-425d-bf9b-e7a9c57d559e nodeName:}" failed. No retries permitted until 2026-07-14 21:50:51.253268985 +0000 UTC m=+10.165108427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret") pod "global-pull-secret-syncer-4g2l8" (UID: "8b178bec-d3fb-425d-bf9b-e7a9c57d559e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:50:47.579876 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:47.579122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:47.579876 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:47.579258    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:50:47.579876 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:47.579122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:47.579876 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:47.579365    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:50:47.579876 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:47.579122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:47.579876 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:47.579439    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:50:47.653203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:47.653120    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" event={"ID":"e856a531b29482c4ea43eb88a22001bd","Type":"ContainerStarted","Data":"d823c8031347763cf322f2263dd4bb6b10faa934df27cd5b8109419a166f9284"}
Jul 14 21:50:49.579312 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:49.579283    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:49.579740 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:49.579411    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:50:49.579818 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:49.579771    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:49.580003 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:49.579870    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:50:49.580003 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:49.579922    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:49.580135 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:49.580029    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:50:51.185600 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:51.184880    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnwj\" (UniqueName: \"kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj\") pod \"network-check-target-dqdq4\" (UID: \"1032b119-d5ba-458f-94cf-784b5ed1e33f\") " pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:51.185600 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:51.185094    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:50:51.185600 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:51.185118    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:50:51.185600 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:51.185133    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2mnwj for pod openshift-network-diagnostics/network-check-target-dqdq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:50:51.185600 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:51.185199    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj podName:1032b119-d5ba-458f-94cf-784b5ed1e33f nodeName:}" failed. No retries permitted until 2026-07-14 21:50:59.185177837 +0000 UTC m=+18.097017299 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2mnwj" (UniqueName: "kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj") pod "network-check-target-dqdq4" (UID: "1032b119-d5ba-458f-94cf-784b5ed1e33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:50:51.285927 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:51.285714    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:51.285927 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:51.285776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:51.285927 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:51.285906    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:50:51.286222 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:51.285977    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret podName:8b178bec-d3fb-425d-bf9b-e7a9c57d559e nodeName:}" failed. No retries permitted until 2026-07-14 21:50:59.28595791 +0000 UTC m=+18.197797353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret") pod "global-pull-secret-syncer-4g2l8" (UID: "8b178bec-d3fb-425d-bf9b-e7a9c57d559e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:50:51.286222 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:51.285906    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:50:51.286222 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:51.286097    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs podName:675d03c4-b4d9-4d6f-8114-fde0d6206464 nodeName:}" failed. No retries permitted until 2026-07-14 21:50:59.286072778 +0000 UTC m=+18.197912221 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs") pod "network-metrics-daemon-dnx2s" (UID: "675d03c4-b4d9-4d6f-8114-fde0d6206464") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:50:51.584405 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:51.584331    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:51.584555 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:51.584505    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:50:51.584963 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:51.584931    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:51.585114 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:51.585089    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:50:51.585179 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:51.585086    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:51.585229 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:51.585211    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:50:53.578866 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:53.578830    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:53.579447 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:53.578966    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:50:53.579447 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:53.579365    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:53.579585 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:53.579450    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:50:53.579585 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:53.579500    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:53.579675 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:53.579581    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:50:55.579434 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:55.579404    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:55.579885 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:55.579404    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:55.579885 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:55.579525    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:50:55.579885 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:55.579404    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:55.579885 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:55.579630    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:50:55.579885 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:55.579736    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:50:57.579337 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:57.579294    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:57.579790 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:57.579294    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:57.579790 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:57.579446    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:50:57.579790 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:57.579501    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:57.579790 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:57.579629    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:50:57.579790 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:57.579719    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:50:59.252787 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:59.252748    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnwj\" (UniqueName: \"kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj\") pod \"network-check-target-dqdq4\" (UID: \"1032b119-d5ba-458f-94cf-784b5ed1e33f\") " pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:59.253266 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:59.252922    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:50:59.253266 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:59.252948    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:50:59.253266 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:59.252962    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2mnwj for pod openshift-network-diagnostics/network-check-target-dqdq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:50:59.253266 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:59.253039    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj podName:1032b119-d5ba-458f-94cf-784b5ed1e33f nodeName:}" failed. No retries permitted until 2026-07-14 21:51:15.253019892 +0000 UTC m=+34.164859334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2mnwj" (UniqueName: "kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj") pod "network-check-target-dqdq4" (UID: "1032b119-d5ba-458f-94cf-784b5ed1e33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:50:59.353571 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:59.353486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:59.353571 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:59.353524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:59.353799 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:59.353614    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:50:59.353799 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:59.353680    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret podName:8b178bec-d3fb-425d-bf9b-e7a9c57d559e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:15.353660934 +0000 UTC m=+34.265500389 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret") pod "global-pull-secret-syncer-4g2l8" (UID: "8b178bec-d3fb-425d-bf9b-e7a9c57d559e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:50:59.353799 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:59.353618    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:50:59.353799 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:59.353729    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs podName:675d03c4-b4d9-4d6f-8114-fde0d6206464 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:15.353719199 +0000 UTC m=+34.265558642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs") pod "network-metrics-daemon-dnx2s" (UID: "675d03c4-b4d9-4d6f-8114-fde0d6206464") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:50:59.579368 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:59.579327    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:50:59.579368 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:59.579351    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:50:59.579572 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:50:59.579327    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:50:59.579572 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:59.579451    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:50:59.579572 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:59.579541    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:50:59.579790 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:50:59.579633    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:51:01.579400 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:01.579350    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:51:01.579852 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:01.579447    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:51:01.579852 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:01.579458    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:51:01.579852 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:01.579555    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:51:01.579852 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:01.579600    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:01.579852 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:01.579649    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:51:03.581597 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:03.581568    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:51:03.581973 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:03.581677    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:51:03.581973 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:03.581688    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:51:03.581973 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:03.581708    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:03.581973 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:03.581794    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:51:03.581973 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:03.581861    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:51:04.690475 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.690176    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4swhd" event={"ID":"9e728bee-45ad-401c-a4e2-96307e102e2b","Type":"ContainerStarted","Data":"6dc5ba95f5bf0e51b226854975d06d40e3c4ddd350a13088cd84a4eca782b7ed"}
Jul 14 21:51:04.691689 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.691667    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qh9ns" event={"ID":"ce0c7cdb-5105-4e28-acc6-f4ce42c233ec","Type":"ContainerStarted","Data":"cdbc51781b9ce73ecf2d15f873265e9ce3420b62d1e2189a1063ab3816ca5c10"}
Jul 14 21:51:04.693044 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.693019    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4ctzt" event={"ID":"c91692a9-5187-4ef7-ab60-702349a28c5b","Type":"ContainerStarted","Data":"a59c4458e09e3f2aa4a7cd77d1e4d98cecf81441da3e4288da36df198b9f2f75"}
Jul 14 21:51:04.694394 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.694366    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hw88" event={"ID":"f2a9a89b-e8f4-4073-960f-51e3693744a2","Type":"ContainerStarted","Data":"f48c755e6d7bd7fe6e924207e9ff520af9cdc09212006a32f42a392cbb121dad"}
Jul 14 21:51:04.697156 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.697138    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 21:51:04.697455 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.697436    2583 generic.go:356] "Generic (PLEG): container finished" podID="471d7d22-f3fb-409a-9f56-076ce8317934" containerID="3d12ce57678857dd144d403f2b3135f3fec734c665eac7d92a09933b9faf5f42" exitCode=1
Jul 14 21:51:04.697523 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.697506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w" event={"ID":"471d7d22-f3fb-409a-9f56-076ce8317934","Type":"ContainerStarted","Data":"0b96779765ca7007a2c645a4bd91838c9f37f52e009e1c1a1dec661b9bbb3b0d"}
Jul 14 21:51:04.697575 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.697560    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w" event={"ID":"471d7d22-f3fb-409a-9f56-076ce8317934","Type":"ContainerStarted","Data":"dd42b1ae4182fddb1dbde7b065156f011e6784187a701108ae5bff22e6152c63"}
Jul 14 21:51:04.697670 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.697599    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w" event={"ID":"471d7d22-f3fb-409a-9f56-076ce8317934","Type":"ContainerStarted","Data":"ef6baa3d202987358a6cb826407d4dc122e07a5879f1384612b5c97575796850"}
Jul 14 21:51:04.697670 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.697644    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w" event={"ID":"471d7d22-f3fb-409a-9f56-076ce8317934","Type":"ContainerStarted","Data":"5ade3a411bd7752685adb0cf4faece72b8780f0f99ddf78a3a208670cf9cba46"}
Jul 14 21:51:04.697766 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.697672    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w" event={"ID":"471d7d22-f3fb-409a-9f56-076ce8317934","Type":"ContainerDied","Data":"3d12ce57678857dd144d403f2b3135f3fec734c665eac7d92a09933b9faf5f42"}
Jul 14 21:51:04.697766 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.697701    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w" event={"ID":"471d7d22-f3fb-409a-9f56-076ce8317934","Type":"ContainerStarted","Data":"c7e1aa53cd12db8c306072e16ebac81dc80a1a48d7b41f4c7212a0b1497c0d4f"}
Jul 14 21:51:04.698765 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.698747    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww" event={"ID":"86a5bdce-880f-4d54-8676-2ad252e6cd32","Type":"ContainerStarted","Data":"4b8ec5ef763472c530233866d8f0d5e030b08ec63c375516a0155bc8d5852074"}
Jul 14 21:51:04.699973 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.699955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jjhrt" event={"ID":"d7985261-d01a-4a06-9a47-7e92ce099f3f","Type":"ContainerStarted","Data":"081173e3d78d90bdf0f0295a9feea5a2d76c86664ed01e7024c291e28a8b2dae"}
Jul 14 21:51:04.701315 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.701295    2583 generic.go:356] "Generic (PLEG): container finished" podID="ecbb0cab-8220-46af-97e1-0af94c7040ca" containerID="7d7413ecf3654411e496628245cb85ddb94893c80d3aee728a54b83022e88dbb" exitCode=0
Jul 14 21:51:04.701386 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.701323    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd2n4" event={"ID":"ecbb0cab-8220-46af-97e1-0af94c7040ca","Type":"ContainerDied","Data":"7d7413ecf3654411e496628245cb85ddb94893c80d3aee728a54b83022e88dbb"}
Jul 14 21:51:04.711569 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.711520    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4swhd" podStartSLOduration=3.405461929 podStartE2EDuration="22.711503805s" totalImagesPullingTime="19.306041876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:51:04.711344941 +0000 UTC m=+23.623184420" watchObservedRunningTime="2026-07-14 21:51:04.711503805 +0000 UTC m=+23.623343270"
Jul 14 21:51:04.711730 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.711711    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-126.ec2.internal" podStartSLOduration=22.711706613 podStartE2EDuration="22.711706613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:50:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:50:47.670212976 +0000 UTC m=+6.582052457" watchObservedRunningTime="2026-07-14 21:51:04.711706613 +0000 UTC m=+23.623546074"
Jul 14 21:51:04.729117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.729068    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4ctzt" podStartSLOduration=3.450726573 podStartE2EDuration="22.729052409s" totalImagesPullingTime="19.278325836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:51:04.728847649 +0000 UTC m=+23.640687128" watchObservedRunningTime="2026-07-14 21:51:04.729052409 +0000 UTC m=+23.640891869"
Jul 14 21:51:04.780349 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.780291    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jjhrt" podStartSLOduration=3.496871751 podStartE2EDuration="22.780275121s" totalImagesPullingTime="19.28340337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:51:04.779803092 +0000 UTC m=+23.691642547" watchObservedRunningTime="2026-07-14 21:51:04.780275121 +0000 UTC m=+23.692114944"
Jul 14 21:51:04.808900 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:04.808850    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2hw88" podStartSLOduration=4.508876548 podStartE2EDuration="23.808834098s" totalImagesPullingTime="19.29995755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:51:04.808283058 +0000 UTC m=+23.720122518" watchObservedRunningTime="2026-07-14 21:51:04.808834098 +0000 UTC m=+23.720673559"
Jul 14 21:51:05.012253 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:05.012222    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 21:51:05.579348 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:05.579308    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:05.579649 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:05.579441    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:51:05.579649 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:05.579468    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:51:05.579649 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:05.579580    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:51:05.579817 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:05.579653    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:51:05.579817 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:05.579729    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:51:05.616301 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:05.616096    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T21:51:05.012245695Z","UUID":"30b3aa30-fb4f-4492-9318-27819fbe9015","Handler":null,"Name":"","Endpoint":""}
Jul 14 21:51:05.618061 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:05.618037    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 21:51:05.618203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:05.618081    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 21:51:05.706388 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:05.705982    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nt879" event={"ID":"bb27746a-6dd7-46ad-b732-296937a92989","Type":"ContainerStarted","Data":"843403b7663ff0d83939c076bf6db1dca10618e52524fd58aee5141d5b78201a"}
Jul 14 21:51:05.708018 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:05.707976    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww" event={"ID":"86a5bdce-880f-4d54-8676-2ad252e6cd32","Type":"ContainerStarted","Data":"e6c0dd097c5b43ebaf0d384ed3ebf8b30adb877d98d6543ad30e7d4077c0405b"}
Jul 14 21:51:05.722878 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:05.722831    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qh9ns" podStartSLOduration=10.009655887 podStartE2EDuration="24.72281139s" totalImagesPullingTime="14.713155503s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:51:04.849172967 +0000 UTC m=+23.761012428" watchObservedRunningTime="2026-07-14 21:51:05.72281139 +0000 UTC m=+24.634650851"
Jul 14 21:51:05.723294 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:05.723247    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nt879" podStartSLOduration=10.342383772 podStartE2EDuration="24.723237573s" totalImagesPullingTime="14.380853801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:51:05.722673222 +0000 UTC m=+24.634512683" watchObservedRunningTime="2026-07-14 21:51:05.723237573 +0000 UTC m=+24.635077033"
Jul 14 21:51:06.714769 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:06.714534    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 21:51:06.715289 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:06.715218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w" event={"ID":"471d7d22-f3fb-409a-9f56-076ce8317934","Type":"ContainerStarted","Data":"407fd420c8717301cdcd6591a118884b52797b8bed2b540c1fd4822e85d89cdd"}
Jul 14 21:51:06.717565 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:06.717537    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww" event={"ID":"86a5bdce-880f-4d54-8676-2ad252e6cd32","Type":"ContainerStarted","Data":"d5968676de3b12a511342c54139d852e24e1b7640397db065bed3b86c2256e69"}
Jul 14 21:51:06.765599 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:06.765538    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fzsww" podStartSLOduration=3.3406561630000002 podStartE2EDuration="24.765519568s" totalImagesPullingTime="21.424863405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:50:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:51:06.765144665 +0000 UTC m=+25.676984126" watchObservedRunningTime="2026-07-14 21:51:06.765519568 +0000 UTC m=+25.677359029"
Jul 14 21:51:06.948030 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:06.947979    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jjhrt"
Jul 14 21:51:06.948638 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:06.948614    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jjhrt"
Jul 14 21:51:07.582628 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:07.582601    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:51:07.582831 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:07.582706    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:51:07.582831 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:07.582723    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:51:07.582831 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:07.582753    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:07.582986 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:07.582842    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:51:07.582986 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:07.582918    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:51:07.721076 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:07.721039    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jjhrt"
Jul 14 21:51:07.721586 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:07.721450    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jjhrt"
Jul 14 21:51:09.578584 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:09.578549    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:51:09.579298 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:09.578549    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:09.579298 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:09.578666    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:51:09.579298 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:09.578556    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:51:09.579298 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:09.578741    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:51:09.579298 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:09.578837    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:51:09.727091 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:09.727054    2583 generic.go:356] "Generic (PLEG): container finished" podID="ecbb0cab-8220-46af-97e1-0af94c7040ca" containerID="d8d42499ad7f50cdd3a679833988eac7f78f2088b99aed613527626bb71f81bb" exitCode=0
Jul 14 21:51:09.727274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:09.727145    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd2n4" event={"ID":"ecbb0cab-8220-46af-97e1-0af94c7040ca","Type":"ContainerDied","Data":"d8d42499ad7f50cdd3a679833988eac7f78f2088b99aed613527626bb71f81bb"}
Jul 14 21:51:09.734747 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:09.734727    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 21:51:09.735119 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:09.735097    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w" event={"ID":"471d7d22-f3fb-409a-9f56-076ce8317934","Type":"ContainerStarted","Data":"bf72ae3fe2703b8828b31870b46de562754c84db07077639f635ab89fa3388c7"}
Jul 14 21:51:09.735531 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:09.735515    2583 scope.go:117] "RemoveContainer" containerID="3d12ce57678857dd144d403f2b3135f3fec734c665eac7d92a09933b9faf5f42"
Jul 14 21:51:10.741279 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.741252    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 21:51:10.741736 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.741566    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w" event={"ID":"471d7d22-f3fb-409a-9f56-076ce8317934","Type":"ContainerStarted","Data":"36d9be3af0a60880c4298aeb387c16a95e7a4d8d363a778a96776003d2c9683b"}
Jul 14 21:51:10.741796 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.741761    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:51:10.741902 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.741887    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:51:10.742012 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.741968    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:51:10.758017 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.757978    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:51:10.763538 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.763503    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:51:10.782349 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.782303    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w" podStartSLOduration=10.261184769 podStartE2EDuration="29.782287493s" totalImagesPullingTime="19.521102724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:51:10.781865957 +0000 UTC m=+29.693705418" watchObservedRunningTime="2026-07-14 21:51:10.782287493 +0000 UTC m=+29.694126953"
Jul 14 21:51:10.949890 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.949708    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dnx2s"]
Jul 14 21:51:10.950069 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.949976    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:51:10.950126 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:10.950084    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:51:10.951962 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.951938    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqdq4"]
Jul 14 21:51:10.952125 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.952043    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:10.952177 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:10.952126    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:51:10.954675 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.954645    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4g2l8"]
Jul 14 21:51:10.954777 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:10.954752    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:51:10.954866 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:10.954847    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:51:11.745625 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:11.745586    2583 generic.go:356] "Generic (PLEG): container finished" podID="ecbb0cab-8220-46af-97e1-0af94c7040ca" containerID="b8857826c03b0991170ba74c659f11863603c1ee6edbca2e7c078af6ecc49b2d" exitCode=0
Jul 14 21:51:11.746029 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:11.745664    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd2n4" event={"ID":"ecbb0cab-8220-46af-97e1-0af94c7040ca","Type":"ContainerDied","Data":"b8857826c03b0991170ba74c659f11863603c1ee6edbca2e7c078af6ecc49b2d"}
Jul 14 21:51:12.578836 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:12.578801    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:51:12.579038 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:12.578845    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:12.579038 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:12.578919    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:51:12.579038 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:12.578934    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:51:12.579038 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:12.578984    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:51:12.579265 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:12.579121    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:51:13.752540 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:13.752503    2583 generic.go:356] "Generic (PLEG): container finished" podID="ecbb0cab-8220-46af-97e1-0af94c7040ca" containerID="0b46cac96a9d5d1e1e6fc26e747010d175e89d6f6998e6a637de91153ee3d2d6" exitCode=0
Jul 14 21:51:13.753165 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:13.752572    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd2n4" event={"ID":"ecbb0cab-8220-46af-97e1-0af94c7040ca","Type":"ContainerDied","Data":"0b46cac96a9d5d1e1e6fc26e747010d175e89d6f6998e6a637de91153ee3d2d6"}
Jul 14 21:51:14.579368 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:14.579326    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:51:14.579368 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:14.579361    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:14.579626 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:14.579468    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4g2l8" podUID="8b178bec-d3fb-425d-bf9b-e7a9c57d559e"
Jul 14 21:51:14.579626 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:14.579525    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:51:14.579626 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:14.579599    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqdq4" podUID="1032b119-d5ba-458f-94cf-784b5ed1e33f"
Jul 14 21:51:14.579772 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:14.579675    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dnx2s" podUID="675d03c4-b4d9-4d6f-8114-fde0d6206464"
Jul 14 21:51:15.265293 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:15.265230    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnwj\" (UniqueName: \"kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj\") pod \"network-check-target-dqdq4\" (UID: \"1032b119-d5ba-458f-94cf-784b5ed1e33f\") " pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:15.265759 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:15.265413    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 21:51:15.265759 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:15.265440    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 21:51:15.265759 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:15.265456    2583 projected.go:196] Error preparing data for projected volume kube-api-access-2mnwj for pod openshift-network-diagnostics/network-check-target-dqdq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:51:15.265759 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:15.265516    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj podName:1032b119-d5ba-458f-94cf-784b5ed1e33f nodeName:}" failed. No retries permitted until 2026-07-14 21:51:47.265496566 +0000 UTC m=+66.177336006 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2mnwj" (UniqueName: "kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj") pod "network-check-target-dqdq4" (UID: "1032b119-d5ba-458f-94cf-784b5ed1e33f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 21:51:15.366087 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:15.366048    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:51:15.366323 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:15.366099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:51:15.366323 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:15.366213    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 21:51:15.366323 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:15.366290    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret podName:8b178bec-d3fb-425d-bf9b-e7a9c57d559e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:47.36626851 +0000 UTC m=+66.278107951 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret") pod "global-pull-secret-syncer-4g2l8" (UID: "8b178bec-d3fb-425d-bf9b-e7a9c57d559e") : object "kube-system"/"original-pull-secret" not registered
Jul 14 21:51:15.366323 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:15.366222    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:51:15.366542 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:15.366386    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs podName:675d03c4-b4d9-4d6f-8114-fde0d6206464 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:47.366362806 +0000 UTC m=+66.278202251 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs") pod "network-metrics-daemon-dnx2s" (UID: "675d03c4-b4d9-4d6f-8114-fde0d6206464") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 21:51:16.431788 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.431531    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-126.ec2.internal" event="NodeReady"
Jul 14 21:51:16.432270 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.431841    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 21:51:16.484433 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.484397    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64b9d68f48-zldd6"]
Jul 14 21:51:16.487833 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.487812    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.491267 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.491235    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 14 21:51:16.491398 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.491241    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dhwt6\""
Jul 14 21:51:16.491523 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.491505    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 14 21:51:16.491716 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.491695    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 14 21:51:16.501525 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.501448    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 14 21:51:16.502972 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.502760    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b9d68f48-zldd6"]
Jul 14 21:51:16.504630 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.504610    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d44xw"]
Jul 14 21:51:16.507255 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.507234    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:16.509705 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.509684    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t9b2c"]
Jul 14 21:51:16.510740 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.510713    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2wg9m\""
Jul 14 21:51:16.510849 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.510731    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 21:51:16.510917 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.510854    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 21:51:16.512852 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.512834    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t9b2c"
Jul 14 21:51:16.516195 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.516168    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 21:51:16.516289 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.516168    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 21:51:16.516708 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.516435    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f67q8\""
Jul 14 21:51:16.516708 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.516492    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 21:51:16.527203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.527183    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d44xw"]
Jul 14 21:51:16.527844 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.527824    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t9b2c"]
Jul 14 21:51:16.574009 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.573964    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-bound-sa-token\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.574188 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.574018    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b54191fc-df69-4163-982d-4d527c25655e-config-volume\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:16.574188 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.574065    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd908e82-8390-4555-9096-adbe328eddb9-image-registry-private-configuration\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.574188 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.574098    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd908e82-8390-4555-9096-adbe328eddb9-registry-certificates\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.574188 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.574166    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:16.574402 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.574216    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b54191fc-df69-4163-982d-4d527c25655e-tmp-dir\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:16.574402 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.574258    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxlxw\" (UniqueName: \"kubernetes.io/projected/b54191fc-df69-4163-982d-4d527c25655e-kube-api-access-dxlxw\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:16.574402 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.574287    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2sdj\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-kube-api-access-w2sdj\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.574402 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.574323    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.574402 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.574372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd908e82-8390-4555-9096-adbe328eddb9-ca-trust-extracted\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.574402 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.574395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd908e82-8390-4555-9096-adbe328eddb9-trusted-ca\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.574687 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.574411    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd908e82-8390-4555-9096-adbe328eddb9-installation-pull-secrets\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.578842 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.578818    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:51:16.579089 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.578877    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:51:16.579195 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.578883    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:16.583204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.582904    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r4xkn\""
Jul 14 21:51:16.583204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.583018    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l5sfp\""
Jul 14 21:51:16.583204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.583033    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 21:51:16.583204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.583115    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 21:51:16.583204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.583150    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 21:51:16.583468 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.583262    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 21:51:16.675386 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675357    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b54191fc-df69-4163-982d-4d527c25655e-config-volume\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:16.675561 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675401    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd908e82-8390-4555-9096-adbe328eddb9-image-registry-private-configuration\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.675561 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd908e82-8390-4555-9096-adbe328eddb9-registry-certificates\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.675561 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675474    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:16.675561 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675503    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b54191fc-df69-4163-982d-4d527c25655e-tmp-dir\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:16.675561 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxlxw\" (UniqueName: \"kubernetes.io/projected/b54191fc-df69-4163-982d-4d527c25655e-kube-api-access-dxlxw\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:16.675561 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675560    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2sdj\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-kube-api-access-w2sdj\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.675820 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.675820 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675670    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd908e82-8390-4555-9096-adbe328eddb9-ca-trust-extracted\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.675820 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675694    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd908e82-8390-4555-9096-adbe328eddb9-trusted-ca\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.675820 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd908e82-8390-4555-9096-adbe328eddb9-installation-pull-secrets\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.675820 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675775    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzzct\" (UniqueName: \"kubernetes.io/projected/cfcb488d-3e32-4a99-a49a-f6e76c404001-kube-api-access-dzzct\") pod \"ingress-canary-t9b2c\" (UID: \"cfcb488d-3e32-4a99-a49a-f6e76c404001\") " pod="openshift-ingress-canary/ingress-canary-t9b2c"
Jul 14 21:51:16.675820 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-bound-sa-token\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.676134 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.675827    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfcb488d-3e32-4a99-a49a-f6e76c404001-cert\") pod \"ingress-canary-t9b2c\" (UID: \"cfcb488d-3e32-4a99-a49a-f6e76c404001\") " pod="openshift-ingress-canary/ingress-canary-t9b2c"
Jul 14 21:51:16.676134 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:16.676050    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 21:51:16.676134 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:16.676066    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b9d68f48-zldd6: secret "image-registry-tls" not found
Jul 14 21:51:16.676134 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.676081    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b54191fc-df69-4163-982d-4d527c25655e-config-volume\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:16.676134 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:16.676116    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls podName:fd908e82-8390-4555-9096-adbe328eddb9 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:17.176098108 +0000 UTC m=+36.087937561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls") pod "image-registry-64b9d68f48-zldd6" (UID: "fd908e82-8390-4555-9096-adbe328eddb9") : secret "image-registry-tls" not found
Jul 14 21:51:16.676378 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.676151    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd908e82-8390-4555-9096-adbe328eddb9-ca-trust-extracted\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.676378 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.676167    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd908e82-8390-4555-9096-adbe328eddb9-registry-certificates\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.676378 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:16.676234    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 21:51:16.676378 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:16.676287    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls podName:b54191fc-df69-4163-982d-4d527c25655e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:17.176272101 +0000 UTC m=+36.088111551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls") pod "dns-default-d44xw" (UID: "b54191fc-df69-4163-982d-4d527c25655e") : secret "dns-default-metrics-tls" not found
Jul 14 21:51:16.676378 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.676346    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b54191fc-df69-4163-982d-4d527c25655e-tmp-dir\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:16.676949 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.676926    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd908e82-8390-4555-9096-adbe328eddb9-trusted-ca\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.679756 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.679733    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd908e82-8390-4555-9096-adbe328eddb9-installation-pull-secrets\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.679756 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.679744    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd908e82-8390-4555-9096-adbe328eddb9-image-registry-private-configuration\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.693236 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.693183    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-bound-sa-token\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.707259 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.707235    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxlxw\" (UniqueName: \"kubernetes.io/projected/b54191fc-df69-4163-982d-4d527c25655e-kube-api-access-dxlxw\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:16.708608 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.708587    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2sdj\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-kube-api-access-w2sdj\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:16.769525 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.769482    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjhrt_d7985261-d01a-4a06-9a47-7e92ce099f3f/konnectivity-agent/0.log" limit=1024
Jul 14 21:51:16.776241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.776208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzzct\" (UniqueName: \"kubernetes.io/projected/cfcb488d-3e32-4a99-a49a-f6e76c404001-kube-api-access-dzzct\") pod \"ingress-canary-t9b2c\" (UID: \"cfcb488d-3e32-4a99-a49a-f6e76c404001\") " pod="openshift-ingress-canary/ingress-canary-t9b2c"
Jul 14 21:51:16.776241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.776242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfcb488d-3e32-4a99-a49a-f6e76c404001-cert\") pod \"ingress-canary-t9b2c\" (UID: \"cfcb488d-3e32-4a99-a49a-f6e76c404001\") " pod="openshift-ingress-canary/ingress-canary-t9b2c"
Jul 14 21:51:16.778924 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.778901    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfcb488d-3e32-4a99-a49a-f6e76c404001-cert\") pod \"ingress-canary-t9b2c\" (UID: \"cfcb488d-3e32-4a99-a49a-f6e76c404001\") " pod="openshift-ingress-canary/ingress-canary-t9b2c"
Jul 14 21:51:16.787340 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.787290    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzzct\" (UniqueName: \"kubernetes.io/projected/cfcb488d-3e32-4a99-a49a-f6e76c404001-kube-api-access-dzzct\") pod \"ingress-canary-t9b2c\" (UID: \"cfcb488d-3e32-4a99-a49a-f6e76c404001\") " pod="openshift-ingress-canary/ingress-canary-t9b2c"
Jul 14 21:51:16.824357 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.824326    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t9b2c"
Jul 14 21:51:16.876346 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:16.876306    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjhrt_d7985261-d01a-4a06-9a47-7e92ce099f3f/konnectivity-agent/0.log" limit=1024
Jul 14 21:51:17.178226 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:17.178193    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:17.178414 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:17.178372    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:17.178496 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:17.178380    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 21:51:17.178496 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:17.178448    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b9d68f48-zldd6: secret "image-registry-tls" not found
Jul 14 21:51:17.178496 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:17.178461    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 21:51:17.178643 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:17.178518    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls podName:fd908e82-8390-4555-9096-adbe328eddb9 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:18.178501186 +0000 UTC m=+37.090340641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls") pod "image-registry-64b9d68f48-zldd6" (UID: "fd908e82-8390-4555-9096-adbe328eddb9") : secret "image-registry-tls" not found
Jul 14 21:51:17.178643 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:17.178535    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls podName:b54191fc-df69-4163-982d-4d527c25655e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:18.178527677 +0000 UTC m=+37.090367121 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls") pod "dns-default-d44xw" (UID: "b54191fc-df69-4163-982d-4d527c25655e") : secret "dns-default-metrics-tls" not found
Jul 14 21:51:17.919204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:17.919178    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t9b2c"]
Jul 14 21:51:17.923597 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:51:17.923571    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfcb488d_3e32_4a99_a49a_f6e76c404001.slice/crio-99161f1df12e919dc468c859747390638270f8ff278b527e1e4099737ce9c949 WatchSource:0}: Error finding container 99161f1df12e919dc468c859747390638270f8ff278b527e1e4099737ce9c949: Status 404 returned error can't find the container with id 99161f1df12e919dc468c859747390638270f8ff278b527e1e4099737ce9c949
Jul 14 21:51:18.185477 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:18.185424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:18.185686 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:18.185511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:18.185686 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:18.185591    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 21:51:18.185686 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:18.185648    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 21:51:18.185686 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:18.185665    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls podName:b54191fc-df69-4163-982d-4d527c25655e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:20.185647532 +0000 UTC m=+39.097486971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls") pod "dns-default-d44xw" (UID: "b54191fc-df69-4163-982d-4d527c25655e") : secret "dns-default-metrics-tls" not found
Jul 14 21:51:18.185686 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:18.185667    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b9d68f48-zldd6: secret "image-registry-tls" not found
Jul 14 21:51:18.185878 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:18.185719    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls podName:fd908e82-8390-4555-9096-adbe328eddb9 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:20.185704801 +0000 UTC m=+39.097544261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls") pod "image-registry-64b9d68f48-zldd6" (UID: "fd908e82-8390-4555-9096-adbe328eddb9") : secret "image-registry-tls" not found
Jul 14 21:51:18.770041 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:18.769818    2583 generic.go:356] "Generic (PLEG): container finished" podID="ecbb0cab-8220-46af-97e1-0af94c7040ca" containerID="efe002321a856bf468fd5d0f49114ab5ec3c1bc92bc7a9072e1b180fe3b0739f" exitCode=0
Jul 14 21:51:18.770235 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:18.769906    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd2n4" event={"ID":"ecbb0cab-8220-46af-97e1-0af94c7040ca","Type":"ContainerDied","Data":"efe002321a856bf468fd5d0f49114ab5ec3c1bc92bc7a9072e1b180fe3b0739f"}
Jul 14 21:51:18.771661 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:18.771637    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t9b2c" event={"ID":"cfcb488d-3e32-4a99-a49a-f6e76c404001","Type":"ContainerStarted","Data":"99161f1df12e919dc468c859747390638270f8ff278b527e1e4099737ce9c949"}
Jul 14 21:51:19.777560 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:19.777519    2583 generic.go:356] "Generic (PLEG): container finished" podID="ecbb0cab-8220-46af-97e1-0af94c7040ca" containerID="12ad4f3dd2cd84feb4c0415f9f0a2cc03aaa2b31fb8a67900f9ba1aff26c9504" exitCode=0
Jul 14 21:51:19.778035 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:19.777574    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd2n4" event={"ID":"ecbb0cab-8220-46af-97e1-0af94c7040ca","Type":"ContainerDied","Data":"12ad4f3dd2cd84feb4c0415f9f0a2cc03aaa2b31fb8a67900f9ba1aff26c9504"}
Jul 14 21:51:20.204257 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:20.204227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:20.204394 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:20.204294    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:20.204430 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:20.204385    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 21:51:20.204430 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:20.204409    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b9d68f48-zldd6: secret "image-registry-tls" not found
Jul 14 21:51:20.204541 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:20.204461    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls podName:fd908e82-8390-4555-9096-adbe328eddb9 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:24.204446285 +0000 UTC m=+43.116285761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls") pod "image-registry-64b9d68f48-zldd6" (UID: "fd908e82-8390-4555-9096-adbe328eddb9") : secret "image-registry-tls" not found
Jul 14 21:51:20.204541 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:20.204389    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 21:51:20.204541 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:20.204528    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls podName:b54191fc-df69-4163-982d-4d527c25655e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:24.204512266 +0000 UTC m=+43.116351706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls") pod "dns-default-d44xw" (UID: "b54191fc-df69-4163-982d-4d527c25655e") : secret "dns-default-metrics-tls" not found
Jul 14 21:51:20.783362 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:20.783277    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hd2n4" event={"ID":"ecbb0cab-8220-46af-97e1-0af94c7040ca","Type":"ContainerStarted","Data":"e172d0c68f3259754f497ba1628683e51413686f8de40bcfcca2980a04e131a7"}
Jul 14 21:51:20.784837 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:20.784807    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t9b2c" event={"ID":"cfcb488d-3e32-4a99-a49a-f6e76c404001","Type":"ContainerStarted","Data":"9b4058ef7fe9a3518c9131ab21998fc141cfbf5e431b4c92e51c2f86d4e5aa74"}
Jul 14 21:51:20.811422 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:20.811373    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hd2n4" podStartSLOduration=9.063252652 podStartE2EDuration="38.811357309s" totalImagesPullingTime="29.748104657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:50:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:51:20.809461957 +0000 UTC m=+39.721301438" watchObservedRunningTime="2026-07-14 21:51:20.811357309 +0000 UTC m=+39.723196770"
Jul 14 21:51:20.825631 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:20.825573    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t9b2c" podStartSLOduration=2.5259026369999997 podStartE2EDuration="4.825556206s" totalImagesPullingTime="2.299653569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:51:20.825361055 +0000 UTC m=+39.737200516" watchObservedRunningTime="2026-07-14 21:51:20.825556206 +0000 UTC m=+39.737395669"
Jul 14 21:51:21.039898 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:21.039802    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjhrt_d7985261-d01a-4a06-9a47-7e92ce099f3f/konnectivity-agent/0.log" limit=1024
Jul 14 21:51:21.110818 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:21.110783    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjhrt_d7985261-d01a-4a06-9a47-7e92ce099f3f/konnectivity-agent/0.log" limit=1024
Jul 14 21:51:21.202233 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:21.202203    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjhrt_d7985261-d01a-4a06-9a47-7e92ce099f3f/konnectivity-agent/0.log" limit=1024
Jul 14 21:51:21.278467 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:21.278428    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jjhrt_d7985261-d01a-4a06-9a47-7e92ce099f3f/konnectivity-agent/0.log" limit=1024
Jul 14 21:51:24.234045 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:24.234004    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:24.234451 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:24.234081    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:24.234451 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:24.234157    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 21:51:24.234451 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:24.234171    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 21:51:24.234451 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:24.234176    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b9d68f48-zldd6: secret "image-registry-tls" not found
Jul 14 21:51:24.234451 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:24.234224    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls podName:b54191fc-df69-4163-982d-4d527c25655e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:32.234210467 +0000 UTC m=+51.146049906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls") pod "dns-default-d44xw" (UID: "b54191fc-df69-4163-982d-4d527c25655e") : secret "dns-default-metrics-tls" not found
Jul 14 21:51:24.234451 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:24.234236    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls podName:fd908e82-8390-4555-9096-adbe328eddb9 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:32.234230789 +0000 UTC m=+51.146070228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls") pod "image-registry-64b9d68f48-zldd6" (UID: "fd908e82-8390-4555-9096-adbe328eddb9") : secret "image-registry-tls" not found
Jul 14 21:51:31.384763 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.384727    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"]
Jul 14 21:51:31.394122 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.394095    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:31.397451 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.397426    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 21:51:31.397738 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.397716    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"]
Jul 14 21:51:31.397875 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.397861    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 21:51:31.397921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.397905    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 14 21:51:31.398265 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.398243    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-92dn2\""
Jul 14 21:51:31.400247 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.400227    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 14 21:51:31.488713 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.488683    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xb9m6"]
Jul 14 21:51:31.492488 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.492461    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c7zp\" (UniqueName: \"kubernetes.io/projected/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-kube-api-access-8c7zp\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:31.492646 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.492531    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:31.492646 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.492553    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:31.503237 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.503207    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56769d696d-kg2rh"]
Jul 14 21:51:31.503394 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.503373    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.506509 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.506486    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 21:51:31.506675 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.506655    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 21:51:31.506749 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.506727    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qgjph\""
Jul 14 21:51:31.506870 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.506854    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 14 21:51:31.506934 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.506924    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 14 21:51:31.514010 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.513970    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 14 21:51:31.517878 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.517855    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xb9m6"]
Jul 14 21:51:31.517978 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.517891    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56769d696d-kg2rh"]
Jul 14 21:51:31.517978 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.517964    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.520389 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.520371    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 14 21:51:31.520508 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.520455    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 21:51:31.520508 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.520488    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-94pjj\""
Jul 14 21:51:31.520631 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.520578    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 14 21:51:31.520669 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.520646    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 14 21:51:31.520717 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.520671    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 21:51:31.520876 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.520864    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 14 21:51:31.593717 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.593677    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c7zp\" (UniqueName: \"kubernetes.io/projected/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-kube-api-access-8c7zp\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:31.593717 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.593717    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abec354f-45af-43a7-a75b-dd4f722fa7f5-serving-cert\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.593981 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.593771    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:31.593981 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.593787    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abec354f-45af-43a7-a75b-dd4f722fa7f5-tmp\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.593981 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.593837    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:31.593981 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.593869    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/abec354f-45af-43a7-a75b-dd4f722fa7f5-snapshots\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.593981 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:31.593938    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 21:51:31.594204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.594007    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w89bt\" (UniqueName: \"kubernetes.io/projected/abec354f-45af-43a7-a75b-dd4f722fa7f5-kube-api-access-w89bt\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.594204 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:31.594023    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls podName:0f7ebb7b-17e8-4466-8ec6-6244fa0897ed nodeName:}" failed. No retries permitted until 2026-07-14 21:51:32.093982351 +0000 UTC m=+51.005821795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6kl8x" (UID: "0f7ebb7b-17e8-4466-8ec6-6244fa0897ed") : secret "cluster-monitoring-operator-tls" not found
Jul 14 21:51:31.594204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.594098    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abec354f-45af-43a7-a75b-dd4f722fa7f5-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.594204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.594127    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abec354f-45af-43a7-a75b-dd4f722fa7f5-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.594583 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.594566    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:31.605589 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.605564    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c7zp\" (UniqueName: \"kubernetes.io/projected/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-kube-api-access-8c7zp\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:31.694932 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.694843    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-stats-auth\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.694932 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.694881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.695175 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.694969    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-default-certificate\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.695175 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.695031    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.695175 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.695108    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abec354f-45af-43a7-a75b-dd4f722fa7f5-tmp\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.695175 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.695139    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w89bt\" (UniqueName: \"kubernetes.io/projected/abec354f-45af-43a7-a75b-dd4f722fa7f5-kube-api-access-w89bt\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.695343 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.695182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abec354f-45af-43a7-a75b-dd4f722fa7f5-serving-cert\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.695343 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.695214    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/abec354f-45af-43a7-a75b-dd4f722fa7f5-snapshots\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.695343 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.695236    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abec354f-45af-43a7-a75b-dd4f722fa7f5-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.695343 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.695251    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abec354f-45af-43a7-a75b-dd4f722fa7f5-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.695343 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.695270    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj58n\" (UniqueName: \"kubernetes.io/projected/04d61ecd-f296-4911-ab2f-05cd8db74221-kube-api-access-gj58n\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.695571 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.695487    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abec354f-45af-43a7-a75b-dd4f722fa7f5-tmp\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.695818 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.695794    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abec354f-45af-43a7-a75b-dd4f722fa7f5-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.695865 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.695842    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/abec354f-45af-43a7-a75b-dd4f722fa7f5-snapshots\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.696105 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.696084    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abec354f-45af-43a7-a75b-dd4f722fa7f5-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.697498 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.697476    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/abec354f-45af-43a7-a75b-dd4f722fa7f5-serving-cert\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.703624 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.703601    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w89bt\" (UniqueName: \"kubernetes.io/projected/abec354f-45af-43a7-a75b-dd4f722fa7f5-kube-api-access-w89bt\") pod \"insights-operator-68d9dd94cf-xb9m6\" (UID: \"abec354f-45af-43a7-a75b-dd4f722fa7f5\") " pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.796533 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.796465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-default-certificate\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.796533 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.796505    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.796752 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.796633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj58n\" (UniqueName: \"kubernetes.io/projected/04d61ecd-f296-4911-ab2f-05cd8db74221-kube-api-access-gj58n\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.796752 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.796665    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-stats-auth\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.796752 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.796689    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.796752 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:31.796734    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle podName:04d61ecd-f296-4911-ab2f-05cd8db74221 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:32.296708433 +0000 UTC m=+51.208547888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle") pod "router-default-56769d696d-kg2rh" (UID: "04d61ecd-f296-4911-ab2f-05cd8db74221") : configmap references non-existent config key: service-ca.crt
Jul 14 21:51:31.796961 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:31.796779    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 21:51:31.796961 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:31.796850    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs podName:04d61ecd-f296-4911-ab2f-05cd8db74221 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:32.296834222 +0000 UTC m=+51.208673661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs") pod "router-default-56769d696d-kg2rh" (UID: "04d61ecd-f296-4911-ab2f-05cd8db74221") : secret "router-metrics-certs-default" not found
Jul 14 21:51:31.798961 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.798939    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-stats-auth\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.799077 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.798966    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-default-certificate\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.806850 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.806827    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj58n\" (UniqueName: \"kubernetes.io/projected/04d61ecd-f296-4911-ab2f-05cd8db74221-kube-api-access-gj58n\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:31.817791 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.817766    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6"
Jul 14 21:51:31.954522 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:31.954447    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xb9m6"]
Jul 14 21:51:31.957646 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:51:31.957619    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabec354f_45af_43a7_a75b_dd4f722fa7f5.slice/crio-bc5759e6d30decb5aaa11d6131408df8cad0b98dc9cc3e9948adc5681a50cb12 WatchSource:0}: Error finding container bc5759e6d30decb5aaa11d6131408df8cad0b98dc9cc3e9948adc5681a50cb12: Status 404 returned error can't find the container with id bc5759e6d30decb5aaa11d6131408df8cad0b98dc9cc3e9948adc5681a50cb12
Jul 14 21:51:32.099433 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:32.099391    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:32.099603 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:32.099547    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 21:51:32.099667 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:32.099613    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls podName:0f7ebb7b-17e8-4466-8ec6-6244fa0897ed nodeName:}" failed. No retries permitted until 2026-07-14 21:51:33.099596582 +0000 UTC m=+52.011436021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6kl8x" (UID: "0f7ebb7b-17e8-4466-8ec6-6244fa0897ed") : secret "cluster-monitoring-operator-tls" not found
Jul 14 21:51:32.301370 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:32.301280    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:32.301370 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:32.301324    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:32.301370 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:32.301346    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:32.301662 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:32.301446    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 21:51:32.301662 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:32.301464    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b9d68f48-zldd6: secret "image-registry-tls" not found
Jul 14 21:51:32.301662 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:32.301472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:32.301662 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:32.301488    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle podName:04d61ecd-f296-4911-ab2f-05cd8db74221 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:33.301471367 +0000 UTC m=+52.213310808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle") pod "router-default-56769d696d-kg2rh" (UID: "04d61ecd-f296-4911-ab2f-05cd8db74221") : configmap references non-existent config key: service-ca.crt
Jul 14 21:51:32.301662 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:32.301531    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 21:51:32.301662 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:32.301556    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls podName:fd908e82-8390-4555-9096-adbe328eddb9 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:48.301537773 +0000 UTC m=+67.213377216 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls") pod "image-registry-64b9d68f48-zldd6" (UID: "fd908e82-8390-4555-9096-adbe328eddb9") : secret "image-registry-tls" not found
Jul 14 21:51:32.301662 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:32.301444    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 21:51:32.301662 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:32.301592    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls podName:b54191fc-df69-4163-982d-4d527c25655e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:48.30157469 +0000 UTC m=+67.213414143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls") pod "dns-default-d44xw" (UID: "b54191fc-df69-4163-982d-4d527c25655e") : secret "dns-default-metrics-tls" not found
Jul 14 21:51:32.301662 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:32.301630    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs podName:04d61ecd-f296-4911-ab2f-05cd8db74221 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:33.301619994 +0000 UTC m=+52.213459433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs") pod "router-default-56769d696d-kg2rh" (UID: "04d61ecd-f296-4911-ab2f-05cd8db74221") : secret "router-metrics-certs-default" not found
Jul 14 21:51:32.815504 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:32.815462    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6" event={"ID":"abec354f-45af-43a7-a75b-dd4f722fa7f5","Type":"ContainerStarted","Data":"bc5759e6d30decb5aaa11d6131408df8cad0b98dc9cc3e9948adc5681a50cb12"}
Jul 14 21:51:33.106915 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:33.106834    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:33.107125 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:33.106961    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 21:51:33.107125 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:33.107046    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls podName:0f7ebb7b-17e8-4466-8ec6-6244fa0897ed nodeName:}" failed. No retries permitted until 2026-07-14 21:51:35.107028731 +0000 UTC m=+54.018868173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6kl8x" (UID: "0f7ebb7b-17e8-4466-8ec6-6244fa0897ed") : secret "cluster-monitoring-operator-tls" not found
Jul 14 21:51:33.309058 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:33.309022    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:33.309255 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:33.309097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:33.309255 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:33.309191    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 21:51:33.309353 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:33.309251    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle podName:04d61ecd-f296-4911-ab2f-05cd8db74221 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:35.309232835 +0000 UTC m=+54.221072279 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle") pod "router-default-56769d696d-kg2rh" (UID: "04d61ecd-f296-4911-ab2f-05cd8db74221") : configmap references non-existent config key: service-ca.crt
Jul 14 21:51:33.309353 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:33.309277    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs podName:04d61ecd-f296-4911-ab2f-05cd8db74221 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:35.309269952 +0000 UTC m=+54.221109391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs") pod "router-default-56769d696d-kg2rh" (UID: "04d61ecd-f296-4911-ab2f-05cd8db74221") : secret "router-metrics-certs-default" not found
Jul 14 21:51:34.823064 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:34.823027    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6" event={"ID":"abec354f-45af-43a7-a75b-dd4f722fa7f5","Type":"ContainerStarted","Data":"3b123a50c25eb2c331b637b43eebe5a3f759d8e0c30b59cb756fe95bfe8431b8"}
Jul 14 21:51:34.840635 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:34.840582    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6" podStartSLOduration=1.148305501 podStartE2EDuration="3.840567223s" totalImagesPullingTime="2.692261722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:51:34.840163936 +0000 UTC m=+53.752003410" watchObservedRunningTime="2026-07-14 21:51:34.840567223 +0000 UTC m=+53.752406729"
Jul 14 21:51:35.123575 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:35.123534    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:35.123806 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:35.123686    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 21:51:35.123806 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:35.123767    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls podName:0f7ebb7b-17e8-4466-8ec6-6244fa0897ed nodeName:}" failed. No retries permitted until 2026-07-14 21:51:39.123751063 +0000 UTC m=+58.035590504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6kl8x" (UID: "0f7ebb7b-17e8-4466-8ec6-6244fa0897ed") : secret "cluster-monitoring-operator-tls" not found
Jul 14 21:51:35.326058 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:35.326016    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:35.326243 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:35.326079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:35.326243 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:35.326167    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 21:51:35.326243 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:35.326235    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs podName:04d61ecd-f296-4911-ab2f-05cd8db74221 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:39.326218389 +0000 UTC m=+58.238057829 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs") pod "router-default-56769d696d-kg2rh" (UID: "04d61ecd-f296-4911-ab2f-05cd8db74221") : secret "router-metrics-certs-default" not found
Jul 14 21:51:35.326405 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:35.326252    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle podName:04d61ecd-f296-4911-ab2f-05cd8db74221 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:39.326245138 +0000 UTC m=+58.238084578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle") pod "router-default-56769d696d-kg2rh" (UID: "04d61ecd-f296-4911-ab2f-05cd8db74221") : configmap references non-existent config key: service-ca.crt
Jul 14 21:51:37.010262 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.010222    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kh8wx"]
Jul 14 21:51:37.013249 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.013227    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.017140 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.017108    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bh6h4\""
Jul 14 21:51:37.017347 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.017329    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 21:51:37.019219 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.019200    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 21:51:37.036119 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.036081    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kh8wx"]
Jul 14 21:51:37.041364 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.041334    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.041531 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.041449    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.041531 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.041501    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-data-volume\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.041644 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.041550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlw8c\" (UniqueName: \"kubernetes.io/projected/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-api-access-wlw8c\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.041644 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.041588    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-crio-socket\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.142504 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.142463    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlw8c\" (UniqueName: \"kubernetes.io/projected/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-api-access-wlw8c\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.142715 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.142533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-crio-socket\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.142715 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.142612    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.142817 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.142742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.142817 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.142803    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-data-volume\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.143238 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.143214    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-data-volume\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.143699 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.143679    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-crio-socket\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.143817 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:37.143802    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 21:51:37.143881 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:37.143870    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls podName:b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:37.64384368 +0000 UTC m=+56.555683119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh8wx" (UID: "b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e") : secret "insights-runtime-extractor-tls" not found
Jul 14 21:51:37.144166 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:37.144143    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 21:51:37.144247 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:37.144201    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm podName:b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:37.644187619 +0000 UTC m=+56.556027072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh8wx" (UID: "b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e") : configmap "kube-rbac-proxy" not found
Jul 14 21:51:37.153227 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.153197    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlw8c\" (UniqueName: \"kubernetes.io/projected/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-api-access-wlw8c\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.646488 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.646448    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.646655 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:37.646545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:37.646655 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:37.646568    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 21:51:37.646655 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:37.646633    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm podName:b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:38.646615679 +0000 UTC m=+57.558455118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh8wx" (UID: "b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e") : configmap "kube-rbac-proxy" not found
Jul 14 21:51:37.646792 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:37.646673    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 21:51:37.646792 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:37.646716    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls podName:b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:38.646703014 +0000 UTC m=+57.558542454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh8wx" (UID: "b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e") : secret "insights-runtime-extractor-tls" not found
Jul 14 21:51:38.656372 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:38.656332    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:38.656812 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:38.656442    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:38.656812 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:38.656495    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 21:51:38.656812 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:38.656560    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 21:51:38.656812 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:38.656575    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls podName:b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:40.656557553 +0000 UTC m=+59.568396992 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh8wx" (UID: "b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e") : secret "insights-runtime-extractor-tls" not found
Jul 14 21:51:38.656812 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:38.656621    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm podName:b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:40.656608348 +0000 UTC m=+59.568447787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh8wx" (UID: "b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e") : configmap "kube-rbac-proxy" not found
Jul 14 21:51:38.800398 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:38.800372    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qh9ns_ce0c7cdb-5105-4e28-acc6-f4ce42c233ec/dns-node-resolver/0.log"
Jul 14 21:51:39.160048 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:39.159981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:39.160320 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:39.160130    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 21:51:39.160320 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:39.160200    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls podName:0f7ebb7b-17e8-4466-8ec6-6244fa0897ed nodeName:}" failed. No retries permitted until 2026-07-14 21:51:47.160185486 +0000 UTC m=+66.072024927 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6kl8x" (UID: "0f7ebb7b-17e8-4466-8ec6-6244fa0897ed") : secret "cluster-monitoring-operator-tls" not found
Jul 14 21:51:39.361420 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:39.361368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:39.361621 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:39.361576    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle podName:04d61ecd-f296-4911-ab2f-05cd8db74221 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:47.36155304 +0000 UTC m=+66.273392483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle") pod "router-default-56769d696d-kg2rh" (UID: "04d61ecd-f296-4911-ab2f-05cd8db74221") : configmap references non-existent config key: service-ca.crt
Jul 14 21:51:39.361621 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:39.361612    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:39.361751 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:39.361740    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 21:51:39.361807 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:39.361790    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs podName:04d61ecd-f296-4911-ab2f-05cd8db74221 nodeName:}" failed. No retries permitted until 2026-07-14 21:51:47.361775915 +0000 UTC m=+66.273615378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs") pod "router-default-56769d696d-kg2rh" (UID: "04d61ecd-f296-4911-ab2f-05cd8db74221") : secret "router-metrics-certs-default" not found
Jul 14 21:51:39.399242 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:39.399210    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4ctzt_c91692a9-5187-4ef7-ab60-702349a28c5b/node-ca/0.log"
Jul 14 21:51:40.002056 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:40.002026    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t9b2c_cfcb488d-3e32-4a99-a49a-f6e76c404001/serve-healthcheck-canary/0.log"
Jul 14 21:51:40.673634 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:40.673583    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:40.673849 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:40.673687    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:40.673849 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:40.673744    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 21:51:40.673849 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:40.673832    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm podName:b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:44.673809871 +0000 UTC m=+63.585649333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh8wx" (UID: "b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e") : configmap "kube-rbac-proxy" not found
Jul 14 21:51:40.673849 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:40.673833    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 21:51:40.674103 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:40.673887    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls podName:b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:44.673874294 +0000 UTC m=+63.585713734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh8wx" (UID: "b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e") : secret "insights-runtime-extractor-tls" not found
Jul 14 21:51:42.767572 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:42.767543    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mx67w"
Jul 14 21:51:44.706431 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:44.706374    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:44.706858 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:44.706517    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 14 21:51:44.706858 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:44.706554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:44.706858 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:44.706585    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm podName:b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:52.706567703 +0000 UTC m=+71.618407142 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kh8wx" (UID: "b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e") : configmap "kube-rbac-proxy" not found
Jul 14 21:51:44.706858 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:44.706639    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 21:51:44.706858 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:44.706680    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls podName:b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e nodeName:}" failed. No retries permitted until 2026-07-14 21:51:52.706669852 +0000 UTC m=+71.618509291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh8wx" (UID: "b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e") : secret "insights-runtime-extractor-tls" not found
Jul 14 21:51:47.227172 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.227131    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:51:47.227548 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:47.227270    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 14 21:51:47.227548 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:47.227337    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls podName:0f7ebb7b-17e8-4466-8ec6-6244fa0897ed nodeName:}" failed. No retries permitted until 2026-07-14 21:52:03.227322874 +0000 UTC m=+82.139162313 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6kl8x" (UID: "0f7ebb7b-17e8-4466-8ec6-6244fa0897ed") : secret "cluster-monitoring-operator-tls" not found
Jul 14 21:51:47.328292 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.328247    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mnwj\" (UniqueName: \"kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj\") pod \"network-check-target-dqdq4\" (UID: \"1032b119-d5ba-458f-94cf-784b5ed1e33f\") " pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:47.331131 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.331108    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 21:51:47.342176 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.342146    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 21:51:47.353034 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.353005    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mnwj\" (UniqueName: \"kubernetes.io/projected/1032b119-d5ba-458f-94cf-784b5ed1e33f-kube-api-access-2mnwj\") pod \"network-check-target-dqdq4\" (UID: \"1032b119-d5ba-458f-94cf-784b5ed1e33f\") " pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:47.428686 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.428640    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:47.428857 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.428706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:51:47.428857 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.428747    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:51:47.428857 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.428774    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:51:47.428857 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:47.428809    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 14 21:51:47.429026 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:47.428877    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs podName:04d61ecd-f296-4911-ab2f-05cd8db74221 nodeName:}" failed. No retries permitted until 2026-07-14 21:52:03.428857056 +0000 UTC m=+82.340696515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs") pod "router-default-56769d696d-kg2rh" (UID: "04d61ecd-f296-4911-ab2f-05cd8db74221") : secret "router-metrics-certs-default" not found
Jul 14 21:51:47.429026 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:47.428904    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle podName:04d61ecd-f296-4911-ab2f-05cd8db74221 nodeName:}" failed. No retries permitted until 2026-07-14 21:52:03.428886877 +0000 UTC m=+82.340726315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle") pod "router-default-56769d696d-kg2rh" (UID: "04d61ecd-f296-4911-ab2f-05cd8db74221") : configmap references non-existent config key: service-ca.crt
Jul 14 21:51:47.431479 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.431455    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 21:51:47.431592 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.431554    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 21:51:47.439573 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:47.439532    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 14 21:51:47.439711 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:47.439622    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs podName:675d03c4-b4d9-4d6f-8114-fde0d6206464 nodeName:}" failed. No retries permitted until 2026-07-14 21:52:51.439599582 +0000 UTC m=+130.351439022 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs") pod "network-metrics-daemon-dnx2s" (UID: "675d03c4-b4d9-4d6f-8114-fde0d6206464") : secret "metrics-daemon-secret" not found
Jul 14 21:51:47.441878 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.441851    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8b178bec-d3fb-425d-bf9b-e7a9c57d559e-original-pull-secret\") pod \"global-pull-secret-syncer-4g2l8\" (UID: \"8b178bec-d3fb-425d-bf9b-e7a9c57d559e\") " pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:51:47.496500 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.496398    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4g2l8"
Jul 14 21:51:47.505066 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.505034    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r4xkn\""
Jul 14 21:51:47.513561 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.513529    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:47.631117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.630925    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4g2l8"]
Jul 14 21:51:47.633823 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:51:47.633797    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b178bec_d3fb_425d_bf9b_e7a9c57d559e.slice/crio-45467afc56c8bf74939f6524b3fd5f913ea048f04171fab08f6432108145ef47 WatchSource:0}: Error finding container 45467afc56c8bf74939f6524b3fd5f913ea048f04171fab08f6432108145ef47: Status 404 returned error can't find the container with id 45467afc56c8bf74939f6524b3fd5f913ea048f04171fab08f6432108145ef47
Jul 14 21:51:47.649227 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.649199    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqdq4"]
Jul 14 21:51:47.652025 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:51:47.651982    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1032b119_d5ba_458f_94cf_784b5ed1e33f.slice/crio-2c0f321399555984beef59a5960cbabf6e0177a0ca12d97cf7fb9112c9d40891 WatchSource:0}: Error finding container 2c0f321399555984beef59a5960cbabf6e0177a0ca12d97cf7fb9112c9d40891: Status 404 returned error can't find the container with id 2c0f321399555984beef59a5960cbabf6e0177a0ca12d97cf7fb9112c9d40891
Jul 14 21:51:47.855509 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.855475    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4g2l8" event={"ID":"8b178bec-d3fb-425d-bf9b-e7a9c57d559e","Type":"ContainerStarted","Data":"45467afc56c8bf74939f6524b3fd5f913ea048f04171fab08f6432108145ef47"}
Jul 14 21:51:47.856532 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:47.856502    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqdq4" event={"ID":"1032b119-d5ba-458f-94cf-784b5ed1e33f","Type":"ContainerStarted","Data":"2c0f321399555984beef59a5960cbabf6e0177a0ca12d97cf7fb9112c9d40891"}
Jul 14 21:51:48.338369 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:48.338321    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:51:48.338861 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:48.338436    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:51:48.338861 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:48.338488    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 14 21:51:48.338861 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:48.338505    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b9d68f48-zldd6: secret "image-registry-tls" not found
Jul 14 21:51:48.338861 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:48.338547    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 14 21:51:48.338861 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:48.338573    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls podName:fd908e82-8390-4555-9096-adbe328eddb9 nodeName:}" failed. No retries permitted until 2026-07-14 21:52:20.338553908 +0000 UTC m=+99.250393369 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls") pod "image-registry-64b9d68f48-zldd6" (UID: "fd908e82-8390-4555-9096-adbe328eddb9") : secret "image-registry-tls" not found
Jul 14 21:51:48.338861 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:48.338589    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls podName:b54191fc-df69-4163-982d-4d527c25655e nodeName:}" failed. No retries permitted until 2026-07-14 21:52:20.338581164 +0000 UTC m=+99.250420607 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls") pod "dns-default-d44xw" (UID: "b54191fc-df69-4163-982d-4d527c25655e") : secret "dns-default-metrics-tls" not found
Jul 14 21:51:52.776231 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:52.776181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:52.776662 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:52.776265    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:52.776662 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:52.776341    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 14 21:51:52.776662 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:51:52.776405    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls podName:b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e nodeName:}" failed. No retries permitted until 2026-07-14 21:52:08.776389775 +0000 UTC m=+87.688229219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kh8wx" (UID: "b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e") : secret "insights-runtime-extractor-tls" not found
Jul 14 21:51:52.776803 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:52.776782    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:51:52.873119 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:52.873078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4g2l8" event={"ID":"8b178bec-d3fb-425d-bf9b-e7a9c57d559e","Type":"ContainerStarted","Data":"991de0f9de7ce7c28d54e7f49f500df04d23342d13a5c8dd2dfaf0fa2dadfe96"}
Jul 14 21:51:52.874445 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:52.874423    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqdq4" event={"ID":"1032b119-d5ba-458f-94cf-784b5ed1e33f","Type":"ContainerStarted","Data":"99372c0f86f1c9b5451c94be8e20d9eef0c8c2289ff3a1b88757f838059f6ff5"}
Jul 14 21:51:52.874575 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:52.874558    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:51:52.890261 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:52.890198    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4g2l8" podStartSLOduration=66.3371555 podStartE2EDuration="1m10.89018305s" totalImagesPullingTime="4.55302755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:51:52.889187113 +0000 UTC m=+71.801026578" watchObservedRunningTime="2026-07-14 21:51:52.89018305 +0000 UTC m=+71.802022510"
Jul 14 21:51:52.907953 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:51:52.907887    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dqdq4" podStartSLOduration=67.376771347 podStartE2EDuration="1m11.907867754s" totalImagesPullingTime="4.531096407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:51:52.907351059 +0000 UTC m=+71.819190523" watchObservedRunningTime="2026-07-14 21:51:52.907867754 +0000 UTC m=+71.819707219"
Jul 14 21:52:03.263719 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.263658    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:52:03.266084 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.266055    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0f7ebb7b-17e8-4466-8ec6-6244fa0897ed-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6kl8x\" (UID: \"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:52:03.465074 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.465032    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:52:03.465242 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.465092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:52:03.465667 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.465650    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04d61ecd-f296-4911-ab2f-05cd8db74221-service-ca-bundle\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:52:03.467418 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.467399    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04d61ecd-f296-4911-ab2f-05cd8db74221-metrics-certs\") pod \"router-default-56769d696d-kg2rh\" (UID: \"04d61ecd-f296-4911-ab2f-05cd8db74221\") " pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:52:03.506467 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.506431    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-92dn2\""
Jul 14 21:52:03.514553 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.514482    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"
Jul 14 21:52:03.629360 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.629332    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-94pjj\""
Jul 14 21:52:03.636510 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.636484    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:52:03.644865 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.644837    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x"]
Jul 14 21:52:03.647695 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:03.647656    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f7ebb7b_17e8_4466_8ec6_6244fa0897ed.slice/crio-7fbb2523b6458ea97173cb480b0df23db0ddb6710d783ce621bc1dbe3e9c3d7b WatchSource:0}: Error finding container 7fbb2523b6458ea97173cb480b0df23db0ddb6710d783ce621bc1dbe3e9c3d7b: Status 404 returned error can't find the container with id 7fbb2523b6458ea97173cb480b0df23db0ddb6710d783ce621bc1dbe3e9c3d7b
Jul 14 21:52:03.766016 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.765923    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56769d696d-kg2rh"]
Jul 14 21:52:03.768746 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:03.768723    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d61ecd_f296_4911_ab2f_05cd8db74221.slice/crio-7689114e1d67246ad0a38aeb525ecea56f075e81de0efd19effd8537ecae6b34 WatchSource:0}: Error finding container 7689114e1d67246ad0a38aeb525ecea56f075e81de0efd19effd8537ecae6b34: Status 404 returned error can't find the container with id 7689114e1d67246ad0a38aeb525ecea56f075e81de0efd19effd8537ecae6b34
Jul 14 21:52:03.904656 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.904620    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x" event={"ID":"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed","Type":"ContainerStarted","Data":"7fbb2523b6458ea97173cb480b0df23db0ddb6710d783ce621bc1dbe3e9c3d7b"}
Jul 14 21:52:03.906047 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.906018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56769d696d-kg2rh" event={"ID":"04d61ecd-f296-4911-ab2f-05cd8db74221","Type":"ContainerStarted","Data":"e2c5a328eb93cc1e487ba92b1e066c3c8681fac5e3534fdf23b9af231b84756d"}
Jul 14 21:52:03.906155 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.906060    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56769d696d-kg2rh" event={"ID":"04d61ecd-f296-4911-ab2f-05cd8db74221","Type":"ContainerStarted","Data":"7689114e1d67246ad0a38aeb525ecea56f075e81de0efd19effd8537ecae6b34"}
Jul 14 21:52:03.927243 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:03.927195    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56769d696d-kg2rh" podStartSLOduration=32.927181227 podStartE2EDuration="32.927181227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:51:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:03.926139925 +0000 UTC m=+82.837979404" watchObservedRunningTime="2026-07-14 21:52:03.927181227 +0000 UTC m=+82.839020687"
Jul 14 21:52:04.636900 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:04.636859    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:52:04.639339 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:04.639318    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:52:04.910949 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:04.910836    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:52:04.912388 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:04.912366    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56769d696d-kg2rh"
Jul 14 21:52:05.915326 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:05.915238    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x" event={"ID":"0f7ebb7b-17e8-4466-8ec6-6244fa0897ed","Type":"ContainerStarted","Data":"f415aef271a3e4058b5230599e0f7d373bd6c0f4555e822b47b8596bfbd80967"}
Jul 14 21:52:05.937677 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:05.937617    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6kl8x" podStartSLOduration=33.028572482 podStartE2EDuration="34.937599272s" totalImagesPullingTime="1.90902679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:05.937018436 +0000 UTC m=+84.848857904" watchObservedRunningTime="2026-07-14 21:52:05.937599272 +0000 UTC m=+84.849438783"
Jul 14 21:52:08.811073 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:08.811036    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:52:08.813313 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:08.813292    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kh8wx\" (UID: \"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e\") " pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:52:08.826162 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:08.826136    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bh6h4\""
Jul 14 21:52:08.833954 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:08.833930    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kh8wx"
Jul 14 21:52:08.970589 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:08.970555    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kh8wx"]
Jul 14 21:52:08.973436 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:08.973410    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64b1f9c_c0c9_4d50_a6aa_5c138dc7f62e.slice/crio-84661fc21c8619de9ac7a18028a880f2b15529e49373dd443e471e072f35ee3c WatchSource:0}: Error finding container 84661fc21c8619de9ac7a18028a880f2b15529e49373dd443e471e072f35ee3c: Status 404 returned error can't find the container with id 84661fc21c8619de9ac7a18028a880f2b15529e49373dd443e471e072f35ee3c
Jul 14 21:52:09.929588 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:09.929543    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh8wx" event={"ID":"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e","Type":"ContainerStarted","Data":"84661fc21c8619de9ac7a18028a880f2b15529e49373dd443e471e072f35ee3c"}
Jul 14 21:52:12.940923 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:12.940843    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh8wx" event={"ID":"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e","Type":"ContainerStarted","Data":"9d71c3f397761c41b5ff44e68e38567f667e7cb743498c281576bda2a319a5f5"}
Jul 14 21:52:13.946030 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:13.945969    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh8wx" event={"ID":"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e","Type":"ContainerStarted","Data":"9908c99730c3a602fc14407d97b7f41cd4bfa97248d3be365c82cea1ffe21ab7"}
Jul 14 21:52:14.779510 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.779477    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"]
Jul 14 21:52:14.782592 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.782571    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"
Jul 14 21:52:14.785570 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.785546    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 14 21:52:14.786634 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.786616    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 14 21:52:14.786634 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.786627    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 14 21:52:14.786983 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.786964    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 14 21:52:14.799138 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.799110    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"]
Jul 14 21:52:14.862852 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.862817    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xhkl\" (UniqueName: \"kubernetes.io/projected/2848d22a-f2a7-43f7-abcc-eb55f4810d24-kube-api-access-9xhkl\") pod \"klusterlet-addon-workmgr-74fd8f857b-ftk8h\" (UID: \"2848d22a-f2a7-43f7-abcc-eb55f4810d24\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"
Jul 14 21:52:14.863044 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.862926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2848d22a-f2a7-43f7-abcc-eb55f4810d24-klusterlet-config\") pod \"klusterlet-addon-workmgr-74fd8f857b-ftk8h\" (UID: \"2848d22a-f2a7-43f7-abcc-eb55f4810d24\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"
Jul 14 21:52:14.863044 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.862980    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2848d22a-f2a7-43f7-abcc-eb55f4810d24-tmp\") pod \"klusterlet-addon-workmgr-74fd8f857b-ftk8h\" (UID: \"2848d22a-f2a7-43f7-abcc-eb55f4810d24\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"
Jul 14 21:52:14.877719 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.877683    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-f79ht"]
Jul 14 21:52:14.882251 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.882227    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-f79ht"
Jul 14 21:52:14.885584 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.885552    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-g422n\""
Jul 14 21:52:14.892440 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.892414    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-f79ht"]
Jul 14 21:52:14.963739 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.963701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xhkl\" (UniqueName: \"kubernetes.io/projected/2848d22a-f2a7-43f7-abcc-eb55f4810d24-kube-api-access-9xhkl\") pod \"klusterlet-addon-workmgr-74fd8f857b-ftk8h\" (UID: \"2848d22a-f2a7-43f7-abcc-eb55f4810d24\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"
Jul 14 21:52:14.964248 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.963854    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2848d22a-f2a7-43f7-abcc-eb55f4810d24-klusterlet-config\") pod \"klusterlet-addon-workmgr-74fd8f857b-ftk8h\" (UID: \"2848d22a-f2a7-43f7-abcc-eb55f4810d24\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"
Jul 14 21:52:14.964248 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.963902    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2848d22a-f2a7-43f7-abcc-eb55f4810d24-tmp\") pod \"klusterlet-addon-workmgr-74fd8f857b-ftk8h\" (UID: \"2848d22a-f2a7-43f7-abcc-eb55f4810d24\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"
Jul 14 21:52:14.964248 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.963926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q8dv\" (UniqueName: \"kubernetes.io/projected/c42f432c-25bc-4ee4-ada3-075d43ebdbe4-kube-api-access-8q8dv\") pod \"network-check-source-869dcfcdcd-f79ht\" (UID: \"c42f432c-25bc-4ee4-ada3-075d43ebdbe4\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-f79ht"
Jul 14 21:52:14.964415 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.964315    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2848d22a-f2a7-43f7-abcc-eb55f4810d24-tmp\") pod \"klusterlet-addon-workmgr-74fd8f857b-ftk8h\" (UID: \"2848d22a-f2a7-43f7-abcc-eb55f4810d24\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"
Jul 14 21:52:14.966926 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.966895    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2848d22a-f2a7-43f7-abcc-eb55f4810d24-klusterlet-config\") pod \"klusterlet-addon-workmgr-74fd8f857b-ftk8h\" (UID: \"2848d22a-f2a7-43f7-abcc-eb55f4810d24\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"
Jul 14 21:52:14.982168 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:14.982133    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xhkl\" (UniqueName: \"kubernetes.io/projected/2848d22a-f2a7-43f7-abcc-eb55f4810d24-kube-api-access-9xhkl\") pod \"klusterlet-addon-workmgr-74fd8f857b-ftk8h\" (UID: \"2848d22a-f2a7-43f7-abcc-eb55f4810d24\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"
Jul 14 21:52:15.064588 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:15.064547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q8dv\" (UniqueName: \"kubernetes.io/projected/c42f432c-25bc-4ee4-ada3-075d43ebdbe4-kube-api-access-8q8dv\") pod \"network-check-source-869dcfcdcd-f79ht\" (UID: \"c42f432c-25bc-4ee4-ada3-075d43ebdbe4\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-f79ht"
Jul 14 21:52:15.074918 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:15.074876    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q8dv\" (UniqueName: \"kubernetes.io/projected/c42f432c-25bc-4ee4-ada3-075d43ebdbe4-kube-api-access-8q8dv\") pod \"network-check-source-869dcfcdcd-f79ht\" (UID: \"c42f432c-25bc-4ee4-ada3-075d43ebdbe4\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-f79ht"
Jul 14 21:52:15.093400 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:15.093355    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"
Jul 14 21:52:15.193423 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:15.193386    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-f79ht"
Jul 14 21:52:16.039490 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:16.039461    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-f79ht"]
Jul 14 21:52:16.042747 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:16.042720    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42f432c_25bc_4ee4_ada3_075d43ebdbe4.slice/crio-87aa549696af63f0d507e1caf3abd8656d454a07cb441ae6c5225233d87a1669 WatchSource:0}: Error finding container 87aa549696af63f0d507e1caf3abd8656d454a07cb441ae6c5225233d87a1669: Status 404 returned error can't find the container with id 87aa549696af63f0d507e1caf3abd8656d454a07cb441ae6c5225233d87a1669
Jul 14 21:52:16.057922 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:16.057895    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"]
Jul 14 21:52:16.059639 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:16.059611    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2848d22a_f2a7_43f7_abcc_eb55f4810d24.slice/crio-b5cedb91e9e13e4e29bd5814150e984194f6fd15e1671ff93b1c55c571600b2b WatchSource:0}: Error finding container b5cedb91e9e13e4e29bd5814150e984194f6fd15e1671ff93b1c55c571600b2b: Status 404 returned error can't find the container with id b5cedb91e9e13e4e29bd5814150e984194f6fd15e1671ff93b1c55c571600b2b
Jul 14 21:52:16.960693 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:16.960658    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kh8wx" event={"ID":"b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e","Type":"ContainerStarted","Data":"d729df86485a654c5014a202b503905f045a2b1680dc342e9c2c0b2aa4e84a34"}
Jul 14 21:52:16.963329 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:16.963296    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-f79ht" event={"ID":"c42f432c-25bc-4ee4-ada3-075d43ebdbe4","Type":"ContainerStarted","Data":"44fc77e50c06f861e5f3de5e033c391772a5f128b402ae1c875eea155063dec6"}
Jul 14 21:52:16.963505 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:16.963349    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-f79ht" event={"ID":"c42f432c-25bc-4ee4-ada3-075d43ebdbe4","Type":"ContainerStarted","Data":"87aa549696af63f0d507e1caf3abd8656d454a07cb441ae6c5225233d87a1669"}
Jul 14 21:52:16.965467 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:16.965436    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h" event={"ID":"2848d22a-f2a7-43f7-abcc-eb55f4810d24","Type":"ContainerStarted","Data":"b5cedb91e9e13e4e29bd5814150e984194f6fd15e1671ff93b1c55c571600b2b"}
Jul 14 21:52:16.979240 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:16.979152    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kh8wx" podStartSLOduration=34.122004292 podStartE2EDuration="40.9791071s" totalImagesPullingTime="6.857102808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 21:51:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:16.977923261 +0000 UTC m=+95.889762723" watchObservedRunningTime="2026-07-14 21:52:16.9791071 +0000 UTC m=+95.890946561"
Jul 14 21:52:19.979915 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:19.979881    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h" event={"ID":"2848d22a-f2a7-43f7-abcc-eb55f4810d24","Type":"ContainerStarted","Data":"949f4090e803bdd61750a9f8d195b959fa26310d46fd81ab6546e84728e4dfd3"}
Jul 14 21:52:19.980335 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:19.980073    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"
Jul 14 21:52:19.981729 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:19.981708    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h"
Jul 14 21:52:20.002882 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.002829    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-f79ht" podStartSLOduration=6.002809522 podStartE2EDuration="6.002809522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:16.994091191 +0000 UTC m=+95.905930675" watchObservedRunningTime="2026-07-14 21:52:20.002809522 +0000 UTC m=+98.914648961"
Jul 14 21:52:20.003563 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.003530    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74fd8f857b-ftk8h" podStartSLOduration=2.297812433 podStartE2EDuration="6.003521673s" totalImagesPullingTime="3.70570924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:52:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:20.002505822 +0000 UTC m=+98.914345283" watchObservedRunningTime="2026-07-14 21:52:20.003521673 +0000 UTC m=+98.915361134"
Jul 14 21:52:20.413658 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.413614    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:52:20.413856 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.413719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:52:20.416105 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.416078    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b54191fc-df69-4163-982d-4d527c25655e-metrics-tls\") pod \"dns-default-d44xw\" (UID: \"b54191fc-df69-4163-982d-4d527c25655e\") " pod="openshift-dns/dns-default-d44xw"
Jul 14 21:52:20.416264 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.416249    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls\") pod \"image-registry-64b9d68f48-zldd6\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") " pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:52:20.419647 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.419629    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2wg9m\""
Jul 14 21:52:20.428124 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.428079    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d44xw"
Jul 14 21:52:20.562796 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.562750    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d44xw"]
Jul 14 21:52:20.565537 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:20.565497    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54191fc_df69_4163_982d_4d527c25655e.slice/crio-fdbb0827b9b664407fcabd0cf1827535ad78d55e112d7f144a0f54aae3324ef0 WatchSource:0}: Error finding container fdbb0827b9b664407fcabd0cf1827535ad78d55e112d7f144a0f54aae3324ef0: Status 404 returned error can't find the container with id fdbb0827b9b664407fcabd0cf1827535ad78d55e112d7f144a0f54aae3324ef0
Jul 14 21:52:20.703165 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.703078    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dhwt6\""
Jul 14 21:52:20.710657 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.710631    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:52:20.849918 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.849883    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b9d68f48-zldd6"]
Jul 14 21:52:20.853124 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:20.853097    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd908e82_8390_4555_9096_adbe328eddb9.slice/crio-82256ae61a8992384d8ec020e9e6e5ce3219e3e3a5da015523eb9603d59bd4a7 WatchSource:0}: Error finding container 82256ae61a8992384d8ec020e9e6e5ce3219e3e3a5da015523eb9603d59bd4a7: Status 404 returned error can't find the container with id 82256ae61a8992384d8ec020e9e6e5ce3219e3e3a5da015523eb9603d59bd4a7
Jul 14 21:52:20.986147 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.986035    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b9d68f48-zldd6" event={"ID":"fd908e82-8390-4555-9096-adbe328eddb9","Type":"ContainerStarted","Data":"430c48a5d519ea7ae5dcf57d9c71db03d2e7d5c5af4a2e864da999785f954be2"}
Jul 14 21:52:20.986147 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.986110    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b9d68f48-zldd6" event={"ID":"fd908e82-8390-4555-9096-adbe328eddb9","Type":"ContainerStarted","Data":"82256ae61a8992384d8ec020e9e6e5ce3219e3e3a5da015523eb9603d59bd4a7"}
Jul 14 21:52:20.986642 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.986169    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:52:20.987589 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:20.987553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d44xw" event={"ID":"b54191fc-df69-4163-982d-4d527c25655e","Type":"ContainerStarted","Data":"fdbb0827b9b664407fcabd0cf1827535ad78d55e112d7f144a0f54aae3324ef0"}
Jul 14 21:52:21.013178 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:21.013117    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64b9d68f48-zldd6" podStartSLOduration=99.013093353 podStartE2EDuration="1m39.013093353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:50:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:21.011438611 +0000 UTC m=+99.923278073" watchObservedRunningTime="2026-07-14 21:52:21.013093353 +0000 UTC m=+99.924932817"
Jul 14 21:52:22.995564 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:22.995517    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d44xw" event={"ID":"b54191fc-df69-4163-982d-4d527c25655e","Type":"ContainerStarted","Data":"ec8924d14541b85c81205c141f30a544da86ef39a7a9ba1b056152f3b3352eb6"}
Jul 14 21:52:22.995985 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:22.995582    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d44xw" event={"ID":"b54191fc-df69-4163-982d-4d527c25655e","Type":"ContainerStarted","Data":"588c919dc8504616f637c1b59701ce5ffc23369e9440947e8bab8f1f6fd1cfb2"}
Jul 14 21:52:22.995985 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:22.995696    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d44xw"
Jul 14 21:52:23.015538 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:23.015483    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d44xw" podStartSLOduration=65.466937535 podStartE2EDuration="1m7.015463566s" totalImagesPullingTime="1.548526031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:23.014783234 +0000 UTC m=+101.926622695" watchObservedRunningTime="2026-07-14 21:52:23.015463566 +0000 UTC m=+101.927303026"
Jul 14 21:52:23.879502 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:23.879466    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dqdq4"
Jul 14 21:52:33.001603 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:33.001568    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d44xw"
Jul 14 21:52:37.443745 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:37.443702    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64b9d68f48-zldd6"]
Jul 14 21:52:37.448086 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:37.448061    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:52:38.655066 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.655033    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"]
Jul 14 21:52:38.658492 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.658471    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:38.666524 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.666496    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 14 21:52:38.666672 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.666574    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 14 21:52:38.667759 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.667744    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 21:52:38.667826 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.667776    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jjzqt\""
Jul 14 21:52:38.671877 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.671857    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"]
Jul 14 21:52:38.685708 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.685679    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ggbsx"]
Jul 14 21:52:38.688624 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.688596    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.691581 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.691555    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 21:52:38.691704 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.691562    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vxhfs\""
Jul 14 21:52:38.691926 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.691911    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 21:52:38.692326 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.692311    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 21:52:38.758923 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.758891    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c6da7c89-ff51-41f0-b1f7-ef2562be7777-root\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.758923 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.758927    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-tls\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.759188 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.758950    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6da7c89-ff51-41f0-b1f7-ef2562be7777-metrics-client-ca\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.759188 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.758987    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6da7c89-ff51-41f0-b1f7-ef2562be7777-sys\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.759188 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.759019    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbfd31bf-a993-411a-b286-7f5225bd7c0d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-m59rz\" (UID: \"fbfd31bf-a993-411a-b286-7f5225bd7c0d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:38.759188 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.759039    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-textfile\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.759188 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.759057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.759188 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.759083    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbfd31bf-a993-411a-b286-7f5225bd7c0d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-m59rz\" (UID: \"fbfd31bf-a993-411a-b286-7f5225bd7c0d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:38.759188 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.759098    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5p9t\" (UniqueName: \"kubernetes.io/projected/fbfd31bf-a993-411a-b286-7f5225bd7c0d-kube-api-access-g5p9t\") pod \"openshift-state-metrics-84bd68b896-m59rz\" (UID: \"fbfd31bf-a993-411a-b286-7f5225bd7c0d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:38.759188 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.759170    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbfd31bf-a993-411a-b286-7f5225bd7c0d-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-m59rz\" (UID: \"fbfd31bf-a993-411a-b286-7f5225bd7c0d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:38.759508 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.759222    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-wtmp\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.759508 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.759247    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29rkl\" (UniqueName: \"kubernetes.io/projected/c6da7c89-ff51-41f0-b1f7-ef2562be7777-kube-api-access-29rkl\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.759508 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.759283    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-accelerators-collector-config\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860008 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.859961    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-textfile\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860202 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860032    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860202 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbfd31bf-a993-411a-b286-7f5225bd7c0d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-m59rz\" (UID: \"fbfd31bf-a993-411a-b286-7f5225bd7c0d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:38.860202 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5p9t\" (UniqueName: \"kubernetes.io/projected/fbfd31bf-a993-411a-b286-7f5225bd7c0d-kube-api-access-g5p9t\") pod \"openshift-state-metrics-84bd68b896-m59rz\" (UID: \"fbfd31bf-a993-411a-b286-7f5225bd7c0d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:38.860202 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860129    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbfd31bf-a993-411a-b286-7f5225bd7c0d-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-m59rz\" (UID: \"fbfd31bf-a993-411a-b286-7f5225bd7c0d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:38.860202 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-wtmp\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860202 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860186    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29rkl\" (UniqueName: \"kubernetes.io/projected/c6da7c89-ff51-41f0-b1f7-ef2562be7777-kube-api-access-29rkl\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860486 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860344    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-textfile\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860486 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860399    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-accelerators-collector-config\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860486 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860474    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-wtmp\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860643 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860487    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c6da7c89-ff51-41f0-b1f7-ef2562be7777-root\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860643 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-tls\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860643 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860576    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c6da7c89-ff51-41f0-b1f7-ef2562be7777-root\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860643 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:52:38.860598    2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 14 21:52:38.860643 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860624    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6da7c89-ff51-41f0-b1f7-ef2562be7777-metrics-client-ca\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860878 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6da7c89-ff51-41f0-b1f7-ef2562be7777-sys\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860878 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbfd31bf-a993-411a-b286-7f5225bd7c0d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-m59rz\" (UID: \"fbfd31bf-a993-411a-b286-7f5225bd7c0d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:38.860878 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6da7c89-ff51-41f0-b1f7-ef2562be7777-sys\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.860878 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:52:38.860815    2583 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 14 21:52:38.861107 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:52:38.860898    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbfd31bf-a993-411a-b286-7f5225bd7c0d-openshift-state-metrics-tls podName:fbfd31bf-a993-411a-b286-7f5225bd7c0d nodeName:}" failed. No retries permitted until 2026-07-14 21:52:39.360878925 +0000 UTC m=+118.272718367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fbfd31bf-a993-411a-b286-7f5225bd7c0d-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-m59rz" (UID: "fbfd31bf-a993-411a-b286-7f5225bd7c0d") : secret "openshift-state-metrics-tls" not found
Jul 14 21:52:38.861107 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.860926    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbfd31bf-a993-411a-b286-7f5225bd7c0d-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-m59rz\" (UID: \"fbfd31bf-a993-411a-b286-7f5225bd7c0d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:38.861107 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.861050    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-accelerators-collector-config\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.861270 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.861220    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6da7c89-ff51-41f0-b1f7-ef2562be7777-metrics-client-ca\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.861334 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:52:38.861308    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-tls podName:c6da7c89-ff51-41f0-b1f7-ef2562be7777 nodeName:}" failed. No retries permitted until 2026-07-14 21:52:39.361290107 +0000 UTC m=+118.273129552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-tls") pod "node-exporter-ggbsx" (UID: "c6da7c89-ff51-41f0-b1f7-ef2562be7777") : secret "node-exporter-tls" not found
Jul 14 21:52:38.862603 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.862580    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.862921 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.862903    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbfd31bf-a993-411a-b286-7f5225bd7c0d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-m59rz\" (UID: \"fbfd31bf-a993-411a-b286-7f5225bd7c0d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:38.869341 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.869320    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29rkl\" (UniqueName: \"kubernetes.io/projected/c6da7c89-ff51-41f0-b1f7-ef2562be7777-kube-api-access-29rkl\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:38.869454 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:38.869326    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5p9t\" (UniqueName: \"kubernetes.io/projected/fbfd31bf-a993-411a-b286-7f5225bd7c0d-kube-api-access-g5p9t\") pod \"openshift-state-metrics-84bd68b896-m59rz\" (UID: \"fbfd31bf-a993-411a-b286-7f5225bd7c0d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:39.365296 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:39.365260    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-tls\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:39.365482 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:39.365310    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbfd31bf-a993-411a-b286-7f5225bd7c0d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-m59rz\" (UID: \"fbfd31bf-a993-411a-b286-7f5225bd7c0d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:39.367699 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:39.367675    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c6da7c89-ff51-41f0-b1f7-ef2562be7777-node-exporter-tls\") pod \"node-exporter-ggbsx\" (UID: \"c6da7c89-ff51-41f0-b1f7-ef2562be7777\") " pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:39.367895 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:39.367873    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbfd31bf-a993-411a-b286-7f5225bd7c0d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-m59rz\" (UID: \"fbfd31bf-a993-411a-b286-7f5225bd7c0d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:39.567398 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:39.567355    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"
Jul 14 21:52:39.598184 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:39.598149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ggbsx"
Jul 14 21:52:39.608739 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:39.608702    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6da7c89_ff51_41f0_b1f7_ef2562be7777.slice/crio-0ce3b30e367ed8b1bc584b281a3021bd20c532e9762b0da7f2852a9431077889 WatchSource:0}: Error finding container 0ce3b30e367ed8b1bc584b281a3021bd20c532e9762b0da7f2852a9431077889: Status 404 returned error can't find the container with id 0ce3b30e367ed8b1bc584b281a3021bd20c532e9762b0da7f2852a9431077889
Jul 14 21:52:39.717942 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:39.717914    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz"]
Jul 14 21:52:39.720076 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:39.720046    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbfd31bf_a993_411a_b286_7f5225bd7c0d.slice/crio-655548aaffe22c6834d9efbf47cbbecdfcf6b3cb716565d5392a62d7acf6d4ae WatchSource:0}: Error finding container 655548aaffe22c6834d9efbf47cbbecdfcf6b3cb716565d5392a62d7acf6d4ae: Status 404 returned error can't find the container with id 655548aaffe22c6834d9efbf47cbbecdfcf6b3cb716565d5392a62d7acf6d4ae
Jul 14 21:52:40.052340 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.052304    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz" event={"ID":"fbfd31bf-a993-411a-b286-7f5225bd7c0d","Type":"ContainerStarted","Data":"6a551f7a627f491f543dff2d114442312510b1595b00e21097053eaf3151846d"}
Jul 14 21:52:40.052512 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.052385    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz" event={"ID":"fbfd31bf-a993-411a-b286-7f5225bd7c0d","Type":"ContainerStarted","Data":"b04fa7e23e825de639e4c740c37b488f34c48cac2aea1b020d438ef5cc1d5463"}
Jul 14 21:52:40.052512 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.052412    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz" event={"ID":"fbfd31bf-a993-411a-b286-7f5225bd7c0d","Type":"ContainerStarted","Data":"655548aaffe22c6834d9efbf47cbbecdfcf6b3cb716565d5392a62d7acf6d4ae"}
Jul 14 21:52:40.053896 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.053830    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggbsx" event={"ID":"c6da7c89-ff51-41f0-b1f7-ef2562be7777","Type":"ContainerStarted","Data":"0ce3b30e367ed8b1bc584b281a3021bd20c532e9762b0da7f2852a9431077889"}
Jul 14 21:52:40.639437 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.639401    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-75f887f58-rv5bd"]
Jul 14 21:52:40.642256 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.642231    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.645024 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.644981    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 14 21:52:40.645262 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.645243    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jfbwr\""
Jul 14 21:52:40.645413 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.645264    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 14 21:52:40.645413 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.645363    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 14 21:52:40.645413 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.645246    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 14 21:52:40.646466 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.646441    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 14 21:52:40.646560 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.646513    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5bi8cr34teris\""
Jul 14 21:52:40.659831 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.659747    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75f887f58-rv5bd"]
Jul 14 21:52:40.677431 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.677401    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.677431 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.677438    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-tls\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.677701 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.677467    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4dhd\" (UniqueName: \"kubernetes.io/projected/bb2651a3-5d90-4e91-84f5-9c545d2c080d-kube-api-access-p4dhd\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.677701 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.677565    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.677701 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.677597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-grpc-tls\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.677701 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.677620    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.677701 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.677642    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.677933 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.677725    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb2651a3-5d90-4e91-84f5-9c545d2c080d-metrics-client-ca\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.778693 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.778656    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.779203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.778708    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-grpc-tls\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.779203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.778738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.779203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.778766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.779203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.778808    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb2651a3-5d90-4e91-84f5-9c545d2c080d-metrics-client-ca\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.779203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.778879    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.779203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.778911    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-tls\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.779203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.778942    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4dhd\" (UniqueName: \"kubernetes.io/projected/bb2651a3-5d90-4e91-84f5-9c545d2c080d-kube-api-access-p4dhd\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.780274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.780221    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb2651a3-5d90-4e91-84f5-9c545d2c080d-metrics-client-ca\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.781687 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.781661    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.781813 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.781797    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.782038 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.782014    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-grpc-tls\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.782516 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.782474    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.782516 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.782483    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-tls\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.782639 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.782600    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/bb2651a3-5d90-4e91-84f5-9c545d2c080d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.789158 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.789131    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4dhd\" (UniqueName: \"kubernetes.io/projected/bb2651a3-5d90-4e91-84f5-9c545d2c080d-kube-api-access-p4dhd\") pod \"thanos-querier-75f887f58-rv5bd\" (UID: \"bb2651a3-5d90-4e91-84f5-9c545d2c080d\") " pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:40.954200 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:40.954162    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:41.066723 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:41.066674    2583 generic.go:356] "Generic (PLEG): container finished" podID="c6da7c89-ff51-41f0-b1f7-ef2562be7777" containerID="04b9e73eb9e4c2b8586a2f488aee7b124d3f5499c0c5c6236adc68003f52a9f5" exitCode=0
Jul 14 21:52:41.066908 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:41.066775    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggbsx" event={"ID":"c6da7c89-ff51-41f0-b1f7-ef2562be7777","Type":"ContainerDied","Data":"04b9e73eb9e4c2b8586a2f488aee7b124d3f5499c0c5c6236adc68003f52a9f5"}
Jul 14 21:52:41.069344 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:41.069314    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz" event={"ID":"fbfd31bf-a993-411a-b286-7f5225bd7c0d","Type":"ContainerStarted","Data":"e65992d4deb901f677b07247f0934c63c9530d964be7673ad01179ae535ee471"}
Jul 14 21:52:41.106328 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:41.106266    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m59rz" podStartSLOduration=2.087521074 podStartE2EDuration="3.106244497s" totalImagesPullingTime="1.018723423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:41.105948556 +0000 UTC m=+120.017788026" watchObservedRunningTime="2026-07-14 21:52:41.106244497 +0000 UTC m=+120.018083958"
Jul 14 21:52:41.113461 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:41.113314    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75f887f58-rv5bd"]
Jul 14 21:52:41.125865 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:41.125834    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2651a3_5d90_4e91_84f5_9c545d2c080d.slice/crio-fbf89a9b907458735726befada153812e05762b9ee46c7905d0662da874041c9 WatchSource:0}: Error finding container fbf89a9b907458735726befada153812e05762b9ee46c7905d0662da874041c9: Status 404 returned error can't find the container with id fbf89a9b907458735726befada153812e05762b9ee46c7905d0662da874041c9
Jul 14 21:52:42.074325 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:42.074285    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd" event={"ID":"bb2651a3-5d90-4e91-84f5-9c545d2c080d","Type":"ContainerStarted","Data":"fbf89a9b907458735726befada153812e05762b9ee46c7905d0662da874041c9"}
Jul 14 21:52:42.077286 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:42.076661    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggbsx" event={"ID":"c6da7c89-ff51-41f0-b1f7-ef2562be7777","Type":"ContainerStarted","Data":"83a6aaa86221eee051d084d4108d45b075c24383b89046f93215a322b6e289db"}
Jul 14 21:52:42.077286 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:42.077111    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggbsx" event={"ID":"c6da7c89-ff51-41f0-b1f7-ef2562be7777","Type":"ContainerStarted","Data":"59ece0a324f65cc273732fa3081cb633bc8a7862f43ec3fa5067a00bd7a0f3d6"}
Jul 14 21:52:42.101030 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:42.100951    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ggbsx" podStartSLOduration=3.086341965 podStartE2EDuration="4.100929995s" totalImagesPullingTime="937.542404ms" totalInitContainerRuntime="77.045626ms" isStatefulPod=true podCreationTimestamp="2026-07-14 21:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:42.099017442 +0000 UTC m=+121.010856920" watchObservedRunningTime="2026-07-14 21:52:42.100929995 +0000 UTC m=+121.012769457"
Jul 14 21:52:43.050482 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.050440    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"]
Jul 14 21:52:43.052901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.052878    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.057074 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.057045    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 14 21:52:43.057220 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.057089    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nlkjk\""
Jul 14 21:52:43.057220 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.057126    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 14 21:52:43.057220 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.057094    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-54uc83kbct7m1\""
Jul 14 21:52:43.057492 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.057473    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 14 21:52:43.057591 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.057530    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 14 21:52:43.068672 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.068639    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"]
Jul 14 21:52:43.100231 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.100198    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-secret-metrics-server-client-certs\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.100699 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.100237    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-audit-log\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.100699 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.100272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-metrics-server-audit-profiles\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.100699 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.100421    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjxpt\" (UniqueName: \"kubernetes.io/projected/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-kube-api-access-bjxpt\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.100699 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.100450    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.100699 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.100481    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-client-ca-bundle\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.100699 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.100565    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-secret-metrics-server-tls\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.201835 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.201792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjxpt\" (UniqueName: \"kubernetes.io/projected/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-kube-api-access-bjxpt\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.202064 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.201850    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.202064 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.202007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-client-ca-bundle\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.202064 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.202056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-secret-metrics-server-tls\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.202247 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.202223    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-secret-metrics-server-client-certs\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.202333 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.202273    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-audit-log\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.202333 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.202301    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-metrics-server-audit-profiles\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.202677 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.202652    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.202767 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.202697    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-audit-log\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.203306 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.203281    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-metrics-server-audit-profiles\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.205259 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.205217    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-secret-metrics-server-tls\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.205381 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.205357    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-secret-metrics-server-client-certs\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.205453 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.205404    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-client-ca-bundle\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.211763 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.211736    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjxpt\" (UniqueName: \"kubernetes.io/projected/ca31f28d-7d36-4a4a-bec0-1eabf96c6d25-kube-api-access-bjxpt\") pod \"metrics-server-6b659b4f5f-wdlpf\" (UID: \"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25\") " pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.363455 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.363332    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:52:43.536097 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.536060    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"]
Jul 14 21:52:43.539221 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:43.539193    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca31f28d_7d36_4a4a_bec0_1eabf96c6d25.slice/crio-dcef33d696866c0049b18b6f27a7a06dbb1c42f51a739731bf341539319f7283 WatchSource:0}: Error finding container dcef33d696866c0049b18b6f27a7a06dbb1c42f51a739731bf341539319f7283: Status 404 returned error can't find the container with id dcef33d696866c0049b18b6f27a7a06dbb1c42f51a739731bf341539319f7283
Jul 14 21:52:43.784838 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.784755    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"]
Jul 14 21:52:43.793747 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.793725    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:43.797074 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.797050    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 14 21:52:43.797326 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.797305    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 14 21:52:43.797422 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.797320    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 14 21:52:43.797714 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.797701    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 14 21:52:43.797922 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.797909    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vwv8h\""
Jul 14 21:52:43.798331 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.798316    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 14 21:52:43.802967 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.802939    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 14 21:52:43.804456 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.804434    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"]
Jul 14 21:52:43.908616 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.908580    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba80b577-be74-43cd-ac44-7d9aa37b5e02-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:43.908788 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.908631    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba80b577-be74-43cd-ac44-7d9aa37b5e02-serving-certs-ca-bundle\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:43.908788 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.908652    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba80b577-be74-43cd-ac44-7d9aa37b5e02-metrics-client-ca\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:43.908788 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.908695    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mslbz\" (UniqueName: \"kubernetes.io/projected/ba80b577-be74-43cd-ac44-7d9aa37b5e02-kube-api-access-mslbz\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:43.908788 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.908748    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba80b577-be74-43cd-ac44-7d9aa37b5e02-federate-client-tls\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:43.908920 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.908797    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba80b577-be74-43cd-ac44-7d9aa37b5e02-telemeter-client-tls\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:43.908920 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.908848    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba80b577-be74-43cd-ac44-7d9aa37b5e02-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:43.908920 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:43.908869    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba80b577-be74-43cd-ac44-7d9aa37b5e02-secret-telemeter-client\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.010219 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.010163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba80b577-be74-43cd-ac44-7d9aa37b5e02-federate-client-tls\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.010393 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.010283    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba80b577-be74-43cd-ac44-7d9aa37b5e02-telemeter-client-tls\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.010393 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.010319    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba80b577-be74-43cd-ac44-7d9aa37b5e02-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.010393 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.010349    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba80b577-be74-43cd-ac44-7d9aa37b5e02-secret-telemeter-client\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.010556 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.010429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba80b577-be74-43cd-ac44-7d9aa37b5e02-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.010556 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.010472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba80b577-be74-43cd-ac44-7d9aa37b5e02-serving-certs-ca-bundle\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.010556 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.010502    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba80b577-be74-43cd-ac44-7d9aa37b5e02-metrics-client-ca\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.010556 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.010540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mslbz\" (UniqueName: \"kubernetes.io/projected/ba80b577-be74-43cd-ac44-7d9aa37b5e02-kube-api-access-mslbz\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.011505 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.011457    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba80b577-be74-43cd-ac44-7d9aa37b5e02-serving-certs-ca-bundle\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.011629 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.011592    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba80b577-be74-43cd-ac44-7d9aa37b5e02-metrics-client-ca\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.011629 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.011607    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba80b577-be74-43cd-ac44-7d9aa37b5e02-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.013096 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.013067    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba80b577-be74-43cd-ac44-7d9aa37b5e02-telemeter-client-tls\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.013200 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.013070    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba80b577-be74-43cd-ac44-7d9aa37b5e02-secret-telemeter-client\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.013200 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.013150    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba80b577-be74-43cd-ac44-7d9aa37b5e02-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.013274 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.013213    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba80b577-be74-43cd-ac44-7d9aa37b5e02-federate-client-tls\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.018698 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.018679    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mslbz\" (UniqueName: \"kubernetes.io/projected/ba80b577-be74-43cd-ac44-7d9aa37b5e02-kube-api-access-mslbz\") pod \"telemeter-client-6fdfd8d658-gftb6\" (UID: \"ba80b577-be74-43cd-ac44-7d9aa37b5e02\") " pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.086487 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.086446    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf" event={"ID":"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25","Type":"ContainerStarted","Data":"dcef33d696866c0049b18b6f27a7a06dbb1c42f51a739731bf341539319f7283"}
Jul 14 21:52:44.089057 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.089020    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd" event={"ID":"bb2651a3-5d90-4e91-84f5-9c545d2c080d","Type":"ContainerStarted","Data":"a98a0615596942cb92f3f34e607c58af11479c8d4a6ee28b0108bbddb256708e"}
Jul 14 21:52:44.089219 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.089105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd" event={"ID":"bb2651a3-5d90-4e91-84f5-9c545d2c080d","Type":"ContainerStarted","Data":"0abf041b0d86e432a38e27b9f811b3dac787b574b7ed2994889cbc76dc5f74a7"}
Jul 14 21:52:44.089219 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.089145    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd" event={"ID":"bb2651a3-5d90-4e91-84f5-9c545d2c080d","Type":"ContainerStarted","Data":"50ea1c1283dca5cd75cee7225af2166a987946a02b1b7c7d447c84e24f1b35e3"}
Jul 14 21:52:44.104346 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.104308    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"
Jul 14 21:52:44.275805 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.275725    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6fdfd8d658-gftb6"]
Jul 14 21:52:44.279658 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:44.279616    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba80b577_be74_43cd_ac44_7d9aa37b5e02.slice/crio-d11ae13cfe85b6af08c3dfe885d202c2743b00d738ffa81a5326f6a21fa80ce0 WatchSource:0}: Error finding container d11ae13cfe85b6af08c3dfe885d202c2743b00d738ffa81a5326f6a21fa80ce0: Status 404 returned error can't find the container with id d11ae13cfe85b6af08c3dfe885d202c2743b00d738ffa81a5326f6a21fa80ce0
Jul 14 21:52:44.842889 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.842854    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 21:52:44.856805 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.856764    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.860132 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.860073    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 14 21:52:44.860307 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.860271    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 14 21:52:44.860691 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.860662    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 14 21:52:44.860965 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.860904    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 14 21:52:44.861319 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.861297    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 14 21:52:44.861426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.861391    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 14 21:52:44.861426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.861407    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ppgj5\""
Jul 14 21:52:44.861541 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.861508    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 14 21:52:44.861852 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.861726    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 14 21:52:44.861852 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.861734    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 14 21:52:44.861852 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.861757    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d616nqj44u5uh\""
Jul 14 21:52:44.862149 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.862131    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 14 21:52:44.862445 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.862379    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 14 21:52:44.862628 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.862608    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 14 21:52:44.864800 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.864777    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 14 21:52:44.868957 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.868863    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 21:52:44.869913 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.869893    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 14 21:52:44.919422 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919375    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-config-out\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.919611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919431    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.919611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.919611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919557    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-web-config\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.919611 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919586    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbgmj\" (UniqueName: \"kubernetes.io/projected/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-kube-api-access-qbgmj\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.919813 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919614    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.919813 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.919813 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919682    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.919813 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919707    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.919813 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919729    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.919813 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919764    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.920111 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919816    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.920111 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919866    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-config\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.920111 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919893    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.920111 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.920111 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919951    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.920111 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.919975    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.920111 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.920021    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.920111 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.920078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:44.920111 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:44.920107    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.021088 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.021452 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021117    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.021452 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021152    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.021452 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021180    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-config-out\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.021452 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021205    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.021452 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021228    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.021452 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021257    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-web-config\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.021452 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021296    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbgmj\" (UniqueName: \"kubernetes.io/projected/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-kube-api-access-qbgmj\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.021452 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.021452 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021383    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.021452 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.021452 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021432    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.021452 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021453    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.022088 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021484    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.022088 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021536    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.022088 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-config\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.022088 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.022088 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021645    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.022088 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.022088 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021709    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.022088 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.021883    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.022507 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.022320    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.022507 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.022440    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.022847 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.022740    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.023239 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.023210    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.025973 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.025172    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.025973 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.025473    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.025973 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.025514    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.025973 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.025613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-web-config\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.025973 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.025665    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.025973 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.025699    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-config-out\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.025973 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.025808    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.025973 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.025922    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.027006 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.026962    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.027153 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.027118    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.027265 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.027214    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.027607 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.027584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-config\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.027820 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.027779    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.027961 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.027939    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.029775 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.029759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbgmj\" (UniqueName: \"kubernetes.io/projected/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-kube-api-access-qbgmj\") pod \"prometheus-k8s-0\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.094390 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.094301    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6" event={"ID":"ba80b577-be74-43cd-ac44-7d9aa37b5e02","Type":"ContainerStarted","Data":"d11ae13cfe85b6af08c3dfe885d202c2743b00d738ffa81a5326f6a21fa80ce0"}
Jul 14 21:52:45.170930 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.170889    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:52:45.631015 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:45.630904    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 21:52:45.631683 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:45.631659    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1888aaae_5b7b_4fae_93d5_1c88151d8ddb.slice/crio-b1c9250ccdf3fbff7ad4325f3d7bc5a2455ac8e043c6652e9467d13c2ef19650 WatchSource:0}: Error finding container b1c9250ccdf3fbff7ad4325f3d7bc5a2455ac8e043c6652e9467d13c2ef19650: Status 404 returned error can't find the container with id b1c9250ccdf3fbff7ad4325f3d7bc5a2455ac8e043c6652e9467d13c2ef19650
Jul 14 21:52:46.099800 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:46.099762    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf" event={"ID":"ca31f28d-7d36-4a4a-bec0-1eabf96c6d25","Type":"ContainerStarted","Data":"dcf5af04ccabc9c96b2bb6081aa2e28b1b6648c1ba33affe1ab2f5a607cde752"}
Jul 14 21:52:46.103166 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:46.103112    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd" event={"ID":"bb2651a3-5d90-4e91-84f5-9c545d2c080d","Type":"ContainerStarted","Data":"92ac1f108829f5d9b49602f5b433b69484a01d43f9aa3851545c54531b11fa60"}
Jul 14 21:52:46.103342 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:46.103186    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd" event={"ID":"bb2651a3-5d90-4e91-84f5-9c545d2c080d","Type":"ContainerStarted","Data":"658e66ca6addff6ee8ea3c9e953557df4e41a4c2b01c2cac9a42d7906b15c35f"}
Jul 14 21:52:46.103342 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:46.103235    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:46.103467 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:46.103407    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd" event={"ID":"bb2651a3-5d90-4e91-84f5-9c545d2c080d","Type":"ContainerStarted","Data":"113fcd77daef56fe2327f4240e7db3a46dac9bcdfb4072cf2cd988054212e1af"}
Jul 14 21:52:46.104733 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:46.104713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerStarted","Data":"b1c9250ccdf3fbff7ad4325f3d7bc5a2455ac8e043c6652e9467d13c2ef19650"}
Jul 14 21:52:46.118584 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:46.118508    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf" podStartSLOduration=1.193579403 podStartE2EDuration="3.118485426s" totalImagesPullingTime="1.924906023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:46.117503101 +0000 UTC m=+125.029342576" watchObservedRunningTime="2026-07-14 21:52:46.118485426 +0000 UTC m=+125.030324888"
Jul 14 21:52:46.143029 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:46.142944    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd" podStartSLOduration=1.998472501 podStartE2EDuration="6.142926551s" totalImagesPullingTime="4.14445405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:52:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:46.142319707 +0000 UTC m=+125.054159171" watchObservedRunningTime="2026-07-14 21:52:46.142926551 +0000 UTC m=+125.054766018"
Jul 14 21:52:47.110456 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:47.110363    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6" event={"ID":"ba80b577-be74-43cd-ac44-7d9aa37b5e02","Type":"ContainerStarted","Data":"d1af9b9d437688d6ce2b40b55fc17479316c130a5e4fd073c542f0d4d32ad008"}
Jul 14 21:52:48.115525 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:48.115493    2583 generic.go:356] "Generic (PLEG): container finished" podID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerID="cea76044ade5c8358cb683544489ae845cc0e341a780aee8abb439548bfc1385" exitCode=0
Jul 14 21:52:48.115940 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:48.115587    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerDied","Data":"cea76044ade5c8358cb683544489ae845cc0e341a780aee8abb439548bfc1385"}
Jul 14 21:52:48.117838 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:48.117816    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6" event={"ID":"ba80b577-be74-43cd-ac44-7d9aa37b5e02","Type":"ContainerStarted","Data":"b71c2949d8665f12f7c0b66c4d4e006b6aa7a00f4153486b422962890f548857"}
Jul 14 21:52:48.117913 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:48.117860    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6" event={"ID":"ba80b577-be74-43cd-ac44-7d9aa37b5e02","Type":"ContainerStarted","Data":"8a209a9785cc2893b2d81733d3b07e2c76fa1083084ad98edac504cb0d7098be"}
Jul 14 21:52:48.181147 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:48.180975    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6fdfd8d658-gftb6" podStartSLOduration=1.849930268 podStartE2EDuration="5.180952708s" totalImagesPullingTime="3.33102244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:52:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:48.17863019 +0000 UTC m=+127.090469651" watchObservedRunningTime="2026-07-14 21:52:48.180952708 +0000 UTC m=+127.092792170"
Jul 14 21:52:51.488967 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:51.488923    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:52:51.491813 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:51.491780    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/675d03c4-b4d9-4d6f-8114-fde0d6206464-metrics-certs\") pod \"network-metrics-daemon-dnx2s\" (UID: \"675d03c4-b4d9-4d6f-8114-fde0d6206464\") " pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:52:51.692246 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:51.692220    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l5sfp\""
Jul 14 21:52:51.699508 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:51.699487    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dnx2s"
Jul 14 21:52:51.855497 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:51.855432    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dnx2s"]
Jul 14 21:52:51.857456 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:52:51.857410    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675d03c4_b4d9_4d6f_8114_fde0d6206464.slice/crio-e467b2f7a59932c8a59cc495ecb3d6ddc88108c0a656823c1ce08dda08086833 WatchSource:0}: Error finding container e467b2f7a59932c8a59cc495ecb3d6ddc88108c0a656823c1ce08dda08086833: Status 404 returned error can't find the container with id e467b2f7a59932c8a59cc495ecb3d6ddc88108c0a656823c1ce08dda08086833
Jul 14 21:52:52.116582 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:52.116447    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-75f887f58-rv5bd"
Jul 14 21:52:52.137952 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:52.137909    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerStarted","Data":"f17f8234ccc22557c2b6cc40685ea272776d51cac0032319395caa7f9ff78760"}
Jul 14 21:52:52.138159 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:52.138026    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerStarted","Data":"61b59dd4206d7c7ec95a97f4afbfe9497714282978eb6f21d41058d8aa5df4be"}
Jul 14 21:52:52.138159 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:52.138072    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerStarted","Data":"9ecaea6e4a9aa1a3cdc97f6b3035a0f9a42f1a4f33c2b1382d644973e380589b"}
Jul 14 21:52:52.138159 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:52.138113    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerStarted","Data":"b0c2aed93b3e3203d50dcb86438ecfac0d160ab13359a52acea07af50df5bcd3"}
Jul 14 21:52:52.138159 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:52.138153    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerStarted","Data":"510163770fdf584fc1ddc1d6da5ccf6a4d286c1ab29a60951000fa2f40fcdab2"}
Jul 14 21:52:52.139890 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:52.139862    2583 generic.go:356] "Generic (PLEG): container finished" podID="abec354f-45af-43a7-a75b-dd4f722fa7f5" containerID="3b123a50c25eb2c331b637b43eebe5a3f759d8e0c30b59cb756fe95bfe8431b8" exitCode=0
Jul 14 21:52:52.140041 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:52.139938    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6" event={"ID":"abec354f-45af-43a7-a75b-dd4f722fa7f5","Type":"ContainerDied","Data":"3b123a50c25eb2c331b637b43eebe5a3f759d8e0c30b59cb756fe95bfe8431b8"}
Jul 14 21:52:52.140403 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:52.140372    2583 scope.go:117] "RemoveContainer" containerID="3b123a50c25eb2c331b637b43eebe5a3f759d8e0c30b59cb756fe95bfe8431b8"
Jul 14 21:52:52.141321 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:52.141294    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnx2s" event={"ID":"675d03c4-b4d9-4d6f-8114-fde0d6206464","Type":"ContainerStarted","Data":"e467b2f7a59932c8a59cc495ecb3d6ddc88108c0a656823c1ce08dda08086833"}
Jul 14 21:52:53.148210 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:53.148165    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xb9m6" event={"ID":"abec354f-45af-43a7-a75b-dd4f722fa7f5","Type":"ContainerStarted","Data":"71a29c8f4740f289165c3a9235c82f564ce9e45a965d6078b04c12878ccd813c"}
Jul 14 21:52:53.151426 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:53.151399    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerStarted","Data":"d0aab6ed3477e2deff0aca69160e3ec8bd8e91cf8fa5d3bb553120e2abcd4908"}
Jul 14 21:52:53.198122 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:53.198038    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.538817332 podStartE2EDuration="9.19801557s" totalImagesPullingTime="5.632652858s" totalInitContainerRuntime="26.54538ms" isStatefulPod=false podCreationTimestamp="2026-07-14 21:52:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:53.196245377 +0000 UTC m=+132.108084838" watchObservedRunningTime="2026-07-14 21:52:53.19801557 +0000 UTC m=+132.109855034"
Jul 14 21:52:54.157634 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:54.157600    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnx2s" event={"ID":"675d03c4-b4d9-4d6f-8114-fde0d6206464","Type":"ContainerStarted","Data":"76a23ae5a0cda4915cd2e8ee5058553b54f74cac0e3379ab4a913c285c74eba1"}
Jul 14 21:52:54.158030 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:54.157683    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dnx2s" event={"ID":"675d03c4-b4d9-4d6f-8114-fde0d6206464","Type":"ContainerStarted","Data":"ce57d2a9024bf91d0095f75797d04ff8cd3c3946bf209aa6121474e45db1dfd3"}
Jul 14 21:52:54.176049 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:54.175971    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dnx2s" podStartSLOduration=130.546501586 podStartE2EDuration="2m12.175955511s" totalImagesPullingTime="1.629453925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:52:54.175546775 +0000 UTC m=+133.087386238" watchObservedRunningTime="2026-07-14 21:52:54.175955511 +0000 UTC m=+133.087794971"
Jul 14 21:52:55.171174 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:52:55.171126    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:53:02.463820 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.463773    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64b9d68f48-zldd6" podUID="fd908e82-8390-4555-9096-adbe328eddb9" containerName="registry" containerID="cri-o://430c48a5d519ea7ae5dcf57d9c71db03d2e7d5c5af4a2e864da999785f954be2" gracePeriod=30
Jul 14 21:53:02.708976 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.708951    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:53:02.793541 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.793443    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd908e82-8390-4555-9096-adbe328eddb9-image-registry-private-configuration\") pod \"fd908e82-8390-4555-9096-adbe328eddb9\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") "
Jul 14 21:53:02.793541 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.793491    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd908e82-8390-4555-9096-adbe328eddb9-installation-pull-secrets\") pod \"fd908e82-8390-4555-9096-adbe328eddb9\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") "
Jul 14 21:53:02.793769 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.793553    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd908e82-8390-4555-9096-adbe328eddb9-trusted-ca\") pod \"fd908e82-8390-4555-9096-adbe328eddb9\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") "
Jul 14 21:53:02.793769 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.793584    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-bound-sa-token\") pod \"fd908e82-8390-4555-9096-adbe328eddb9\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") "
Jul 14 21:53:02.793769 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.793611    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2sdj\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-kube-api-access-w2sdj\") pod \"fd908e82-8390-4555-9096-adbe328eddb9\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") "
Jul 14 21:53:02.793769 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.793639    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd908e82-8390-4555-9096-adbe328eddb9-registry-certificates\") pod \"fd908e82-8390-4555-9096-adbe328eddb9\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") "
Jul 14 21:53:02.793769 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.793677    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd908e82-8390-4555-9096-adbe328eddb9-ca-trust-extracted\") pod \"fd908e82-8390-4555-9096-adbe328eddb9\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") "
Jul 14 21:53:02.793769 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.793706    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls\") pod \"fd908e82-8390-4555-9096-adbe328eddb9\" (UID: \"fd908e82-8390-4555-9096-adbe328eddb9\") "
Jul 14 21:53:02.794099 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.794064    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd908e82-8390-4555-9096-adbe328eddb9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fd908e82-8390-4555-9096-adbe328eddb9" (UID: "fd908e82-8390-4555-9096-adbe328eddb9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:53:02.794374 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.794343    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd908e82-8390-4555-9096-adbe328eddb9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fd908e82-8390-4555-9096-adbe328eddb9" (UID: "fd908e82-8390-4555-9096-adbe328eddb9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:53:02.796298 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.796256    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-kube-api-access-w2sdj" (OuterVolumeSpecName: "kube-api-access-w2sdj") pod "fd908e82-8390-4555-9096-adbe328eddb9" (UID: "fd908e82-8390-4555-9096-adbe328eddb9"). InnerVolumeSpecName "kube-api-access-w2sdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 21:53:02.796450 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.796345    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fd908e82-8390-4555-9096-adbe328eddb9" (UID: "fd908e82-8390-4555-9096-adbe328eddb9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 21:53:02.796450 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.796344    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd908e82-8390-4555-9096-adbe328eddb9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fd908e82-8390-4555-9096-adbe328eddb9" (UID: "fd908e82-8390-4555-9096-adbe328eddb9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:53:02.796450 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.796417    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd908e82-8390-4555-9096-adbe328eddb9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fd908e82-8390-4555-9096-adbe328eddb9" (UID: "fd908e82-8390-4555-9096-adbe328eddb9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:53:02.796563 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.796516    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fd908e82-8390-4555-9096-adbe328eddb9" (UID: "fd908e82-8390-4555-9096-adbe328eddb9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 21:53:02.802326 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.802301    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd908e82-8390-4555-9096-adbe328eddb9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fd908e82-8390-4555-9096-adbe328eddb9" (UID: "fd908e82-8390-4555-9096-adbe328eddb9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 21:53:02.895203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.895165    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fd908e82-8390-4555-9096-adbe328eddb9-trusted-ca\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:53:02.895203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.895195    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-bound-sa-token\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:53:02.895203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.895205    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2sdj\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-kube-api-access-w2sdj\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:53:02.895203 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.895215    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fd908e82-8390-4555-9096-adbe328eddb9-registry-certificates\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:53:02.895599 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.895224    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fd908e82-8390-4555-9096-adbe328eddb9-ca-trust-extracted\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:53:02.895599 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.895233    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fd908e82-8390-4555-9096-adbe328eddb9-registry-tls\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:53:02.895599 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.895243    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fd908e82-8390-4555-9096-adbe328eddb9-image-registry-private-configuration\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:53:02.895599 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:02.895252    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fd908e82-8390-4555-9096-adbe328eddb9-installation-pull-secrets\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:53:03.196047 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:03.196011    2583 generic.go:356] "Generic (PLEG): container finished" podID="fd908e82-8390-4555-9096-adbe328eddb9" containerID="430c48a5d519ea7ae5dcf57d9c71db03d2e7d5c5af4a2e864da999785f954be2" exitCode=0
Jul 14 21:53:03.196276 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:03.196072    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b9d68f48-zldd6"
Jul 14 21:53:03.196276 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:03.196076    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b9d68f48-zldd6" event={"ID":"fd908e82-8390-4555-9096-adbe328eddb9","Type":"ContainerDied","Data":"430c48a5d519ea7ae5dcf57d9c71db03d2e7d5c5af4a2e864da999785f954be2"}
Jul 14 21:53:03.196276 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:03.196144    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b9d68f48-zldd6" event={"ID":"fd908e82-8390-4555-9096-adbe328eddb9","Type":"ContainerDied","Data":"82256ae61a8992384d8ec020e9e6e5ce3219e3e3a5da015523eb9603d59bd4a7"}
Jul 14 21:53:03.196276 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:03.196174    2583 scope.go:117] "RemoveContainer" containerID="430c48a5d519ea7ae5dcf57d9c71db03d2e7d5c5af4a2e864da999785f954be2"
Jul 14 21:53:03.205841 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:03.205818    2583 scope.go:117] "RemoveContainer" containerID="430c48a5d519ea7ae5dcf57d9c71db03d2e7d5c5af4a2e864da999785f954be2"
Jul 14 21:53:03.206272 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:53:03.206248    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"430c48a5d519ea7ae5dcf57d9c71db03d2e7d5c5af4a2e864da999785f954be2\": container with ID starting with 430c48a5d519ea7ae5dcf57d9c71db03d2e7d5c5af4a2e864da999785f954be2 not found: ID does not exist" containerID="430c48a5d519ea7ae5dcf57d9c71db03d2e7d5c5af4a2e864da999785f954be2"
Jul 14 21:53:03.206387 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:03.206277    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"430c48a5d519ea7ae5dcf57d9c71db03d2e7d5c5af4a2e864da999785f954be2"} err="failed to get container status \"430c48a5d519ea7ae5dcf57d9c71db03d2e7d5c5af4a2e864da999785f954be2\": rpc error: code = NotFound desc = could not find container \"430c48a5d519ea7ae5dcf57d9c71db03d2e7d5c5af4a2e864da999785f954be2\": container with ID starting with 430c48a5d519ea7ae5dcf57d9c71db03d2e7d5c5af4a2e864da999785f954be2 not found: ID does not exist"
Jul 14 21:53:03.218912 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:03.218884    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64b9d68f48-zldd6"]
Jul 14 21:53:03.224403 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:03.224374    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64b9d68f48-zldd6"]
Jul 14 21:53:03.364158 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:03.364118    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:53:03.364331 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:03.364185    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:53:03.584275 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:03.584245    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd908e82-8390-4555-9096-adbe328eddb9" path="/var/lib/kubelet/pods/fd908e82-8390-4555-9096-adbe328eddb9/volumes"
Jul 14 21:53:23.368617 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:23.368580    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:53:23.372464 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:23.372443    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6b659b4f5f-wdlpf"
Jul 14 21:53:45.171045 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:45.171009    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:53:45.186662 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:45.186632    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:53:45.388486 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:53:45.388455    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:03.269420 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.269382    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 21:54:03.269937 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.269679    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="prometheus" containerID="cri-o://510163770fdf584fc1ddc1d6da5ccf6a4d286c1ab29a60951000fa2f40fcdab2" gracePeriod=600
Jul 14 21:54:03.269937 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.269719    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="kube-rbac-proxy" containerID="cri-o://f17f8234ccc22557c2b6cc40685ea272776d51cac0032319395caa7f9ff78760" gracePeriod=600
Jul 14 21:54:03.269937 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.269743    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="thanos-sidecar" containerID="cri-o://9ecaea6e4a9aa1a3cdc97f6b3035a0f9a42f1a4f33c2b1382d644973e380589b" gracePeriod=600
Jul 14 21:54:03.269937 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.269801    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d0aab6ed3477e2deff0aca69160e3ec8bd8e91cf8fa5d3bb553120e2abcd4908" gracePeriod=600
Jul 14 21:54:03.269937 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.269760    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="config-reloader" containerID="cri-o://b0c2aed93b3e3203d50dcb86438ecfac0d160ab13359a52acea07af50df5bcd3" gracePeriod=600
Jul 14 21:54:03.269937 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.269796    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="kube-rbac-proxy-web" containerID="cri-o://61b59dd4206d7c7ec95a97f4afbfe9497714282978eb6f21d41058d8aa5df4be" gracePeriod=600
Jul 14 21:54:03.445118 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.445082    2583 generic.go:356] "Generic (PLEG): container finished" podID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerID="d0aab6ed3477e2deff0aca69160e3ec8bd8e91cf8fa5d3bb553120e2abcd4908" exitCode=0
Jul 14 21:54:03.445118 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.445113    2583 generic.go:356] "Generic (PLEG): container finished" podID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerID="f17f8234ccc22557c2b6cc40685ea272776d51cac0032319395caa7f9ff78760" exitCode=0
Jul 14 21:54:03.445118 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.445122    2583 generic.go:356] "Generic (PLEG): container finished" podID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerID="61b59dd4206d7c7ec95a97f4afbfe9497714282978eb6f21d41058d8aa5df4be" exitCode=0
Jul 14 21:54:03.445383 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.445130    2583 generic.go:356] "Generic (PLEG): container finished" podID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerID="9ecaea6e4a9aa1a3cdc97f6b3035a0f9a42f1a4f33c2b1382d644973e380589b" exitCode=0
Jul 14 21:54:03.445383 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.445137    2583 generic.go:356] "Generic (PLEG): container finished" podID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerID="b0c2aed93b3e3203d50dcb86438ecfac0d160ab13359a52acea07af50df5bcd3" exitCode=0
Jul 14 21:54:03.445383 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.445146    2583 generic.go:356] "Generic (PLEG): container finished" podID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerID="510163770fdf584fc1ddc1d6da5ccf6a4d286c1ab29a60951000fa2f40fcdab2" exitCode=0
Jul 14 21:54:03.445383 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.445244    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerDied","Data":"d0aab6ed3477e2deff0aca69160e3ec8bd8e91cf8fa5d3bb553120e2abcd4908"}
Jul 14 21:54:03.445383 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.445314    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerDied","Data":"f17f8234ccc22557c2b6cc40685ea272776d51cac0032319395caa7f9ff78760"}
Jul 14 21:54:03.445383 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.445359    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerDied","Data":"61b59dd4206d7c7ec95a97f4afbfe9497714282978eb6f21d41058d8aa5df4be"}
Jul 14 21:54:03.445686 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.445400    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerDied","Data":"9ecaea6e4a9aa1a3cdc97f6b3035a0f9a42f1a4f33c2b1382d644973e380589b"}
Jul 14 21:54:03.445686 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.445440    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerDied","Data":"b0c2aed93b3e3203d50dcb86438ecfac0d160ab13359a52acea07af50df5bcd3"}
Jul 14 21:54:03.445686 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.445479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerDied","Data":"510163770fdf584fc1ddc1d6da5ccf6a4d286c1ab29a60951000fa2f40fcdab2"}
Jul 14 21:54:03.504272 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.504243    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:03.521311 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.521261    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-kube-rbac-proxy\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.521311 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.521293    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-db\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.521466 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.521315    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.521466 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.521340    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-grpc-tls\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.521466 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.521374    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-thanos-prometheus-http-client-file\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.521466 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.521390    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.521466 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.521413    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-0\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.521466 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.521436    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-web-config\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.521466 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.521458    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-tls-assets\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.522086 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.522032    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-2\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.522086 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.522077    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-1\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.522241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.522102    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbgmj\" (UniqueName: \"kubernetes.io/projected/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-kube-api-access-qbgmj\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.522241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.522154    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-config-out\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.522241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.522191    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-metrics-client-certs\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.522241 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.522232    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-serving-certs-ca-bundle\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.522445 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.522265    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-metrics-client-ca\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.522445 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.522294    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-config\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.522445 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.522329    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-trusted-ca-bundle\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.522445 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.522371    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-kubelet-serving-ca-bundle\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.522445 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.522402    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-tls\") pod \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\" (UID: \"1888aaae-5b7b-4fae-93d5-1c88151d8ddb\") "
Jul 14 21:54:03.523055 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.523026    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 21:54:03.523149 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.523073    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:54:03.523606 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.523576    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:54:03.524179 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.524152    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:54:03.524179 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.524168    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:54:03.524526 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.524501    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:54:03.524647 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.524595    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:54:03.524910 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.524886    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 21:54:03.525498 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.525323    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:54:03.525498 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.525389    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:54:03.525498 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.525451    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 21:54:03.525708 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.525524    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:54:03.525928 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.525869    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:54:03.525928 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.525895    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:54:03.526081 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.525966    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:54:03.526202 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.526178    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-config-out" (OuterVolumeSpecName: "config-out") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 21:54:03.526551 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.526522    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:54:03.527013 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.526976    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-kube-api-access-qbgmj" (OuterVolumeSpecName: "kube-api-access-qbgmj") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "kube-api-access-qbgmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 21:54:03.527132 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.527114    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-config" (OuterVolumeSpecName: "config") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:54:03.535789 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.535763    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-web-config" (OuterVolumeSpecName: "web-config") pod "1888aaae-5b7b-4fae-93d5-1c88151d8ddb" (UID: "1888aaae-5b7b-4fae-93d5-1c88151d8ddb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 21:54:03.623402 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623370    2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623402 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623402    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623562 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623418    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623562 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623433    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-web-config\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623562 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623446    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-tls-assets\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623562 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623458    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623562 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623471    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623562 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623484    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbgmj\" (UniqueName: \"kubernetes.io/projected/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-kube-api-access-qbgmj\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623562 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623497    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-config-out\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623562 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623510    2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-metrics-client-certs\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623562 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623524    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623562 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623538    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-metrics-client-ca\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623562 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623551    2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-config\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623562 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623563    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623946 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623578    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623946 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623591    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623946 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623602    2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-kube-rbac-proxy\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623946 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623611    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-prometheus-k8s-db\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623946 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623619    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:03.623946 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:03.623627    2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1888aaae-5b7b-4fae-93d5-1c88151d8ddb-secret-grpc-tls\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:54:04.451903 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.451869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1888aaae-5b7b-4fae-93d5-1c88151d8ddb","Type":"ContainerDied","Data":"b1c9250ccdf3fbff7ad4325f3d7bc5a2455ac8e043c6652e9467d13c2ef19650"}
Jul 14 21:54:04.452355 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.451922    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.452355 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.451942    2583 scope.go:117] "RemoveContainer" containerID="d0aab6ed3477e2deff0aca69160e3ec8bd8e91cf8fa5d3bb553120e2abcd4908"
Jul 14 21:54:04.459511 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.459486    2583 scope.go:117] "RemoveContainer" containerID="f17f8234ccc22557c2b6cc40685ea272776d51cac0032319395caa7f9ff78760"
Jul 14 21:54:04.466369 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.466346    2583 scope.go:117] "RemoveContainer" containerID="61b59dd4206d7c7ec95a97f4afbfe9497714282978eb6f21d41058d8aa5df4be"
Jul 14 21:54:04.472590 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.472574    2583 scope.go:117] "RemoveContainer" containerID="9ecaea6e4a9aa1a3cdc97f6b3035a0f9a42f1a4f33c2b1382d644973e380589b"
Jul 14 21:54:04.476310 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.476284    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 21:54:04.483190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.479966    2583 scope.go:117] "RemoveContainer" containerID="b0c2aed93b3e3203d50dcb86438ecfac0d160ab13359a52acea07af50df5bcd3"
Jul 14 21:54:04.485528 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.485506    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 21:54:04.489787 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.489760    2583 scope.go:117] "RemoveContainer" containerID="510163770fdf584fc1ddc1d6da5ccf6a4d286c1ab29a60951000fa2f40fcdab2"
Jul 14 21:54:04.496968 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.496953    2583 scope.go:117] "RemoveContainer" containerID="cea76044ade5c8358cb683544489ae845cc0e341a780aee8abb439548bfc1385"
Jul 14 21:54:04.511213 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511194    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 21:54:04.511479 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511467    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd908e82-8390-4555-9096-adbe328eddb9" containerName="registry"
Jul 14 21:54:04.511520 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511480    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd908e82-8390-4555-9096-adbe328eddb9" containerName="registry"
Jul 14 21:54:04.511520 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511494    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="thanos-sidecar"
Jul 14 21:54:04.511520 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511500    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="thanos-sidecar"
Jul 14 21:54:04.511520 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511507    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="kube-rbac-proxy-web"
Jul 14 21:54:04.511520 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511512    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="kube-rbac-proxy-web"
Jul 14 21:54:04.511520 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511521    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="kube-rbac-proxy"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511527    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="kube-rbac-proxy"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511535    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="prometheus"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511540    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="prometheus"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511547    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="kube-rbac-proxy-thanos"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511552    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="kube-rbac-proxy-thanos"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511560    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="init-config-reloader"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511565    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="init-config-reloader"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511573    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="config-reloader"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511577    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="config-reloader"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511618    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="kube-rbac-proxy-web"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511624    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="prometheus"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511631    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="thanos-sidecar"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511637    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd908e82-8390-4555-9096-adbe328eddb9" containerName="registry"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511643    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="kube-rbac-proxy"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511649    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="kube-rbac-proxy-thanos"
Jul 14 21:54:04.511694 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.511656    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" containerName="config-reloader"
Jul 14 21:54:04.516894 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.516880    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.520151 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.520135    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 14 21:54:04.520370 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.520351    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 14 21:54:04.520464 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.520450    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 14 21:54:04.520682 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.520666    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 14 21:54:04.520682 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.520677    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 14 21:54:04.521002 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.520972    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d616nqj44u5uh\""
Jul 14 21:54:04.521088 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.521045    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 14 21:54:04.521147 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.521092    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 14 21:54:04.521297 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.521281    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 14 21:54:04.521364 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.521305    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 14 21:54:04.521544 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.521525    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 14 21:54:04.521755 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.521743    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ppgj5\""
Jul 14 21:54:04.522036 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.522021    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 14 21:54:04.522618 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.522599    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 14 21:54:04.525094 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.525064    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 14 21:54:04.528661 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.528644    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 14 21:54:04.530841 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.530824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-config\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.530899 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.530849    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.530899 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.530880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.530962 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.530944    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2936c37d-4f84-4a27-913c-90525953dcc5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531008 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.530970    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531045 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531007    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531045 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531027    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-web-config\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531105 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531054    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531105 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531070    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531105 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531087    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531191 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531191 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531148    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531191 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531176    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc9xv\" (UniqueName: \"kubernetes.io/projected/2936c37d-4f84-4a27-913c-90525953dcc5-kube-api-access-kc9xv\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531281 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531192    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531281 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531207    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531281 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531225    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531281 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531239    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531281 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531257    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2936c37d-4f84-4a27-913c-90525953dcc5-config-out\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531281 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.531445 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.531304    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.535074 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.535025    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 21:54:04.632543 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.632512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.632543 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.632541    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.632765 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.632562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.632765 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.632585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.632765 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.632606    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.632765 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.632628    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc9xv\" (UniqueName: \"kubernetes.io/projected/2936c37d-4f84-4a27-913c-90525953dcc5-kube-api-access-kc9xv\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.632953 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.632770    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633053 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633011    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633120 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633054    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633120 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633080    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633120 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633112    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633257 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2936c37d-4f84-4a27-913c-90525953dcc5-config-out\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633257 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633173    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633257 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633392 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-config\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633392 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633392 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633318    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633392 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2936c37d-4f84-4a27-913c-90525953dcc5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633587 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633394    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633587 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633403    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633587 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.633587 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.633453    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-web-config\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.634204 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.634178    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.634362 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.634226    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.635687 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.635656    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.635687 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.635676    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.636713 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.636406    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.636713 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.636511    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.636869 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.636819    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2936c37d-4f84-4a27-913c-90525953dcc5-config-out\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.636981 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.636958    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-web-config\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.637065 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.637035    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.637379 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.637356    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.637815 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.637759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-config\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.637932 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.637907    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.637932 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.637924    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2936c37d-4f84-4a27-913c-90525953dcc5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.638308 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.638291    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.638370 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.638350    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.638835 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.638820    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2936c37d-4f84-4a27-913c-90525953dcc5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.639232 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.639204    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2936c37d-4f84-4a27-913c-90525953dcc5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.641062 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.641046    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc9xv\" (UniqueName: \"kubernetes.io/projected/2936c37d-4f84-4a27-913c-90525953dcc5-kube-api-access-kc9xv\") pod \"prometheus-k8s-0\" (UID: \"2936c37d-4f84-4a27-913c-90525953dcc5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.826859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.826831    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:54:04.964236 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:04.964202    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 21:54:04.967495 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:54:04.967468    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2936c37d_4f84_4a27_913c_90525953dcc5.slice/crio-7da379a0d0d5f066ee7ec0c7f713b064cecca9fc888a5cea779d931219321d6f WatchSource:0}: Error finding container 7da379a0d0d5f066ee7ec0c7f713b064cecca9fc888a5cea779d931219321d6f: Status 404 returned error can't find the container with id 7da379a0d0d5f066ee7ec0c7f713b064cecca9fc888a5cea779d931219321d6f
Jul 14 21:54:05.457384 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:05.457348    2583 generic.go:356] "Generic (PLEG): container finished" podID="2936c37d-4f84-4a27-913c-90525953dcc5" containerID="fb1efe2167ed9541b4e949db71c9c20bd14a32e48f1e7c6485a46b4528e4cb79" exitCode=0
Jul 14 21:54:05.457794 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:05.457432    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2936c37d-4f84-4a27-913c-90525953dcc5","Type":"ContainerDied","Data":"fb1efe2167ed9541b4e949db71c9c20bd14a32e48f1e7c6485a46b4528e4cb79"}
Jul 14 21:54:05.457794 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:05.457497    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2936c37d-4f84-4a27-913c-90525953dcc5","Type":"ContainerStarted","Data":"7da379a0d0d5f066ee7ec0c7f713b064cecca9fc888a5cea779d931219321d6f"}
Jul 14 21:54:05.585827 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:05.585803    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1888aaae-5b7b-4fae-93d5-1c88151d8ddb" path="/var/lib/kubelet/pods/1888aaae-5b7b-4fae-93d5-1c88151d8ddb/volumes"
Jul 14 21:54:06.464981 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:06.464947    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2936c37d-4f84-4a27-913c-90525953dcc5","Type":"ContainerStarted","Data":"fbe8bfaf967c630982e59a50668e06e04def5eef1a6967b04b0374ec69578791"}
Jul 14 21:54:06.465461 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:06.465051    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2936c37d-4f84-4a27-913c-90525953dcc5","Type":"ContainerStarted","Data":"b45df6855df7f60cf79f62bea33ae6e3f6f1b4dec6eca356b96008fa74aba816"}
Jul 14 21:54:06.465461 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:06.465078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2936c37d-4f84-4a27-913c-90525953dcc5","Type":"ContainerStarted","Data":"c9d9e068bb7f49be9ad70a246fae76328cd752a531f348ff2f348d50d91a69cb"}
Jul 14 21:54:06.465461 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:06.465101    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2936c37d-4f84-4a27-913c-90525953dcc5","Type":"ContainerStarted","Data":"b872fa13023f8e3177477cc5db60153e1e5538cf1c36fd8113f4784137c5a1f8"}
Jul 14 21:54:06.465461 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:06.465124    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2936c37d-4f84-4a27-913c-90525953dcc5","Type":"ContainerStarted","Data":"cc30cf96e0727a8fa14b082aacf86b5bcf6da84930a61cde6513bfbc6eb4c05f"}
Jul 14 21:54:06.465461 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:06.465147    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2936c37d-4f84-4a27-913c-90525953dcc5","Type":"ContainerStarted","Data":"6997ca63f3bbf1318ce8d2a14b016568619333952af8a48adf58000a5ec79d71"}
Jul 14 21:54:06.499246 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:06.499193    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.479987864 podStartE2EDuration="2.499174558s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.186694ms" isStatefulPod=false podCreationTimestamp="2026-07-14 21:54:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:54:06.496207812 +0000 UTC m=+205.408047272" watchObservedRunningTime="2026-07-14 21:54:06.499174558 +0000 UTC m=+205.411014022"
Jul 14 21:54:09.827571 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:54:09.827539    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:55:04.827218 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:04.827130    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:55:04.842692 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:04.842666    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:55:05.705645 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:05.705617    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 21:55:41.519290 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:41.519263    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 21:55:41.523533 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:41.523512    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 21:55:41.526346 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:41.526320    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 21:55:56.040109 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.040075    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"]
Jul 14 21:55:56.043509 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.043494    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.046261 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.046232    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 21:55:56.046378 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.046258    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 21:55:56.046378 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.046299    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 21:55:56.046465 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.046372    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8svd6\""
Jul 14 21:55:56.046860 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.046847    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 21:55:56.069072 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.069048    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"]
Jul 14 21:55:56.129670 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.129641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-manifests\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.129797 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.129680    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.129797 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.129703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-tmp\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.129797 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.129730    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dqf7\" (UniqueName: \"kubernetes.io/projected/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-kube-api-access-2dqf7\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.129797 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.129792    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.231088 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.231052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-manifests\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.231088 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.231103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.231276 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.231132    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-tmp\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.231276 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.231154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dqf7\" (UniqueName: \"kubernetes.io/projected/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-kube-api-access-2dqf7\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.231276 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.231193    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.231536 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.231512    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-manifests\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.233417 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.233395    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-tmp\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.233647 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.233630    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.233780 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.233762    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.241496 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.241474    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dqf7\" (UniqueName: \"kubernetes.io/projected/5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0-kube-api-access-2dqf7\") pod \"opendatahub-operator-controller-manager-5c99649887-6t6k7\" (UID: \"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.353164 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.353148    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:55:56.483003 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.482956    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"]
Jul 14 21:55:56.486848 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:55:56.486825    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7dc0b1_6f4c_4138_9dd2_5f7009938bc0.slice/crio-6a8bee96ce27efa5548be23b7fedac8d5dc0aec2e1006ebb382ef1d1df204704 WatchSource:0}: Error finding container 6a8bee96ce27efa5548be23b7fedac8d5dc0aec2e1006ebb382ef1d1df204704: Status 404 returned error can't find the container with id 6a8bee96ce27efa5548be23b7fedac8d5dc0aec2e1006ebb382ef1d1df204704
Jul 14 21:55:56.488628 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.488610    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 21:55:56.885598 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:56.885565    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7" event={"ID":"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0","Type":"ContainerStarted","Data":"6a8bee96ce27efa5548be23b7fedac8d5dc0aec2e1006ebb382ef1d1df204704"}
Jul 14 21:55:59.901717 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:55:59.901687    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7" event={"ID":"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0","Type":"ContainerStarted","Data":"7ffab6324ead43b1e6e817c029854fcda5b8326f0c2aca22e7f7419acd4d993a"}
Jul 14 21:56:01.911401 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:01.911370    2583 generic.go:356] "Generic (PLEG): container finished" podID="5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0" containerID="7ffab6324ead43b1e6e817c029854fcda5b8326f0c2aca22e7f7419acd4d993a" exitCode=0
Jul 14 21:56:01.911786 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:01.911446    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7" event={"ID":"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0","Type":"ContainerDied","Data":"7ffab6324ead43b1e6e817c029854fcda5b8326f0c2aca22e7f7419acd4d993a"}
Jul 14 21:56:02.917436 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:02.917403    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7" event={"ID":"5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0","Type":"ContainerStarted","Data":"5654233b4acfcde52618ac76d34ca0bf452a5232e29db6647a9fc9ab54d54c23"}
Jul 14 21:56:02.917788 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:02.917616    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:56:02.943601 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:02.943559    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7" podStartSLOduration=2.222649751 podStartE2EDuration="6.943545523s" totalImagesPullingTime="3.647365911s" totalInitContainerRuntime="1.073529861s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:55:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:56:02.941374917 +0000 UTC m=+321.853214548" watchObservedRunningTime="2026-07-14 21:56:02.943545523 +0000 UTC m=+321.855384984"
Jul 14 21:56:13.922958 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:13.922929    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c99649887-6t6k7"
Jul 14 21:56:16.452242 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.452210    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"]
Jul 14 21:56:16.461826 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.461803    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"
Jul 14 21:56:16.465547 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.465525    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lsdld\""
Jul 14 21:56:16.465677 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.465528    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 14 21:56:16.466712 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.466695    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 21:56:16.484073 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.484051    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"]
Jul 14 21:56:16.596152 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.596126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk5nx\" (UniqueName: \"kubernetes.io/projected/54f901ff-51a4-459a-9b66-3f2eccbd1e0a-kube-api-access-kk5nx\") pod \"kube-auth-proxy-9dcf98947-zv2cs\" (UID: \"54f901ff-51a4-459a-9b66-3f2eccbd1e0a\") " pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"
Jul 14 21:56:16.596260 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.596160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54f901ff-51a4-459a-9b66-3f2eccbd1e0a-tmp\") pod \"kube-auth-proxy-9dcf98947-zv2cs\" (UID: \"54f901ff-51a4-459a-9b66-3f2eccbd1e0a\") " pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"
Jul 14 21:56:16.596260 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.596186    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54f901ff-51a4-459a-9b66-3f2eccbd1e0a-tls-certs\") pod \"kube-auth-proxy-9dcf98947-zv2cs\" (UID: \"54f901ff-51a4-459a-9b66-3f2eccbd1e0a\") " pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"
Jul 14 21:56:16.697074 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.697046    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54f901ff-51a4-459a-9b66-3f2eccbd1e0a-tls-certs\") pod \"kube-auth-proxy-9dcf98947-zv2cs\" (UID: \"54f901ff-51a4-459a-9b66-3f2eccbd1e0a\") " pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"
Jul 14 21:56:16.697180 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.697132    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk5nx\" (UniqueName: \"kubernetes.io/projected/54f901ff-51a4-459a-9b66-3f2eccbd1e0a-kube-api-access-kk5nx\") pod \"kube-auth-proxy-9dcf98947-zv2cs\" (UID: \"54f901ff-51a4-459a-9b66-3f2eccbd1e0a\") " pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"
Jul 14 21:56:16.697247 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.697177    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54f901ff-51a4-459a-9b66-3f2eccbd1e0a-tmp\") pod \"kube-auth-proxy-9dcf98947-zv2cs\" (UID: \"54f901ff-51a4-459a-9b66-3f2eccbd1e0a\") " pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"
Jul 14 21:56:16.699380 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.699362    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54f901ff-51a4-459a-9b66-3f2eccbd1e0a-tmp\") pod \"kube-auth-proxy-9dcf98947-zv2cs\" (UID: \"54f901ff-51a4-459a-9b66-3f2eccbd1e0a\") " pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"
Jul 14 21:56:16.699637 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.699618    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54f901ff-51a4-459a-9b66-3f2eccbd1e0a-tls-certs\") pod \"kube-auth-proxy-9dcf98947-zv2cs\" (UID: \"54f901ff-51a4-459a-9b66-3f2eccbd1e0a\") " pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"
Jul 14 21:56:16.718594 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.718534    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk5nx\" (UniqueName: \"kubernetes.io/projected/54f901ff-51a4-459a-9b66-3f2eccbd1e0a-kube-api-access-kk5nx\") pod \"kube-auth-proxy-9dcf98947-zv2cs\" (UID: \"54f901ff-51a4-459a-9b66-3f2eccbd1e0a\") " pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"
Jul 14 21:56:16.771112 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.771092    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"
Jul 14 21:56:16.901491 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.901442    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tqjgl"]
Jul 14 21:56:16.904144 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.904122    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs"]
Jul 14 21:56:16.904245 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.904228    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl"
Jul 14 21:56:16.908501 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:56:16.908481    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f901ff_51a4_459a_9b66_3f2eccbd1e0a.slice/crio-5b73a49f5506efbc646293ac1a1a2c2a9daa9a93541db5759113eef232d9dc11 WatchSource:0}: Error finding container 5b73a49f5506efbc646293ac1a1a2c2a9daa9a93541db5759113eef232d9dc11: Status 404 returned error can't find the container with id 5b73a49f5506efbc646293ac1a1a2c2a9daa9a93541db5759113eef232d9dc11
Jul 14 21:56:16.908835 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.908822    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-t7xfj\""
Jul 14 21:56:16.909153 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.909138    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 14 21:56:16.918419 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.918398    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tqjgl"]
Jul 14 21:56:16.975105 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.975042    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs" event={"ID":"54f901ff-51a4-459a-9b66-3f2eccbd1e0a","Type":"ContainerStarted","Data":"5b73a49f5506efbc646293ac1a1a2c2a9daa9a93541db5759113eef232d9dc11"}
Jul 14 21:56:16.999634 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.999603    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kltl8\" (UniqueName: \"kubernetes.io/projected/d511f6dc-503f-4812-a85e-7b455e866e97-kube-api-access-kltl8\") pod \"odh-model-controller-7998c67dc4-tqjgl\" (UID: \"d511f6dc-503f-4812-a85e-7b455e866e97\") " pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl"
Jul 14 21:56:16.999752 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:16.999668    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d511f6dc-503f-4812-a85e-7b455e866e97-cert\") pod \"odh-model-controller-7998c67dc4-tqjgl\" (UID: \"d511f6dc-503f-4812-a85e-7b455e866e97\") " pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl"
Jul 14 21:56:17.100520 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:17.100486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d511f6dc-503f-4812-a85e-7b455e866e97-cert\") pod \"odh-model-controller-7998c67dc4-tqjgl\" (UID: \"d511f6dc-503f-4812-a85e-7b455e866e97\") " pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl"
Jul 14 21:56:17.100673 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:17.100567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kltl8\" (UniqueName: \"kubernetes.io/projected/d511f6dc-503f-4812-a85e-7b455e866e97-kube-api-access-kltl8\") pod \"odh-model-controller-7998c67dc4-tqjgl\" (UID: \"d511f6dc-503f-4812-a85e-7b455e866e97\") " pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl"
Jul 14 21:56:17.100673 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:56:17.100645    2583 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 14 21:56:17.100782 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:56:17.100705    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d511f6dc-503f-4812-a85e-7b455e866e97-cert podName:d511f6dc-503f-4812-a85e-7b455e866e97 nodeName:}" failed. No retries permitted until 2026-07-14 21:56:17.600688342 +0000 UTC m=+336.512527780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d511f6dc-503f-4812-a85e-7b455e866e97-cert") pod "odh-model-controller-7998c67dc4-tqjgl" (UID: "d511f6dc-503f-4812-a85e-7b455e866e97") : secret "odh-model-controller-webhook-cert" not found
Jul 14 21:56:17.113299 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:17.113278    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kltl8\" (UniqueName: \"kubernetes.io/projected/d511f6dc-503f-4812-a85e-7b455e866e97-kube-api-access-kltl8\") pod \"odh-model-controller-7998c67dc4-tqjgl\" (UID: \"d511f6dc-503f-4812-a85e-7b455e866e97\") " pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl"
Jul 14 21:56:17.604342 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:17.604307    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d511f6dc-503f-4812-a85e-7b455e866e97-cert\") pod \"odh-model-controller-7998c67dc4-tqjgl\" (UID: \"d511f6dc-503f-4812-a85e-7b455e866e97\") " pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl"
Jul 14 21:56:17.606816 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:17.606792    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d511f6dc-503f-4812-a85e-7b455e866e97-cert\") pod \"odh-model-controller-7998c67dc4-tqjgl\" (UID: \"d511f6dc-503f-4812-a85e-7b455e866e97\") " pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl"
Jul 14 21:56:17.816117 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:17.816080    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl"
Jul 14 21:56:17.963986 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:17.963954    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vwjl9"]
Jul 14 21:56:17.966453 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:17.966428    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vwjl9"
Jul 14 21:56:17.969893 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:17.969867    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 14 21:56:17.982432 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:17.982416    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-thpt8\""
Jul 14 21:56:18.004591 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:18.004569    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vwjl9"]
Jul 14 21:56:18.108702 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:18.108677    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6de41562-8b66-4928-ab3a-ec033d603ee7-tls-certs\") pod \"model-serving-api-54d89bd5fc-vwjl9\" (UID: \"6de41562-8b66-4928-ab3a-ec033d603ee7\") " pod="opendatahub/model-serving-api-54d89bd5fc-vwjl9"
Jul 14 21:56:18.108845 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:18.108709    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwjmn\" (UniqueName: \"kubernetes.io/projected/6de41562-8b66-4928-ab3a-ec033d603ee7-kube-api-access-nwjmn\") pod \"model-serving-api-54d89bd5fc-vwjl9\" (UID: \"6de41562-8b66-4928-ab3a-ec033d603ee7\") " pod="opendatahub/model-serving-api-54d89bd5fc-vwjl9"
Jul 14 21:56:18.207174 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:56:18.207141    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd511f6dc_503f_4812_a85e_7b455e866e97.slice/crio-d8be943b80ad1e2c8b861977551c2ceb0fb87d51a777c273fcdc78f94b113216 WatchSource:0}: Error finding container d8be943b80ad1e2c8b861977551c2ceb0fb87d51a777c273fcdc78f94b113216: Status 404 returned error can't find the container with id d8be943b80ad1e2c8b861977551c2ceb0fb87d51a777c273fcdc78f94b113216
Jul 14 21:56:18.209190 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:18.209168    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6de41562-8b66-4928-ab3a-ec033d603ee7-tls-certs\") pod \"model-serving-api-54d89bd5fc-vwjl9\" (UID: \"6de41562-8b66-4928-ab3a-ec033d603ee7\") " pod="opendatahub/model-serving-api-54d89bd5fc-vwjl9"
Jul 14 21:56:18.209264 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:18.209202    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwjmn\" (UniqueName: \"kubernetes.io/projected/6de41562-8b66-4928-ab3a-ec033d603ee7-kube-api-access-nwjmn\") pod \"model-serving-api-54d89bd5fc-vwjl9\" (UID: \"6de41562-8b66-4928-ab3a-ec033d603ee7\") " pod="opendatahub/model-serving-api-54d89bd5fc-vwjl9"
Jul 14 21:56:18.211843 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:18.211817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6de41562-8b66-4928-ab3a-ec033d603ee7-tls-certs\") pod \"model-serving-api-54d89bd5fc-vwjl9\" (UID: \"6de41562-8b66-4928-ab3a-ec033d603ee7\") " pod="opendatahub/model-serving-api-54d89bd5fc-vwjl9"
Jul 14 21:56:18.216786 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:18.216766    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tqjgl"]
Jul 14 21:56:18.230745 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:18.230722    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwjmn\" (UniqueName: \"kubernetes.io/projected/6de41562-8b66-4928-ab3a-ec033d603ee7-kube-api-access-nwjmn\") pod \"model-serving-api-54d89bd5fc-vwjl9\" (UID: \"6de41562-8b66-4928-ab3a-ec033d603ee7\") " pod="opendatahub/model-serving-api-54d89bd5fc-vwjl9"
Jul 14 21:56:18.278176 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:18.278137    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vwjl9"
Jul 14 21:56:18.442556 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:18.442526    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vwjl9"]
Jul 14 21:56:18.446759 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:56:18.446729    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de41562_8b66_4928_ab3a_ec033d603ee7.slice/crio-60b9abb7a9397431dbf94a960d1bb5ba907578a828ff5af2e44782d5953a64d8 WatchSource:0}: Error finding container 60b9abb7a9397431dbf94a960d1bb5ba907578a828ff5af2e44782d5953a64d8: Status 404 returned error can't find the container with id 60b9abb7a9397431dbf94a960d1bb5ba907578a828ff5af2e44782d5953a64d8
Jul 14 21:56:18.985450 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:18.985415    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vwjl9" event={"ID":"6de41562-8b66-4928-ab3a-ec033d603ee7","Type":"ContainerStarted","Data":"60b9abb7a9397431dbf94a960d1bb5ba907578a828ff5af2e44782d5953a64d8"}
Jul 14 21:56:18.986860 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:18.986831    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl" event={"ID":"d511f6dc-503f-4812-a85e-7b455e866e97","Type":"ContainerStarted","Data":"d8be943b80ad1e2c8b861977551c2ceb0fb87d51a777c273fcdc78f94b113216"}
Jul 14 21:56:19.995834 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:19.995649    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs" event={"ID":"54f901ff-51a4-459a-9b66-3f2eccbd1e0a","Type":"ContainerStarted","Data":"cce22d2b17a452b36e921f1ca24e51c3a46ec3fb5e5d3d0fd99f9c225a9631c3"}
Jul 14 21:56:20.016439 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:20.016048    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9dcf98947-zv2cs" podStartSLOduration=1.538627357 podStartE2EDuration="4.016029274s" totalImagesPullingTime="2.477401917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:56:20.015338781 +0000 UTC m=+338.927178241" watchObservedRunningTime="2026-07-14 21:56:20.016029274 +0000 UTC m=+338.927868736"
Jul 14 21:56:23.012834 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:23.012790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl" event={"ID":"d511f6dc-503f-4812-a85e-7b455e866e97","Type":"ContainerStarted","Data":"07f9cb501a137c3253ba68406418987b623fdae246733e57f9078bf8f3ceff78"}
Jul 14 21:56:23.013311 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:23.012977    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl"
Jul 14 21:56:23.014431 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:23.014404    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vwjl9" event={"ID":"6de41562-8b66-4928-ab3a-ec033d603ee7","Type":"ContainerStarted","Data":"b584f6e605ccbe03654aee4444df02c5831b3c352dfe16829bc1a7d4f32a8e01"}
Jul 14 21:56:23.014569 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:23.014462    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vwjl9"
Jul 14 21:56:23.032061 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:23.032017    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl" podStartSLOduration=3.109339856 podStartE2EDuration="7.03197993s" totalImagesPullingTime="3.922640074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:56:23.03180807 +0000 UTC m=+341.943647533" watchObservedRunningTime="2026-07-14 21:56:23.03197993 +0000 UTC m=+341.943819404"
Jul 14 21:56:23.051529 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:23.051485    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vwjl9" podStartSLOduration=2.371543331 podStartE2EDuration="6.051471315s" totalImagesPullingTime="3.679927984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:56:23.050360205 +0000 UTC m=+341.962199709" watchObservedRunningTime="2026-07-14 21:56:23.051471315 +0000 UTC m=+341.963310775"
Jul 14 21:56:25.727542 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.727512    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"]
Jul 14 21:56:25.730854 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.730838    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:25.735067 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.735041    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 14 21:56:25.735197 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.735080    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-gtzrr\""
Jul 14 21:56:25.735197 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.735092    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 14 21:56:25.735197 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.735135    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 14 21:56:25.735379 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.735364    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 14 21:56:25.735421 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.735397    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 14 21:56:25.741846 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.741827    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"]
Jul 14 21:56:25.878440 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.878411    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d56901-8802-46fb-8f77-f5d12f223fa5-cert\") pod \"lws-controller-manager-676d99795d-4tbsq\" (UID: \"f5d56901-8802-46fb-8f77-f5d12f223fa5\") " pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:25.878578 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.878454    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f5d56901-8802-46fb-8f77-f5d12f223fa5-manager-config\") pod \"lws-controller-manager-676d99795d-4tbsq\" (UID: \"f5d56901-8802-46fb-8f77-f5d12f223fa5\") " pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:25.878578 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.878483    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5d56901-8802-46fb-8f77-f5d12f223fa5-metrics-cert\") pod \"lws-controller-manager-676d99795d-4tbsq\" (UID: \"f5d56901-8802-46fb-8f77-f5d12f223fa5\") " pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:25.878578 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.878549    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9ld9\" (UniqueName: \"kubernetes.io/projected/f5d56901-8802-46fb-8f77-f5d12f223fa5-kube-api-access-n9ld9\") pod \"lws-controller-manager-676d99795d-4tbsq\" (UID: \"f5d56901-8802-46fb-8f77-f5d12f223fa5\") " pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:25.979702 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.979617    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d56901-8802-46fb-8f77-f5d12f223fa5-cert\") pod \"lws-controller-manager-676d99795d-4tbsq\" (UID: \"f5d56901-8802-46fb-8f77-f5d12f223fa5\") " pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:25.979702 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.979690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f5d56901-8802-46fb-8f77-f5d12f223fa5-manager-config\") pod \"lws-controller-manager-676d99795d-4tbsq\" (UID: \"f5d56901-8802-46fb-8f77-f5d12f223fa5\") " pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:25.979879 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.979715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5d56901-8802-46fb-8f77-f5d12f223fa5-metrics-cert\") pod \"lws-controller-manager-676d99795d-4tbsq\" (UID: \"f5d56901-8802-46fb-8f77-f5d12f223fa5\") " pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:25.979879 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.979753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9ld9\" (UniqueName: \"kubernetes.io/projected/f5d56901-8802-46fb-8f77-f5d12f223fa5-kube-api-access-n9ld9\") pod \"lws-controller-manager-676d99795d-4tbsq\" (UID: \"f5d56901-8802-46fb-8f77-f5d12f223fa5\") " pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:25.980461 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.980440    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f5d56901-8802-46fb-8f77-f5d12f223fa5-manager-config\") pod \"lws-controller-manager-676d99795d-4tbsq\" (UID: \"f5d56901-8802-46fb-8f77-f5d12f223fa5\") " pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:25.982213 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.982192    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5d56901-8802-46fb-8f77-f5d12f223fa5-metrics-cert\") pod \"lws-controller-manager-676d99795d-4tbsq\" (UID: \"f5d56901-8802-46fb-8f77-f5d12f223fa5\") " pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:25.982289 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.982243    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5d56901-8802-46fb-8f77-f5d12f223fa5-cert\") pod \"lws-controller-manager-676d99795d-4tbsq\" (UID: \"f5d56901-8802-46fb-8f77-f5d12f223fa5\") " pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:25.991605 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:25.991584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9ld9\" (UniqueName: \"kubernetes.io/projected/f5d56901-8802-46fb-8f77-f5d12f223fa5-kube-api-access-n9ld9\") pod \"lws-controller-manager-676d99795d-4tbsq\" (UID: \"f5d56901-8802-46fb-8f77-f5d12f223fa5\") " pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:26.040010 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:26.039967    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:26.175206 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:26.175159    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"]
Jul 14 21:56:26.177432 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:56:26.177408    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d56901_8802_46fb_8f77_f5d12f223fa5.slice/crio-caf08d5f4c9b235afdd9553c394c4ee6a5a9241e786d64debe9d254df294986c WatchSource:0}: Error finding container caf08d5f4c9b235afdd9553c394c4ee6a5a9241e786d64debe9d254df294986c: Status 404 returned error can't find the container with id caf08d5f4c9b235afdd9553c394c4ee6a5a9241e786d64debe9d254df294986c
Jul 14 21:56:27.033412 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:27.033378    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq" event={"ID":"f5d56901-8802-46fb-8f77-f5d12f223fa5","Type":"ContainerStarted","Data":"caf08d5f4c9b235afdd9553c394c4ee6a5a9241e786d64debe9d254df294986c"}
Jul 14 21:56:30.050446 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:30.050363    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq" event={"ID":"f5d56901-8802-46fb-8f77-f5d12f223fa5","Type":"ContainerStarted","Data":"62c50dba3287e0de6a2ddbd376af51eb27f4bd09cd5341fca84de24f7233ed6a"}
Jul 14 21:56:30.050794 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:30.050452    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:56:30.094230 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:30.094156    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq" podStartSLOduration=1.608834242 podStartE2EDuration="5.09414319s" totalImagesPullingTime="3.485308948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:56:30.087164414 +0000 UTC m=+348.999003876" watchObservedRunningTime="2026-07-14 21:56:30.09414319 +0000 UTC m=+349.005982675"
Jul 14 21:56:34.020957 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:34.020873    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-tqjgl"
Jul 14 21:56:34.023091 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:34.023073    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vwjl9"
Jul 14 21:56:41.057042 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:56:41.057012    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-676d99795d-4tbsq"
Jul 14 21:59:06.637309 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.637275    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 21:59:06.640547 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.640531    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"
Jul 14 21:59:06.643300 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.643266    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k4kj9\""
Jul 14 21:59:06.643443 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.643300    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 21:59:06.644368 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.644352    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 21:59:06.644368 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.644351    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 21:59:06.654876 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.654855    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 21:59:06.669052 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.669030    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 21:59:06.691044 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.691018    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4088940-5dcb-4712-b512-d9f85e0e51a9-config-file\") pod \"limitador-limitador-54d6d988d5-g4bd5\" (UID: \"c4088940-5dcb-4712-b512-d9f85e0e51a9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"
Jul 14 21:59:06.691153 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.691131    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp56q\" (UniqueName: \"kubernetes.io/projected/c4088940-5dcb-4712-b512-d9f85e0e51a9-kube-api-access-lp56q\") pod \"limitador-limitador-54d6d988d5-g4bd5\" (UID: \"c4088940-5dcb-4712-b512-d9f85e0e51a9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"
Jul 14 21:59:06.792653 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.792622    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp56q\" (UniqueName: \"kubernetes.io/projected/c4088940-5dcb-4712-b512-d9f85e0e51a9-kube-api-access-lp56q\") pod \"limitador-limitador-54d6d988d5-g4bd5\" (UID: \"c4088940-5dcb-4712-b512-d9f85e0e51a9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"
Jul 14 21:59:06.792809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.792718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4088940-5dcb-4712-b512-d9f85e0e51a9-config-file\") pod \"limitador-limitador-54d6d988d5-g4bd5\" (UID: \"c4088940-5dcb-4712-b512-d9f85e0e51a9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"
Jul 14 21:59:06.793287 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.793266    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4088940-5dcb-4712-b512-d9f85e0e51a9-config-file\") pod \"limitador-limitador-54d6d988d5-g4bd5\" (UID: \"c4088940-5dcb-4712-b512-d9f85e0e51a9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"
Jul 14 21:59:06.801693 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.801671    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp56q\" (UniqueName: \"kubernetes.io/projected/c4088940-5dcb-4712-b512-d9f85e0e51a9-kube-api-access-lp56q\") pod \"limitador-limitador-54d6d988d5-g4bd5\" (UID: \"c4088940-5dcb-4712-b512-d9f85e0e51a9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"
Jul 14 21:59:06.950394 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:06.950325    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"
Jul 14 21:59:07.078451 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:07.078426    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 21:59:07.080499 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:59:07.080472    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4088940_5dcb_4712_b512_d9f85e0e51a9.slice/crio-165df3bad4e55f5c9574edae3995539dc25e9882e59b7256fd36bb897faedfb1 WatchSource:0}: Error finding container 165df3bad4e55f5c9574edae3995539dc25e9882e59b7256fd36bb897faedfb1: Status 404 returned error can't find the container with id 165df3bad4e55f5c9574edae3995539dc25e9882e59b7256fd36bb897faedfb1
Jul 14 21:59:07.154489 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:07.154463    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-2mtzz"]
Jul 14 21:59:07.158760 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:07.158744    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2mtzz"
Jul 14 21:59:07.162310 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:07.162290    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6225n\""
Jul 14 21:59:07.176403 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:07.176377    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2mtzz"]
Jul 14 21:59:07.298131 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:07.298060    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lqtr\" (UniqueName: \"kubernetes.io/projected/d37dff17-447f-490c-a299-2f5f81430954-kube-api-access-2lqtr\") pod \"authorino-58cd955675-2mtzz\" (UID: \"d37dff17-447f-490c-a299-2f5f81430954\") " pod="kuadrant-system/authorino-58cd955675-2mtzz"
Jul 14 21:59:07.399454 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:07.399416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lqtr\" (UniqueName: \"kubernetes.io/projected/d37dff17-447f-490c-a299-2f5f81430954-kube-api-access-2lqtr\") pod \"authorino-58cd955675-2mtzz\" (UID: \"d37dff17-447f-490c-a299-2f5f81430954\") " pod="kuadrant-system/authorino-58cd955675-2mtzz"
Jul 14 21:59:07.408463 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:07.408433    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lqtr\" (UniqueName: \"kubernetes.io/projected/d37dff17-447f-490c-a299-2f5f81430954-kube-api-access-2lqtr\") pod \"authorino-58cd955675-2mtzz\" (UID: \"d37dff17-447f-490c-a299-2f5f81430954\") " pod="kuadrant-system/authorino-58cd955675-2mtzz"
Jul 14 21:59:07.476936 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:07.476914    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2mtzz"
Jul 14 21:59:07.604901 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:07.604856    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2mtzz"]
Jul 14 21:59:07.609393 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:59:07.609365    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd37dff17_447f_490c_a299_2f5f81430954.slice/crio-0f8e9e7b145f0e202f36149120137973fbafe84da9426165fce98f3f3f855a20 WatchSource:0}: Error finding container 0f8e9e7b145f0e202f36149120137973fbafe84da9426165fce98f3f3f855a20: Status 404 returned error can't find the container with id 0f8e9e7b145f0e202f36149120137973fbafe84da9426165fce98f3f3f855a20
Jul 14 21:59:07.750271 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:07.750232    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2mtzz" event={"ID":"d37dff17-447f-490c-a299-2f5f81430954","Type":"ContainerStarted","Data":"0f8e9e7b145f0e202f36149120137973fbafe84da9426165fce98f3f3f855a20"}
Jul 14 21:59:07.752067 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:07.752036    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4bd5" event={"ID":"c4088940-5dcb-4712-b512-d9f85e0e51a9","Type":"ContainerStarted","Data":"165df3bad4e55f5c9574edae3995539dc25e9882e59b7256fd36bb897faedfb1"}
Jul 14 21:59:11.775266 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:11.775186    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2mtzz" event={"ID":"d37dff17-447f-490c-a299-2f5f81430954","Type":"ContainerStarted","Data":"ec22eefa189222b86210d5c13a2c32a98f1f26822fd71c78c482cc2a250128c8"}
Jul 14 21:59:11.776735 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:11.776710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4bd5" event={"ID":"c4088940-5dcb-4712-b512-d9f85e0e51a9","Type":"ContainerStarted","Data":"8da25a70531c6b336c52b9822456e7f4bf7f11965bfa441ca6e7b3520bddbfe8"}
Jul 14 21:59:11.776859 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:11.776846    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"
Jul 14 21:59:11.792265 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:11.792218    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-2mtzz" podStartSLOduration=0.947061177 podStartE2EDuration="4.792204427s" totalImagesPullingTime="3.84514325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:59:11.791077196 +0000 UTC m=+510.702916681" watchObservedRunningTime="2026-07-14 21:59:11.792204427 +0000 UTC m=+510.704043891"
Jul 14 21:59:11.809655 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:11.809606    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4bd5" podStartSLOduration=1.443877611 podStartE2EDuration="5.809593212s" totalImagesPullingTime="4.365715601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:59:11.807152874 +0000 UTC m=+510.718992337" watchObservedRunningTime="2026-07-14 21:59:11.809593212 +0000 UTC m=+510.721432683"
Jul 14 21:59:12.151652 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:12.151621    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2mtzz"]
Jul 14 21:59:13.785191 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:13.785140    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-2mtzz" podUID="d37dff17-447f-490c-a299-2f5f81430954" containerName="authorino" containerID="cri-o://ec22eefa189222b86210d5c13a2c32a98f1f26822fd71c78c482cc2a250128c8" gracePeriod=30
Jul 14 21:59:14.052659 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:14.052635    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2mtzz"
Jul 14 21:59:14.168483 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:14.168452    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lqtr\" (UniqueName: \"kubernetes.io/projected/d37dff17-447f-490c-a299-2f5f81430954-kube-api-access-2lqtr\") pod \"d37dff17-447f-490c-a299-2f5f81430954\" (UID: \"d37dff17-447f-490c-a299-2f5f81430954\") "
Jul 14 21:59:14.170499 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:14.170472    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37dff17-447f-490c-a299-2f5f81430954-kube-api-access-2lqtr" (OuterVolumeSpecName: "kube-api-access-2lqtr") pod "d37dff17-447f-490c-a299-2f5f81430954" (UID: "d37dff17-447f-490c-a299-2f5f81430954"). InnerVolumeSpecName "kube-api-access-2lqtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 21:59:14.269343 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:14.269319    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lqtr\" (UniqueName: \"kubernetes.io/projected/d37dff17-447f-490c-a299-2f5f81430954-kube-api-access-2lqtr\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 21:59:14.790267 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:14.790230    2583 generic.go:356] "Generic (PLEG): container finished" podID="d37dff17-447f-490c-a299-2f5f81430954" containerID="ec22eefa189222b86210d5c13a2c32a98f1f26822fd71c78c482cc2a250128c8" exitCode=0
Jul 14 21:59:14.790267 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:14.790274    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2mtzz"
Jul 14 21:59:14.790807 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:14.790322    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2mtzz" event={"ID":"d37dff17-447f-490c-a299-2f5f81430954","Type":"ContainerDied","Data":"ec22eefa189222b86210d5c13a2c32a98f1f26822fd71c78c482cc2a250128c8"}
Jul 14 21:59:14.790807 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:14.790375    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2mtzz" event={"ID":"d37dff17-447f-490c-a299-2f5f81430954","Type":"ContainerDied","Data":"0f8e9e7b145f0e202f36149120137973fbafe84da9426165fce98f3f3f855a20"}
Jul 14 21:59:14.790807 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:14.790402    2583 scope.go:117] "RemoveContainer" containerID="ec22eefa189222b86210d5c13a2c32a98f1f26822fd71c78c482cc2a250128c8"
Jul 14 21:59:14.799436 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:14.799418    2583 scope.go:117] "RemoveContainer" containerID="ec22eefa189222b86210d5c13a2c32a98f1f26822fd71c78c482cc2a250128c8"
Jul 14 21:59:14.799667 ip-10-0-142-126 kubenswrapper[2583]: E0714 21:59:14.799648    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec22eefa189222b86210d5c13a2c32a98f1f26822fd71c78c482cc2a250128c8\": container with ID starting with ec22eefa189222b86210d5c13a2c32a98f1f26822fd71c78c482cc2a250128c8 not found: ID does not exist" containerID="ec22eefa189222b86210d5c13a2c32a98f1f26822fd71c78c482cc2a250128c8"
Jul 14 21:59:14.799741 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:14.799672    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec22eefa189222b86210d5c13a2c32a98f1f26822fd71c78c482cc2a250128c8"} err="failed to get container status \"ec22eefa189222b86210d5c13a2c32a98f1f26822fd71c78c482cc2a250128c8\": rpc error: code = NotFound desc = could not find container \"ec22eefa189222b86210d5c13a2c32a98f1f26822fd71c78c482cc2a250128c8\": container with ID starting with ec22eefa189222b86210d5c13a2c32a98f1f26822fd71c78c482cc2a250128c8 not found: ID does not exist"
Jul 14 21:59:14.810452 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:14.810427    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2mtzz"]
Jul 14 21:59:14.815716 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:14.815698    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-2mtzz"]
Jul 14 21:59:15.583977 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:15.583945    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d37dff17-447f-490c-a299-2f5f81430954" path="/var/lib/kubelet/pods/d37dff17-447f-490c-a299-2f5f81430954/volumes"
Jul 14 21:59:22.782411 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:22.782376    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"
Jul 14 21:59:47.098559 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.098527    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-959bdb455-j5z2l"]
Jul 14 21:59:47.098934 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.098881    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d37dff17-447f-490c-a299-2f5f81430954" containerName="authorino"
Jul 14 21:59:47.098934 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.098892    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d37dff17-447f-490c-a299-2f5f81430954" containerName="authorino"
Jul 14 21:59:47.099024 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.098969    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d37dff17-447f-490c-a299-2f5f81430954" containerName="authorino"
Jul 14 21:59:47.104926 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.104902    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-959bdb455-j5z2l"
Jul 14 21:59:47.107553 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.107531    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 21:59:47.107836 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.107818    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 21:59:47.108704 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.108689    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rvwns\""
Jul 14 21:59:47.118531 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.118510    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-959bdb455-j5z2l"]
Jul 14 21:59:47.136677 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.136648    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thjv9\" (UniqueName: \"kubernetes.io/projected/d412b801-5299-4cd1-a0d5-01174d285981-kube-api-access-thjv9\") pod \"maas-controller-959bdb455-j5z2l\" (UID: \"d412b801-5299-4cd1-a0d5-01174d285981\") " pod="opendatahub/maas-controller-959bdb455-j5z2l"
Jul 14 21:59:47.136809 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.136735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d412b801-5299-4cd1-a0d5-01174d285981-webhook-cert\") pod \"maas-controller-959bdb455-j5z2l\" (UID: \"d412b801-5299-4cd1-a0d5-01174d285981\") " pod="opendatahub/maas-controller-959bdb455-j5z2l"
Jul 14 21:59:47.237978 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.237949    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d412b801-5299-4cd1-a0d5-01174d285981-webhook-cert\") pod \"maas-controller-959bdb455-j5z2l\" (UID: \"d412b801-5299-4cd1-a0d5-01174d285981\") " pod="opendatahub/maas-controller-959bdb455-j5z2l"
Jul 14 21:59:47.238170 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.238018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thjv9\" (UniqueName: \"kubernetes.io/projected/d412b801-5299-4cd1-a0d5-01174d285981-kube-api-access-thjv9\") pod \"maas-controller-959bdb455-j5z2l\" (UID: \"d412b801-5299-4cd1-a0d5-01174d285981\") " pod="opendatahub/maas-controller-959bdb455-j5z2l"
Jul 14 21:59:47.240370 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.240344    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d412b801-5299-4cd1-a0d5-01174d285981-webhook-cert\") pod \"maas-controller-959bdb455-j5z2l\" (UID: \"d412b801-5299-4cd1-a0d5-01174d285981\") " pod="opendatahub/maas-controller-959bdb455-j5z2l"
Jul 14 21:59:47.247326 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.247301    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thjv9\" (UniqueName: \"kubernetes.io/projected/d412b801-5299-4cd1-a0d5-01174d285981-kube-api-access-thjv9\") pod \"maas-controller-959bdb455-j5z2l\" (UID: \"d412b801-5299-4cd1-a0d5-01174d285981\") " pod="opendatahub/maas-controller-959bdb455-j5z2l"
Jul 14 21:59:47.294666 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.294637    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cb88b8588-qgx5f"]
Jul 14 21:59:47.297100 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.297084    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb88b8588-qgx5f"
Jul 14 21:59:47.308802 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.308781    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cb88b8588-qgx5f"]
Jul 14 21:59:47.338782 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.338757    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93de8137-789e-4845-b69b-037db718a7ef-webhook-cert\") pod \"maas-controller-5cb88b8588-qgx5f\" (UID: \"93de8137-789e-4845-b69b-037db718a7ef\") " pod="opendatahub/maas-controller-5cb88b8588-qgx5f"
Jul 14 21:59:47.338883 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.338839    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqhjg\" (UniqueName: \"kubernetes.io/projected/93de8137-789e-4845-b69b-037db718a7ef-kube-api-access-gqhjg\") pod \"maas-controller-5cb88b8588-qgx5f\" (UID: \"93de8137-789e-4845-b69b-037db718a7ef\") " pod="opendatahub/maas-controller-5cb88b8588-qgx5f"
Jul 14 21:59:47.416652 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.416583    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-959bdb455-j5z2l"
Jul 14 21:59:47.440266 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.440241    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhjg\" (UniqueName: \"kubernetes.io/projected/93de8137-789e-4845-b69b-037db718a7ef-kube-api-access-gqhjg\") pod \"maas-controller-5cb88b8588-qgx5f\" (UID: \"93de8137-789e-4845-b69b-037db718a7ef\") " pod="opendatahub/maas-controller-5cb88b8588-qgx5f"
Jul 14 21:59:47.440370 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.440291    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93de8137-789e-4845-b69b-037db718a7ef-webhook-cert\") pod \"maas-controller-5cb88b8588-qgx5f\" (UID: \"93de8137-789e-4845-b69b-037db718a7ef\") " pod="opendatahub/maas-controller-5cb88b8588-qgx5f"
Jul 14 21:59:47.442582 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.442557    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93de8137-789e-4845-b69b-037db718a7ef-webhook-cert\") pod \"maas-controller-5cb88b8588-qgx5f\" (UID: \"93de8137-789e-4845-b69b-037db718a7ef\") " pod="opendatahub/maas-controller-5cb88b8588-qgx5f"
Jul 14 21:59:47.451310 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.451287    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqhjg\" (UniqueName: \"kubernetes.io/projected/93de8137-789e-4845-b69b-037db718a7ef-kube-api-access-gqhjg\") pod \"maas-controller-5cb88b8588-qgx5f\" (UID: \"93de8137-789e-4845-b69b-037db718a7ef\") " pod="opendatahub/maas-controller-5cb88b8588-qgx5f"
Jul 14 21:59:47.555253 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.555165    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-959bdb455-j5z2l"]
Jul 14 21:59:47.557485 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:59:47.557459    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd412b801_5299_4cd1_a0d5_01174d285981.slice/crio-0c78f602b48284312e537d62c525210070242cf77ca04ae26ea14686930c0c66 WatchSource:0}: Error finding container 0c78f602b48284312e537d62c525210070242cf77ca04ae26ea14686930c0c66: Status 404 returned error can't find the container with id 0c78f602b48284312e537d62c525210070242cf77ca04ae26ea14686930c0c66
Jul 14 21:59:47.607531 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.607501    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb88b8588-qgx5f"
Jul 14 21:59:47.732846 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.732821    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cb88b8588-qgx5f"]
Jul 14 21:59:47.734640 ip-10-0-142-126 kubenswrapper[2583]: W0714 21:59:47.734617    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93de8137_789e_4845_b69b_037db718a7ef.slice/crio-cdf6e60d0a2701262399b7c24ffb76a036cdd987988a713900d972dbde4c9f88 WatchSource:0}: Error finding container cdf6e60d0a2701262399b7c24ffb76a036cdd987988a713900d972dbde4c9f88: Status 404 returned error can't find the container with id cdf6e60d0a2701262399b7c24ffb76a036cdd987988a713900d972dbde4c9f88
Jul 14 21:59:47.942374 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.942284    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb88b8588-qgx5f" event={"ID":"93de8137-789e-4845-b69b-037db718a7ef","Type":"ContainerStarted","Data":"cdf6e60d0a2701262399b7c24ffb76a036cdd987988a713900d972dbde4c9f88"}
Jul 14 21:59:47.943373 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:47.943348    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-959bdb455-j5z2l" event={"ID":"d412b801-5299-4cd1-a0d5-01174d285981","Type":"ContainerStarted","Data":"0c78f602b48284312e537d62c525210070242cf77ca04ae26ea14686930c0c66"}
Jul 14 21:59:50.963455 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:50.963419    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb88b8588-qgx5f" event={"ID":"93de8137-789e-4845-b69b-037db718a7ef","Type":"ContainerStarted","Data":"b9247298e230a0e727cd3dd9341fc3561e5bf30d1f4614f28ed5c973e4232bdf"}
Jul 14 21:59:50.963875 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:50.963569    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cb88b8588-qgx5f"
Jul 14 21:59:50.964978 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:50.964955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-959bdb455-j5z2l" event={"ID":"d412b801-5299-4cd1-a0d5-01174d285981","Type":"ContainerStarted","Data":"e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04"}
Jul 14 21:59:50.965097 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:50.965017    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-959bdb455-j5z2l"
Jul 14 21:59:50.987648 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:50.987609    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cb88b8588-qgx5f" podStartSLOduration=1.512912237 podStartE2EDuration="3.987596853s" totalImagesPullingTime="2.474684616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:59:50.986052152 +0000 UTC m=+549.897891630" watchObservedRunningTime="2026-07-14 21:59:50.987596853 +0000 UTC m=+549.899436351"
Jul 14 21:59:51.005682 ip-10-0-142-126 kubenswrapper[2583]: I0714 21:59:51.005645    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-959bdb455-j5z2l" podStartSLOduration=1.360337036 podStartE2EDuration="4.005631541s" totalImagesPullingTime="2.645294505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 21:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 21:59:51.004879795 +0000 UTC m=+549.916719313" watchObservedRunningTime="2026-07-14 21:59:51.005631541 +0000 UTC m=+549.917471000"
Jul 14 22:00:01.971873 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:01.971837    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cb88b8588-qgx5f"
Jul 14 22:00:01.972326 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:01.971910    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-959bdb455-j5z2l"
Jul 14 22:00:02.036336 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:02.036301    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-959bdb455-j5z2l"]
Jul 14 22:00:02.036547 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:02.036520    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-959bdb455-j5z2l" podUID="d412b801-5299-4cd1-a0d5-01174d285981" containerName="manager" containerID="cri-o://e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04" gracePeriod=30
Jul 14 22:00:02.058056 ip-10-0-142-126 kubenswrapper[2583]: E0714 22:00:02.058022    2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd412b801_5299_4cd1_a0d5_01174d285981.slice/crio-e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd412b801_5299_4cd1_a0d5_01174d285981.slice/crio-conmon-e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04.scope\": RecentStats: unable to find data in memory cache]"
Jul 14 22:00:02.271078 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:02.271057    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-959bdb455-j5z2l"
Jul 14 22:00:02.370112 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:02.370079    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thjv9\" (UniqueName: \"kubernetes.io/projected/d412b801-5299-4cd1-a0d5-01174d285981-kube-api-access-thjv9\") pod \"d412b801-5299-4cd1-a0d5-01174d285981\" (UID: \"d412b801-5299-4cd1-a0d5-01174d285981\") "
Jul 14 22:00:02.370286 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:02.370179    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d412b801-5299-4cd1-a0d5-01174d285981-webhook-cert\") pod \"d412b801-5299-4cd1-a0d5-01174d285981\" (UID: \"d412b801-5299-4cd1-a0d5-01174d285981\") "
Jul 14 22:00:02.372247 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:02.372220    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d412b801-5299-4cd1-a0d5-01174d285981-kube-api-access-thjv9" (OuterVolumeSpecName: "kube-api-access-thjv9") pod "d412b801-5299-4cd1-a0d5-01174d285981" (UID: "d412b801-5299-4cd1-a0d5-01174d285981"). InnerVolumeSpecName "kube-api-access-thjv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:00:02.372335 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:02.372273    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d412b801-5299-4cd1-a0d5-01174d285981-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d412b801-5299-4cd1-a0d5-01174d285981" (UID: "d412b801-5299-4cd1-a0d5-01174d285981"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:00:02.471683 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:02.471657    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thjv9\" (UniqueName: \"kubernetes.io/projected/d412b801-5299-4cd1-a0d5-01174d285981-kube-api-access-thjv9\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:00:02.471683 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:02.471682    2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d412b801-5299-4cd1-a0d5-01174d285981-webhook-cert\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:00:03.019553 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:03.019519    2583 generic.go:356] "Generic (PLEG): container finished" podID="d412b801-5299-4cd1-a0d5-01174d285981" containerID="e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04" exitCode=0
Jul 14 22:00:03.019553 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:03.019557    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-959bdb455-j5z2l"
Jul 14 22:00:03.019986 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:03.019580    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-959bdb455-j5z2l" event={"ID":"d412b801-5299-4cd1-a0d5-01174d285981","Type":"ContainerDied","Data":"e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04"}
Jul 14 22:00:03.019986 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:03.019626    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-959bdb455-j5z2l" event={"ID":"d412b801-5299-4cd1-a0d5-01174d285981","Type":"ContainerDied","Data":"0c78f602b48284312e537d62c525210070242cf77ca04ae26ea14686930c0c66"}
Jul 14 22:00:03.019986 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:03.019649    2583 scope.go:117] "RemoveContainer" containerID="e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04"
Jul 14 22:00:03.028264 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:03.028246    2583 scope.go:117] "RemoveContainer" containerID="e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04"
Jul 14 22:00:03.028505 ip-10-0-142-126 kubenswrapper[2583]: E0714 22:00:03.028488    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04\": container with ID starting with e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04 not found: ID does not exist" containerID="e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04"
Jul 14 22:00:03.028554 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:03.028513    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04"} err="failed to get container status \"e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04\": rpc error: code = NotFound desc = could not find container \"e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04\": container with ID starting with e4889317f11ab272cb64bd7171ac266adf35a37aa83889d73852a31e58b9ff04 not found: ID does not exist"
Jul 14 22:00:03.039661 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:03.039639    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-959bdb455-j5z2l"]
Jul 14 22:00:03.043600 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:03.043579    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-959bdb455-j5z2l"]
Jul 14 22:00:03.585073 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:03.585042    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d412b801-5299-4cd1-a0d5-01174d285981" path="/var/lib/kubelet/pods/d412b801-5299-4cd1-a0d5-01174d285981/volumes"
Jul 14 22:00:23.390255 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:23.390222    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:00:41.547297 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:41.547272    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:00:41.549821 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:41.549789    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:00:52.402956 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.402923    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"]
Jul 14 22:00:52.403467 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.403282    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d412b801-5299-4cd1-a0d5-01174d285981" containerName="manager"
Jul 14 22:00:52.403467 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.403294    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d412b801-5299-4cd1-a0d5-01174d285981" containerName="manager"
Jul 14 22:00:52.403467 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.403350    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d412b801-5299-4cd1-a0d5-01174d285981" containerName="manager"
Jul 14 22:00:52.406255 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.406237    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.410291 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.410267    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 14 22:00:52.410291 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.410290    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 22:00:52.410462 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.410268    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9zfdw\""
Jul 14 22:00:52.410462 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.410267    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 22:00:52.416588 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.416564    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"]
Jul 14 22:00:52.511097 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.511064    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.511097 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.511105    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsrfs\" (UniqueName: \"kubernetes.io/projected/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-kube-api-access-jsrfs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.511313 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.511149    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.511313 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.511198    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.511313 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.511247    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.511313 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.511291    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.612049 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.611988    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsrfs\" (UniqueName: \"kubernetes.io/projected/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-kube-api-access-jsrfs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.612234 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.612077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.612234 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.612103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.612234 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.612148    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.612234 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.612179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.612234 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.612212    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.612641 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.612617    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.612710 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.612641    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.612710 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.612665    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.614396 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.614365    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.614528 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.614501    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.620321 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.620301    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsrfs\" (UniqueName: \"kubernetes.io/projected/7651312c-1adf-4f14-8d14-9d2ca3fc5bfc-kube-api-access-jsrfs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8\" (UID: \"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.716823 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.716732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:00:52.844118 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:52.844095    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"]
Jul 14 22:00:52.846114 ip-10-0-142-126 kubenswrapper[2583]: W0714 22:00:52.846087    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7651312c_1adf_4f14_8d14_9d2ca3fc5bfc.slice/crio-c14e7bc8d9ebc1c745f9a4f991ba1abd58eacd58d4c7f291f7f1f4c1b516d4c0 WatchSource:0}: Error finding container c14e7bc8d9ebc1c745f9a4f991ba1abd58eacd58d4c7f291f7f1f4c1b516d4c0: Status 404 returned error can't find the container with id c14e7bc8d9ebc1c745f9a4f991ba1abd58eacd58d4c7f291f7f1f4c1b516d4c0
Jul 14 22:00:53.134445 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:53.133824    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:00:53.248910 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:53.248878    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8" event={"ID":"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc","Type":"ContainerStarted","Data":"c14e7bc8d9ebc1c745f9a4f991ba1abd58eacd58d4c7f291f7f1f4c1b516d4c0"}
Jul 14 22:00:54.254373 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:54.254296    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8" event={"ID":"7651312c-1adf-4f14-8d14-9d2ca3fc5bfc","Type":"ContainerStarted","Data":"25e585c2c43a73b39aaba52199b6cfc4ef9ec1d2dd3ed3506fac88d08c9eec02"}
Jul 14 22:00:54.275910 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:00:54.275843    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8" podStartSLOduration=1.168209387 podStartE2EDuration="2.275827015s" totalImagesPullingTime="1.107617628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:00:54.27441563 +0000 UTC m=+613.186255111" watchObservedRunningTime="2026-07-14 22:00:54.275827015 +0000 UTC m=+613.187666476"
Jul 14 22:01:01.997200 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:01.997162    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:01:02.717754 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:02.717713    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:01:02.717958 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:02.717774    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:01:02.730046 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:02.730015    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:01:03.304852 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:03.304823    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8"
Jul 14 22:01:22.219050 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.219017    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"]
Jul 14 22:01:22.225037 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.225014    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.232431 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.232417    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 14 22:01:22.253460 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.253439    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"]
Jul 14 22:01:22.255038 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.255018    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a13a6985-b2bb-4cd1-b754-d3347ec37909-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.255124 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.255059    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59hhm\" (UniqueName: \"kubernetes.io/projected/a13a6985-b2bb-4cd1-b754-d3347ec37909-kube-api-access-59hhm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.255124 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.255103    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a13a6985-b2bb-4cd1-b754-d3347ec37909-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.255203 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.255122    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a13a6985-b2bb-4cd1-b754-d3347ec37909-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.255203 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.255173    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a13a6985-b2bb-4cd1-b754-d3347ec37909-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.255203 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.255191    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a13a6985-b2bb-4cd1-b754-d3347ec37909-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.355741 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.355717    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a13a6985-b2bb-4cd1-b754-d3347ec37909-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.355904 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.355751    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59hhm\" (UniqueName: \"kubernetes.io/projected/a13a6985-b2bb-4cd1-b754-d3347ec37909-kube-api-access-59hhm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.355904 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.355783    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a13a6985-b2bb-4cd1-b754-d3347ec37909-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.355904 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.355801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a13a6985-b2bb-4cd1-b754-d3347ec37909-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.355904 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.355827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a13a6985-b2bb-4cd1-b754-d3347ec37909-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.355904 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.355843    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a13a6985-b2bb-4cd1-b754-d3347ec37909-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.356173 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.356150    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a13a6985-b2bb-4cd1-b754-d3347ec37909-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.356211 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.356192    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a13a6985-b2bb-4cd1-b754-d3347ec37909-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.356245 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.356231    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a13a6985-b2bb-4cd1-b754-d3347ec37909-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.358057 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.358030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a13a6985-b2bb-4cd1-b754-d3347ec37909-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.358425 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.358404    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a13a6985-b2bb-4cd1-b754-d3347ec37909-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.364365 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.364346    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59hhm\" (UniqueName: \"kubernetes.io/projected/a13a6985-b2bb-4cd1-b754-d3347ec37909-kube-api-access-59hhm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fvcbj\" (UID: \"a13a6985-b2bb-4cd1-b754-d3347ec37909\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.534611 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.534535    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:22.661533 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.661508    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"]
Jul 14 22:01:22.664917 ip-10-0-142-126 kubenswrapper[2583]: W0714 22:01:22.664890    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13a6985_b2bb_4cd1_b754_d3347ec37909.slice/crio-0fc40ad0b4af2299698c5163e79d4dcbc149a0e8a9f7721f8e0a8aa847bd867b WatchSource:0}: Error finding container 0fc40ad0b4af2299698c5163e79d4dcbc149a0e8a9f7721f8e0a8aa847bd867b: Status 404 returned error can't find the container with id 0fc40ad0b4af2299698c5163e79d4dcbc149a0e8a9f7721f8e0a8aa847bd867b
Jul 14 22:01:22.666247 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:22.666223    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 22:01:23.383966 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:23.383930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj" event={"ID":"a13a6985-b2bb-4cd1-b754-d3347ec37909","Type":"ContainerStarted","Data":"513bb6ca71323ae9d8003aca4248db123d30c78d3db6ef1fd55536151a20986f"}
Jul 14 22:01:23.384401 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:23.384029    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj" event={"ID":"a13a6985-b2bb-4cd1-b754-d3347ec37909","Type":"ContainerStarted","Data":"0fc40ad0b4af2299698c5163e79d4dcbc149a0e8a9f7721f8e0a8aa847bd867b"}
Jul 14 22:01:23.402399 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:23.402356    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj" podStartSLOduration=1.1777389010000001 podStartE2EDuration="1.402342347s" totalImagesPullingTime="224.603446ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:01:23.400473458 +0000 UTC m=+642.312312920" watchObservedRunningTime="2026-07-14 22:01:23.402342347 +0000 UTC m=+642.314181809"
Jul 14 22:01:23.489635 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:23.489601    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:01:32.535230 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:32.535197    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:32.535633 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:32.535287    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:32.547547 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:32.547527    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:33.438077 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:33.438045    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fvcbj"
Jul 14 22:01:43.194380 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:01:43.194344    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:02:01.096489 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:01.096448    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:02:10.174872 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.174843    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"]
Jul 14 22:02:10.177245 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.177219    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.180176 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.180144    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 14 22:02:10.208054 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.208022    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"]
Jul 14 22:02:10.265017 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.264967    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbslk\" (UniqueName: \"kubernetes.io/projected/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-kube-api-access-cbslk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.265159 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.265028    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.265159 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.265070    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.265159 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.265118    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.265318 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.265157    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.265318 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.265184    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.366262 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.366228    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbslk\" (UniqueName: \"kubernetes.io/projected/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-kube-api-access-cbslk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.366416 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.366270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.366416 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.366290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.366416 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.366326    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.366416 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.366352    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.366416 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.366367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.366702 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.366678    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.366782 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.366759    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.366824 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.366795    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.368742 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.368720    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.368859 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.368843    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.376365 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.376341    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbslk\" (UniqueName: \"kubernetes.io/projected/64fc0c68-230b-4a55-bb3f-7cb027e7aea9-kube-api-access-cbslk\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj\" (UID: \"64fc0c68-230b-4a55-bb3f-7cb027e7aea9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.505902 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.505819    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:10.633102 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:10.633075    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"]
Jul 14 22:02:10.635008 ip-10-0-142-126 kubenswrapper[2583]: W0714 22:02:10.634973    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64fc0c68_230b_4a55_bb3f_7cb027e7aea9.slice/crio-20c70a4d5c975c9c02c7a22b75a59dd388e945358b38d9fafcfc5239d8365cb1 WatchSource:0}: Error finding container 20c70a4d5c975c9c02c7a22b75a59dd388e945358b38d9fafcfc5239d8365cb1: Status 404 returned error can't find the container with id 20c70a4d5c975c9c02c7a22b75a59dd388e945358b38d9fafcfc5239d8365cb1
Jul 14 22:02:11.597157 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:11.597128    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj" event={"ID":"64fc0c68-230b-4a55-bb3f-7cb027e7aea9","Type":"ContainerStarted","Data":"33e27ba565320bb5f8b241537ed011e25c0dc13a466bc4c52d805863d6a4eef5"}
Jul 14 22:02:11.597525 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:11.597164    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj" event={"ID":"64fc0c68-230b-4a55-bb3f-7cb027e7aea9","Type":"ContainerStarted","Data":"20c70a4d5c975c9c02c7a22b75a59dd388e945358b38d9fafcfc5239d8365cb1"}
Jul 14 22:02:11.617086 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:11.617042    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj" podStartSLOduration=1.4154063080000001 podStartE2EDuration="1.617028129s" totalImagesPullingTime="201.621821ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:02:11.615145873 +0000 UTC m=+690.526985353" watchObservedRunningTime="2026-07-14 22:02:11.617028129 +0000 UTC m=+690.528867590"
Jul 14 22:02:11.897597 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:11.897522    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:02:20.506427 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:20.506389    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:20.506738 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:20.506447    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:20.518920 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:20.518897    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:02:20.651646 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:02:20.651617    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj"
Jul 14 22:03:00.793215 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:00.793127    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85bbc67d46-fx6pk"]
Jul 14 22:03:00.796799 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:00.796777    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bbc67d46-fx6pk"
Jul 14 22:03:00.800667 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:00.800649    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 14 22:03:00.800777 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:00.800652    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6225n\""
Jul 14 22:03:00.804204 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:00.804179    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85bbc67d46-fx6pk"]
Jul 14 22:03:00.827015 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:00.826979    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57vbt\" (UniqueName: \"kubernetes.io/projected/ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e-kube-api-access-57vbt\") pod \"authorino-85bbc67d46-fx6pk\" (UID: \"ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e\") " pod="kuadrant-system/authorino-85bbc67d46-fx6pk"
Jul 14 22:03:00.827131 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:00.827116    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e-tls-cert\") pod \"authorino-85bbc67d46-fx6pk\" (UID: \"ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e\") " pod="kuadrant-system/authorino-85bbc67d46-fx6pk"
Jul 14 22:03:00.927814 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:00.927780    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57vbt\" (UniqueName: \"kubernetes.io/projected/ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e-kube-api-access-57vbt\") pod \"authorino-85bbc67d46-fx6pk\" (UID: \"ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e\") " pod="kuadrant-system/authorino-85bbc67d46-fx6pk"
Jul 14 22:03:00.928004 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:00.927870    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e-tls-cert\") pod \"authorino-85bbc67d46-fx6pk\" (UID: \"ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e\") " pod="kuadrant-system/authorino-85bbc67d46-fx6pk"
Jul 14 22:03:00.930473 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:00.930450    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e-tls-cert\") pod \"authorino-85bbc67d46-fx6pk\" (UID: \"ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e\") " pod="kuadrant-system/authorino-85bbc67d46-fx6pk"
Jul 14 22:03:00.935424 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:00.935399    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57vbt\" (UniqueName: \"kubernetes.io/projected/ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e-kube-api-access-57vbt\") pod \"authorino-85bbc67d46-fx6pk\" (UID: \"ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e\") " pod="kuadrant-system/authorino-85bbc67d46-fx6pk"
Jul 14 22:03:01.108746 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:01.108715    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bbc67d46-fx6pk"
Jul 14 22:03:01.240636 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:01.240613    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85bbc67d46-fx6pk"]
Jul 14 22:03:01.242719 ip-10-0-142-126 kubenswrapper[2583]: W0714 22:03:01.242691    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad03179c_3a11_4e5e_af4d_ab00a1ae3e5e.slice/crio-c3c7400bff51186fae1b5e90c771652f00d8d98ab00f7f0f0336da335ca7719e WatchSource:0}: Error finding container c3c7400bff51186fae1b5e90c771652f00d8d98ab00f7f0f0336da335ca7719e: Status 404 returned error can't find the container with id c3c7400bff51186fae1b5e90c771652f00d8d98ab00f7f0f0336da335ca7719e
Jul 14 22:03:01.835908 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:01.835877    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bbc67d46-fx6pk" event={"ID":"ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e","Type":"ContainerStarted","Data":"c2833ab3dfa183f2f2f288bcde35979635815d92820d30eede22eabd1e3bc0fc"}
Jul 14 22:03:01.836310 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:01.835932    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bbc67d46-fx6pk" event={"ID":"ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e","Type":"ContainerStarted","Data":"c3c7400bff51186fae1b5e90c771652f00d8d98ab00f7f0f0336da335ca7719e"}
Jul 14 22:03:01.851569 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:01.851513    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85bbc67d46-fx6pk" podStartSLOduration=1.334906944 podStartE2EDuration="1.851490636s" totalImagesPullingTime="516.583692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:03:01.851065252 +0000 UTC m=+740.762904721" watchObservedRunningTime="2026-07-14 22:03:01.851490636 +0000 UTC m=+740.763330100"
Jul 14 22:03:30.792780 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:30.792748    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:03:40.887680 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:40.887653    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:03:51.188321 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:03:51.188283    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:04:00.799936 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:00.799904    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:04:11.089042 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:11.088942    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:04:13.005804 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:13.005771    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cb88b8588-qgx5f"]
Jul 14 22:04:13.006321 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:13.005984    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5cb88b8588-qgx5f" podUID="93de8137-789e-4845-b69b-037db718a7ef" containerName="manager" containerID="cri-o://b9247298e230a0e727cd3dd9341fc3561e5bf30d1f4614f28ed5c973e4232bdf" gracePeriod=30
Jul 14 22:04:13.159402 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:13.159361    2583 generic.go:356] "Generic (PLEG): container finished" podID="93de8137-789e-4845-b69b-037db718a7ef" containerID="b9247298e230a0e727cd3dd9341fc3561e5bf30d1f4614f28ed5c973e4232bdf" exitCode=0
Jul 14 22:04:13.159553 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:13.159424    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb88b8588-qgx5f" event={"ID":"93de8137-789e-4845-b69b-037db718a7ef","Type":"ContainerDied","Data":"b9247298e230a0e727cd3dd9341fc3561e5bf30d1f4614f28ed5c973e4232bdf"}
Jul 14 22:04:13.249286 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:13.249260    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb88b8588-qgx5f"
Jul 14 22:04:13.379710 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:13.379678    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93de8137-789e-4845-b69b-037db718a7ef-webhook-cert\") pod \"93de8137-789e-4845-b69b-037db718a7ef\" (UID: \"93de8137-789e-4845-b69b-037db718a7ef\") "
Jul 14 22:04:13.379902 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:13.379733    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqhjg\" (UniqueName: \"kubernetes.io/projected/93de8137-789e-4845-b69b-037db718a7ef-kube-api-access-gqhjg\") pod \"93de8137-789e-4845-b69b-037db718a7ef\" (UID: \"93de8137-789e-4845-b69b-037db718a7ef\") "
Jul 14 22:04:13.381608 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:13.381585    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93de8137-789e-4845-b69b-037db718a7ef-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "93de8137-789e-4845-b69b-037db718a7ef" (UID: "93de8137-789e-4845-b69b-037db718a7ef"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:04:13.381696 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:13.381655    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93de8137-789e-4845-b69b-037db718a7ef-kube-api-access-gqhjg" (OuterVolumeSpecName: "kube-api-access-gqhjg") pod "93de8137-789e-4845-b69b-037db718a7ef" (UID: "93de8137-789e-4845-b69b-037db718a7ef"). InnerVolumeSpecName "kube-api-access-gqhjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:04:13.480724 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:13.480691    2583 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93de8137-789e-4845-b69b-037db718a7ef-webhook-cert\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:04:13.480724 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:13.480718    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqhjg\" (UniqueName: \"kubernetes.io/projected/93de8137-789e-4845-b69b-037db718a7ef-kube-api-access-gqhjg\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:04:13.624299 ip-10-0-142-126 kubenswrapper[2583]: E0714 22:04:13.624270    2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93de8137_789e_4845_b69b_037db718a7ef.slice/crio-cdf6e60d0a2701262399b7c24ffb76a036cdd987988a713900d972dbde4c9f88\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93de8137_789e_4845_b69b_037db718a7ef.slice\": RecentStats: unable to find data in memory cache]"
Jul 14 22:04:14.166282 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:14.166251    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb88b8588-qgx5f"
Jul 14 22:04:14.166282 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:14.166275    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb88b8588-qgx5f" event={"ID":"93de8137-789e-4845-b69b-037db718a7ef","Type":"ContainerDied","Data":"cdf6e60d0a2701262399b7c24ffb76a036cdd987988a713900d972dbde4c9f88"}
Jul 14 22:04:14.166737 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:14.166329    2583 scope.go:117] "RemoveContainer" containerID="b9247298e230a0e727cd3dd9341fc3561e5bf30d1f4614f28ed5c973e4232bdf"
Jul 14 22:04:14.189982 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:14.189928    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cb88b8588-qgx5f"]
Jul 14 22:04:14.197548 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:14.197523    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cb88b8588-qgx5f"]
Jul 14 22:04:14.988132 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:14.988096    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cb88b8588-jkr44"]
Jul 14 22:04:14.988466 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:14.988453    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93de8137-789e-4845-b69b-037db718a7ef" containerName="manager"
Jul 14 22:04:14.988509 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:14.988466    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="93de8137-789e-4845-b69b-037db718a7ef" containerName="manager"
Jul 14 22:04:14.988545 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:14.988525    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="93de8137-789e-4845-b69b-037db718a7ef" containerName="manager"
Jul 14 22:04:14.992668 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:14.992652    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb88b8588-jkr44"
Jul 14 22:04:14.995892 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:14.995866    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 14 22:04:14.996965 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:14.996952    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 14 22:04:14.997049 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:14.997021    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rvwns\""
Jul 14 22:04:15.000577 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:15.000556    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cb88b8588-jkr44"]
Jul 14 22:04:15.094297 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:15.094262    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9580f277-2f69-445b-8397-b06752747bc4-webhook-cert\") pod \"maas-controller-5cb88b8588-jkr44\" (UID: \"9580f277-2f69-445b-8397-b06752747bc4\") " pod="opendatahub/maas-controller-5cb88b8588-jkr44"
Jul 14 22:04:15.094467 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:15.094325    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w85bp\" (UniqueName: \"kubernetes.io/projected/9580f277-2f69-445b-8397-b06752747bc4-kube-api-access-w85bp\") pod \"maas-controller-5cb88b8588-jkr44\" (UID: \"9580f277-2f69-445b-8397-b06752747bc4\") " pod="opendatahub/maas-controller-5cb88b8588-jkr44"
Jul 14 22:04:15.195837 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:15.195809    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9580f277-2f69-445b-8397-b06752747bc4-webhook-cert\") pod \"maas-controller-5cb88b8588-jkr44\" (UID: \"9580f277-2f69-445b-8397-b06752747bc4\") " pod="opendatahub/maas-controller-5cb88b8588-jkr44"
Jul 14 22:04:15.196228 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:15.195869    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w85bp\" (UniqueName: \"kubernetes.io/projected/9580f277-2f69-445b-8397-b06752747bc4-kube-api-access-w85bp\") pod \"maas-controller-5cb88b8588-jkr44\" (UID: \"9580f277-2f69-445b-8397-b06752747bc4\") " pod="opendatahub/maas-controller-5cb88b8588-jkr44"
Jul 14 22:04:15.198312 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:15.198291    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9580f277-2f69-445b-8397-b06752747bc4-webhook-cert\") pod \"maas-controller-5cb88b8588-jkr44\" (UID: \"9580f277-2f69-445b-8397-b06752747bc4\") " pod="opendatahub/maas-controller-5cb88b8588-jkr44"
Jul 14 22:04:15.204774 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:15.204751    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w85bp\" (UniqueName: \"kubernetes.io/projected/9580f277-2f69-445b-8397-b06752747bc4-kube-api-access-w85bp\") pod \"maas-controller-5cb88b8588-jkr44\" (UID: \"9580f277-2f69-445b-8397-b06752747bc4\") " pod="opendatahub/maas-controller-5cb88b8588-jkr44"
Jul 14 22:04:15.303857 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:15.303822    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cb88b8588-jkr44"
Jul 14 22:04:15.430499 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:15.430471    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cb88b8588-jkr44"]
Jul 14 22:04:15.432545 ip-10-0-142-126 kubenswrapper[2583]: W0714 22:04:15.432519    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9580f277_2f69_445b_8397_b06752747bc4.slice/crio-65ea89f3cc83d8328be1663676689c8639f065eb85d4e66c2f8bccca32e047f6 WatchSource:0}: Error finding container 65ea89f3cc83d8328be1663676689c8639f065eb85d4e66c2f8bccca32e047f6: Status 404 returned error can't find the container with id 65ea89f3cc83d8328be1663676689c8639f065eb85d4e66c2f8bccca32e047f6
Jul 14 22:04:15.589668 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:15.589589    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93de8137-789e-4845-b69b-037db718a7ef" path="/var/lib/kubelet/pods/93de8137-789e-4845-b69b-037db718a7ef/volumes"
Jul 14 22:04:16.178215 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:16.178111    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb88b8588-jkr44" event={"ID":"9580f277-2f69-445b-8397-b06752747bc4","Type":"ContainerStarted","Data":"c6d5dfe56f8de12ea9291f051124d93165b026d40fefdd18fe665fb364f23ede"}
Jul 14 22:04:16.178215 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:16.178179    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cb88b8588-jkr44" event={"ID":"9580f277-2f69-445b-8397-b06752747bc4","Type":"ContainerStarted","Data":"65ea89f3cc83d8328be1663676689c8639f065eb85d4e66c2f8bccca32e047f6"}
Jul 14 22:04:16.178215 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:16.178201    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cb88b8588-jkr44"
Jul 14 22:04:16.195784 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:16.195735    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5cb88b8588-jkr44" podStartSLOduration=1.770205068 podStartE2EDuration="2.195720286s" totalImagesPullingTime="425.515218ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:04:16.195115425 +0000 UTC m=+815.106954885" watchObservedRunningTime="2026-07-14 22:04:16.195720286 +0000 UTC m=+815.107559746"
Jul 14 22:04:27.185435 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:27.185405    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cb88b8588-jkr44"
Jul 14 22:04:39.410568 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:39.410527    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:04:52.400157 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:04:52.400121    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:05:29.098680 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:05:29.098642    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:05:37.505018 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:05:37.504914    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:05:41.580561 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:05:41.580528    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:05:41.581056 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:05:41.581041    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:05:48.513331 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:05:48.513289    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:05:55.904081 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:05:55.904043    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:06:07.400904 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:06:07.400870    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:06:18.798114 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:06:18.798077    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:06:29.727503 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:06:29.727470    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:06:39.809387 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:06:39.809349    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:06:51.605786 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:06:51.605755    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:07:02.399100 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:07:02.399063    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:07:17.588482 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:07:17.588446    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:07:29.696306 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:07:29.696277    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:07:53.197087 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:07:53.197055    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:08:04.399627 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:08:04.399590    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:08:19.408553 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:08:19.408519    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:08:29.097918 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:08:29.097879    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:08:38.901691 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:08:38.901611    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:08:48.601393 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:08:48.601359    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:08:58.405180 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:08:58.405146    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:10:41.608139 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:10:41.608113    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:10:41.611108 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:10:41.611087    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:10:47.791747 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:10:47.791711    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:11:00.197114 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:11:00.197072    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:11:10.083350 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:11:10.083319    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:11:22.595495 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:11:22.595462    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:11:32.604133 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:11:32.604102    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:11:45.084415 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:11:45.084335    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:11:52.994501 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:11:52.994465    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:12:03.402894 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:12:03.402860    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:12:14.328215 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:12:14.328181    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:12:24.600453 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:12:24.600420    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:12:36.505496 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:12:36.505464    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:12:58.492348 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:12:58.492315    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:13:08.321333 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:13:08.321251    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:13:18.286263 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:13:18.286225    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:13:28.108220 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:13:28.108180    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:13:36.411783 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:13:36.411739    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:13:54.396716 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:13:54.396681    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:14:04.210548 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:14:04.210511    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:14:13.500952 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:14:13.500919    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:14:23.999283 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:14:23.999248    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:14:33.499790 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:14:33.499753    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:14:44.598517 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:14:44.598475    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:15:01.794093 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:15:01.794056    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:15:15.600546 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:15:15.600512    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:15:27.800301 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:15:27.800264    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:15:39.295597 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:15:39.295562    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:15:41.636837 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:15:41.636803    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:15:41.640882 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:15:41.640858    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:15:48.688007 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:15:48.687965    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:16:01.704157 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:16:01.704124    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:16:14.385706 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:16:14.385669    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:16:28.291112 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:16:28.291075    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:16:39.989382 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:16:39.989351    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:16:50.692870 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:16:50.692836    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:17:02.402009 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:17:02.401964    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:17:12.996043 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:17:12.996006    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:18:19.598701 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:18:19.598666    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:18:35.894872 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:18:35.894837    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:19:40.591083 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:19:40.591044    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:19:54.391060 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:19:54.391018    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:20:41.664259 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:20:41.664230    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:20:41.670692 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:20:41.670671    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:20:59.597664 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:20:59.597621    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:21:16.403593 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:21:16.403543    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:22:31.693796 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:22:31.693753    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:24:06.607194 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:24:06.607101    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:24:15.596698 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:24:15.596653    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:24:29.296834 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:24:29.296795    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:24:49.502859 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:24:49.502826    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:25:29.297500 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:25:29.297457    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:25:41.690950 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:25:41.690920    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:25:41.699046 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:25:41.699026    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:25:49.707578 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:25:49.707540    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:26:03.693174 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:26:03.693135    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:26:21.186779 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:26:21.186745    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:27:18.606139 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:27:18.606101    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:27:32.004781 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:27:32.004744    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:28:21.230799 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:21.230761    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:28:32.106346 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:32.106310    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:28:36.694061 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.694025    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"]
Jul 14 22:28:36.697374 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.697360    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.701781 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.701756    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6a0cfb\"/\"test-model-6a0cfb-kserve-self-signed-certs\""
Jul 14 22:28:36.701919 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.701818    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6a0cfb\"/\"openshift-service-ca.crt\""
Jul 14 22:28:36.701919 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.701823    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-6a0cfb\"/\"default-dockercfg-d4q7p\""
Jul 14 22:28:36.702115 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.702100    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-6a0cfb\"/\"kube-root-ca.crt\""
Jul 14 22:28:36.714105 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.714086    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"]
Jul 14 22:28:36.806452 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.806424    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-model-cache\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.806577 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.806460    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-tls-certs\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.806577 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.806535    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-dshm\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.806686 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.806593    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-home\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.806686 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.806646    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jz6v\" (UniqueName: \"kubernetes.io/projected/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-kube-api-access-8jz6v\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.806784 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.806706    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-tmp-dir\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.907075 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.907048    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jz6v\" (UniqueName: \"kubernetes.io/projected/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-kube-api-access-8jz6v\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.907255 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.907082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-tmp-dir\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.907255 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.907206    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-model-cache\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.907255 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.907244    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-tls-certs\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.907435 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.907304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-dshm\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.907435 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.907351    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-home\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.907500 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.907448    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-tmp-dir\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.907569 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.907547    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-model-cache\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.907632 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.907619    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-home\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.909390 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.909369    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-dshm\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.909693 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.909654    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-tls-certs\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:36.915877 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:36.915856    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jz6v\" (UniqueName: \"kubernetes.io/projected/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-kube-api-access-8jz6v\") pod \"test-model-6a0cfb-kserve-b56886f49-ckhsk\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") " pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:37.006011 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:37.005915    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:37.136371 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:37.136350    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"]
Jul 14 22:28:37.138669 ip-10-0-142-126 kubenswrapper[2583]: W0714 22:28:37.138644    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0dfb82a_c1a2_41e6_86c2_013cc060fca0.slice/crio-9ee291eada344c1f9c40b4f447140699cef6fc97eba99839f8f5b414640c402b WatchSource:0}: Error finding container 9ee291eada344c1f9c40b4f447140699cef6fc97eba99839f8f5b414640c402b: Status 404 returned error can't find the container with id 9ee291eada344c1f9c40b4f447140699cef6fc97eba99839f8f5b414640c402b
Jul 14 22:28:37.957524 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:37.957494    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk" event={"ID":"e0dfb82a-c1a2-41e6-86c2-013cc060fca0","Type":"ContainerStarted","Data":"f85b5d78195ebd0777aa9970eb97ac268f761844d170a7bbc93bd41db7114bd9"}
Jul 14 22:28:37.957864 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:37.957535    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk" event={"ID":"e0dfb82a-c1a2-41e6-86c2-013cc060fca0","Type":"ContainerStarted","Data":"9ee291eada344c1f9c40b4f447140699cef6fc97eba99839f8f5b414640c402b"}
Jul 14 22:28:37.975861 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:37.975820    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk" podStartSLOduration=1.9758051540000001 podStartE2EDuration="1.975805154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:28:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:28:37.974797345 +0000 UTC m=+2276.886636825" watchObservedRunningTime="2026-07-14 22:28:37.975805154 +0000 UTC m=+2276.887644613"
Jul 14 22:28:41.197224 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:41.197191    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:28:47.014019 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:47.013971    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:47.015087 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:47.015064    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:47.042423 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:47.042399    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:48.015315 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:48.015282    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:28:53.003730 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:28:53.003694    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:29:13.811389 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:13.811350    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:29:27.615597 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:27.615562    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:29:34.537695 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:34.537616    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"]
Jul 14 22:29:41.401295 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:41.401259    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:29:49.556797 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.556760    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk" podUID="e0dfb82a-c1a2-41e6-86c2-013cc060fca0" containerName="main" containerID="cri-o://f85b5d78195ebd0777aa9970eb97ac268f761844d170a7bbc93bd41db7114bd9" gracePeriod=45
Jul 14 22:29:49.801641 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.801615    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:29:49.868169 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.868092    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-tmp-dir\") pod \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") "
Jul 14 22:29:49.868169 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.868170    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-model-cache\") pod \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") "
Jul 14 22:29:49.868371 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.868189    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-home\") pod \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") "
Jul 14 22:29:49.868371 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.868213    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-dshm\") pod \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") "
Jul 14 22:29:49.868371 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.868229    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jz6v\" (UniqueName: \"kubernetes.io/projected/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-kube-api-access-8jz6v\") pod \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") "
Jul 14 22:29:49.868371 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.868251    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-tls-certs\") pod \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\" (UID: \"e0dfb82a-c1a2-41e6-86c2-013cc060fca0\") "
Jul 14 22:29:49.868371 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.868348    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e0dfb82a-c1a2-41e6-86c2-013cc060fca0" (UID: "e0dfb82a-c1a2-41e6-86c2-013cc060fca0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:29:49.868611 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.868451    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-home" (OuterVolumeSpecName: "home") pod "e0dfb82a-c1a2-41e6-86c2-013cc060fca0" (UID: "e0dfb82a-c1a2-41e6-86c2-013cc060fca0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:29:49.868611 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.868464    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-model-cache" (OuterVolumeSpecName: "model-cache") pod "e0dfb82a-c1a2-41e6-86c2-013cc060fca0" (UID: "e0dfb82a-c1a2-41e6-86c2-013cc060fca0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:29:49.868699 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.868628    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-tmp-dir\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:29:49.868699 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.868643    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-model-cache\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:29:49.868699 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.868652    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-home\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:29:49.870225 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.870194    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e0dfb82a-c1a2-41e6-86c2-013cc060fca0" (UID: "e0dfb82a-c1a2-41e6-86c2-013cc060fca0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:29:49.870371 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.870280    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-dshm" (OuterVolumeSpecName: "dshm") pod "e0dfb82a-c1a2-41e6-86c2-013cc060fca0" (UID: "e0dfb82a-c1a2-41e6-86c2-013cc060fca0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:29:49.870371 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.870289    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-kube-api-access-8jz6v" (OuterVolumeSpecName: "kube-api-access-8jz6v") pod "e0dfb82a-c1a2-41e6-86c2-013cc060fca0" (UID: "e0dfb82a-c1a2-41e6-86c2-013cc060fca0"). InnerVolumeSpecName "kube-api-access-8jz6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:29:49.969359 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.969335    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-dshm\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:29:49.969359 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.969359    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jz6v\" (UniqueName: \"kubernetes.io/projected/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-kube-api-access-8jz6v\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:29:49.969491 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:49.969374    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0dfb82a-c1a2-41e6-86c2-013cc060fca0-tls-certs\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:29:50.281348 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:50.281269    2583 generic.go:356] "Generic (PLEG): container finished" podID="e0dfb82a-c1a2-41e6-86c2-013cc060fca0" containerID="f85b5d78195ebd0777aa9970eb97ac268f761844d170a7bbc93bd41db7114bd9" exitCode=0
Jul 14 22:29:50.281348 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:50.281316    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"
Jul 14 22:29:50.281537 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:50.281349    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk" event={"ID":"e0dfb82a-c1a2-41e6-86c2-013cc060fca0","Type":"ContainerDied","Data":"f85b5d78195ebd0777aa9970eb97ac268f761844d170a7bbc93bd41db7114bd9"}
Jul 14 22:29:50.281537 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:50.281385    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk" event={"ID":"e0dfb82a-c1a2-41e6-86c2-013cc060fca0","Type":"ContainerDied","Data":"9ee291eada344c1f9c40b4f447140699cef6fc97eba99839f8f5b414640c402b"}
Jul 14 22:29:50.281537 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:50.281406    2583 scope.go:117] "RemoveContainer" containerID="f85b5d78195ebd0777aa9970eb97ac268f761844d170a7bbc93bd41db7114bd9"
Jul 14 22:29:50.296291 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:50.296273    2583 scope.go:117] "RemoveContainer" containerID="f85b5d78195ebd0777aa9970eb97ac268f761844d170a7bbc93bd41db7114bd9"
Jul 14 22:29:50.296531 ip-10-0-142-126 kubenswrapper[2583]: E0714 22:29:50.296512    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f85b5d78195ebd0777aa9970eb97ac268f761844d170a7bbc93bd41db7114bd9\": container with ID starting with f85b5d78195ebd0777aa9970eb97ac268f761844d170a7bbc93bd41db7114bd9 not found: ID does not exist" containerID="f85b5d78195ebd0777aa9970eb97ac268f761844d170a7bbc93bd41db7114bd9"
Jul 14 22:29:50.296581 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:50.296538    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f85b5d78195ebd0777aa9970eb97ac268f761844d170a7bbc93bd41db7114bd9"} err="failed to get container status \"f85b5d78195ebd0777aa9970eb97ac268f761844d170a7bbc93bd41db7114bd9\": rpc error: code = NotFound desc = could not find container \"f85b5d78195ebd0777aa9970eb97ac268f761844d170a7bbc93bd41db7114bd9\": container with ID starting with f85b5d78195ebd0777aa9970eb97ac268f761844d170a7bbc93bd41db7114bd9 not found: ID does not exist"
Jul 14 22:29:50.310124 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:50.310098    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"]
Jul 14 22:29:50.314668 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:50.314647    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-6a0cfb/test-model-6a0cfb-kserve-b56886f49-ckhsk"]
Jul 14 22:29:51.584774 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:51.584741    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0dfb82a-c1a2-41e6-86c2-013cc060fca0" path="/var/lib/kubelet/pods/e0dfb82a-c1a2-41e6-86c2-013cc060fca0/volumes"
Jul 14 22:29:53.191495 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:29:53.191463    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:30:15.797393 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:30:15.797360    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:30:35.512742 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:30:35.512709    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:30:41.724285 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:30:41.724259    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:30:41.732644 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:30:41.732625    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:30:51.203973 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:30:51.203929    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:31:07.512004 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:31:07.511908    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:31:34.556097 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:31:34.556064    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:31:56.221071 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:31:56.221039    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:32:09.289047 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:09.289015    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:32:12.690126 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.690080    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"]
Jul 14 22:32:12.690653 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.690632    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0dfb82a-c1a2-41e6-86c2-013cc060fca0" containerName="main"
Jul 14 22:32:12.690719 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.690657    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0dfb82a-c1a2-41e6-86c2-013cc060fca0" containerName="main"
Jul 14 22:32:12.690798 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.690785    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0dfb82a-c1a2-41e6-86c2-013cc060fca0" containerName="main"
Jul 14 22:32:12.694248 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.694229    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.698283 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.698263    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fdfd38\"/\"auth-test-model-fdfd38-kserve-self-signed-certs\""
Jul 14 22:32:12.698283 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.698273    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fdfd38\"/\"default-dockercfg-r6g2p\""
Jul 14 22:32:12.698449 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.698263    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fdfd38\"/\"kube-root-ca.crt\""
Jul 14 22:32:12.698449 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.698300    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fdfd38\"/\"openshift-service-ca.crt\""
Jul 14 22:32:12.704038 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.704017    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"]
Jul 14 22:32:12.807010 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.806974    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-model-cache\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.807144 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.807039    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-dshm\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.807144 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.807073    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07eeff86-1b57-465e-bbd4-dd2245ca32c9-tls-certs\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.807144 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.807089    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-home\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.807241 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.807148    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrr65\" (UniqueName: \"kubernetes.io/projected/07eeff86-1b57-465e-bbd4-dd2245ca32c9-kube-api-access-rrr65\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.807241 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.807220    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-tmp-dir\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.908279 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.908250    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-model-cache\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.908431 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.908291    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-dshm\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.908431 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.908310    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07eeff86-1b57-465e-bbd4-dd2245ca32c9-tls-certs\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.908431 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.908329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-home\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.908431 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.908386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrr65\" (UniqueName: \"kubernetes.io/projected/07eeff86-1b57-465e-bbd4-dd2245ca32c9-kube-api-access-rrr65\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.908607 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.908442    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-tmp-dir\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.908754 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.908726    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-model-cache\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.908754 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.908741    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-home\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.908926 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.908772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-tmp-dir\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.910508 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.910489    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-dshm\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.910674 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.910657    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07eeff86-1b57-465e-bbd4-dd2245ca32c9-tls-certs\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:12.916819 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:12.916797    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrr65\" (UniqueName: \"kubernetes.io/projected/07eeff86-1b57-465e-bbd4-dd2245ca32c9-kube-api-access-rrr65\") pod \"auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") " pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:13.004359 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:13.004285    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:13.136762 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:13.136738    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"]
Jul 14 22:32:13.138687 ip-10-0-142-126 kubenswrapper[2583]: W0714 22:32:13.138656    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07eeff86_1b57_465e_bbd4_dd2245ca32c9.slice/crio-5d162a625e8a11923b1f55bbe7dfc30d2c64809f9758323dd1a5ce37a9fc636b WatchSource:0}: Error finding container 5d162a625e8a11923b1f55bbe7dfc30d2c64809f9758323dd1a5ce37a9fc636b: Status 404 returned error can't find the container with id 5d162a625e8a11923b1f55bbe7dfc30d2c64809f9758323dd1a5ce37a9fc636b
Jul 14 22:32:13.948072 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:13.948038    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz" event={"ID":"07eeff86-1b57-465e-bbd4-dd2245ca32c9","Type":"ContainerStarted","Data":"5aef527627cf6078a91f04c28e5b0318dd21222e7d74a9635bb31cd311895059"}
Jul 14 22:32:13.948423 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:13.948084    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz" event={"ID":"07eeff86-1b57-465e-bbd4-dd2245ca32c9","Type":"ContainerStarted","Data":"5d162a625e8a11923b1f55bbe7dfc30d2c64809f9758323dd1a5ce37a9fc636b"}
Jul 14 22:32:13.968972 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:13.968923    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz" podStartSLOduration=1.968906778 podStartE2EDuration="1.968906778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:32:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:32:13.966593091 +0000 UTC m=+2492.878432551" watchObservedRunningTime="2026-07-14 22:32:13.968906778 +0000 UTC m=+2492.880746236"
Jul 14 22:32:18.495107 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:18.495074    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:32:23.005388 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:23.005361    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:23.005751 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:23.005410    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:23.017445 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:23.017420    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:24.004133 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:24.004105    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:32:42.294207 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.294127    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"]
Jul 14 22:32:42.297625 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.297610    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.302080 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.302053    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-32d7b3\"/\"kube-root-ca.crt\""
Jul 14 22:32:42.302080 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.302061    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-32d7b3\"/\"auth-test-model-32d7b3-kserve-self-signed-certs\""
Jul 14 22:32:42.302080 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.302081    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-32d7b3\"/\"openshift-service-ca.crt\""
Jul 14 22:32:42.302317 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.302135    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-32d7b3\"/\"default-dockercfg-6xknl\""
Jul 14 22:32:42.307041 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.307022    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"]
Jul 14 22:32:42.371773 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.371746    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989157d1-5d7a-44b9-89ea-841361a56b47-tls-certs\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.371922 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.371798    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-model-cache\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.371922 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.371863    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-dshm\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.371922 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.371896    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-home\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.371922 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.371914    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2lj8\" (UniqueName: \"kubernetes.io/projected/989157d1-5d7a-44b9-89ea-841361a56b47-kube-api-access-k2lj8\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.372105 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.371933    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-tmp-dir\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.472889 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.472857    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-dshm\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.472889 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.472894    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-home\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.473110 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.472912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2lj8\" (UniqueName: \"kubernetes.io/projected/989157d1-5d7a-44b9-89ea-841361a56b47-kube-api-access-k2lj8\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.473110 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.472933    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-tmp-dir\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.473110 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.473048    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989157d1-5d7a-44b9-89ea-841361a56b47-tls-certs\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.473218 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.473111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-model-cache\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.473349 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.473320    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-home\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.473434 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.473404    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-tmp-dir\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.473480 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.473438    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-model-cache\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.475273 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.475251    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-dshm\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.475396 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.475381    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989157d1-5d7a-44b9-89ea-841361a56b47-tls-certs\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.480695 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.480670    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2lj8\" (UniqueName: \"kubernetes.io/projected/989157d1-5d7a-44b9-89ea-841361a56b47-kube-api-access-k2lj8\") pod \"auth-test-model-32d7b3-kserve-687dd8f475-vfpn5\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") " pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.607273 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.607248    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:42.735202 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:42.735178    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"]
Jul 14 22:32:42.736520 ip-10-0-142-126 kubenswrapper[2583]: W0714 22:32:42.736495    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod989157d1_5d7a_44b9_89ea_841361a56b47.slice/crio-0a47a11272b27e51224e592790278b1ee34087f6bbe3b4a849d625f8bc247b00 WatchSource:0}: Error finding container 0a47a11272b27e51224e592790278b1ee34087f6bbe3b4a849d625f8bc247b00: Status 404 returned error can't find the container with id 0a47a11272b27e51224e592790278b1ee34087f6bbe3b4a849d625f8bc247b00
Jul 14 22:32:43.082521 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:43.082489    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5" event={"ID":"989157d1-5d7a-44b9-89ea-841361a56b47","Type":"ContainerStarted","Data":"346b691575e1a45bc574cd421726b7b636dcbfde9a37bf85b5afbd156f5d78ef"}
Jul 14 22:32:43.082681 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:43.082529    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5" event={"ID":"989157d1-5d7a-44b9-89ea-841361a56b47","Type":"ContainerStarted","Data":"0a47a11272b27e51224e592790278b1ee34087f6bbe3b4a849d625f8bc247b00"}
Jul 14 22:32:43.101380 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:43.101336    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5" podStartSLOduration=1.101323524 podStartE2EDuration="1.101323524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:32:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:32:43.099266222 +0000 UTC m=+2522.011105684" watchObservedRunningTime="2026-07-14 22:32:43.101323524 +0000 UTC m=+2522.013162986"
Jul 14 22:32:46.091047 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:46.091013    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:32:52.607757 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:52.607724    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:52.608277 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:52.607777    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:52.620391 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:52.620365    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:32:53.139999 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:32:53.139973    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:33:00.696063 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:33:00.696035    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:33:21.389087 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:33:21.389051    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:33:34.606903 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:33:34.606861    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:33:51.284232 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:33:51.284201    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:34:08.695738 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:08.695665    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:34:28.493451 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:28.493416    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:34:43.775029 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:43.774980    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"]
Jul 14 22:34:44.674474 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:44.674441    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"]
Jul 14 22:34:47.533110 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:47.533069    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:34:58.794949 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:58.794910    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz" podUID="07eeff86-1b57-465e-bbd4-dd2245ca32c9" containerName="main" containerID="cri-o://5aef527627cf6078a91f04c28e5b0318dd21222e7d74a9635bb31cd311895059" gracePeriod=45
Jul 14 22:34:59.041470 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.041446    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:34:59.129330 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.129303    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-model-cache\") pod \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") "
Jul 14 22:34:59.129458 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.129344    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-tmp-dir\") pod \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") "
Jul 14 22:34:59.129458 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.129393    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-home\") pod \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") "
Jul 14 22:34:59.129458 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.129419    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-dshm\") pod \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") "
Jul 14 22:34:59.129458 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.129439    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07eeff86-1b57-465e-bbd4-dd2245ca32c9-tls-certs\") pod \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") "
Jul 14 22:34:59.129647 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.129495    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrr65\" (UniqueName: \"kubernetes.io/projected/07eeff86-1b57-465e-bbd4-dd2245ca32c9-kube-api-access-rrr65\") pod \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\" (UID: \"07eeff86-1b57-465e-bbd4-dd2245ca32c9\") "
Jul 14 22:34:59.129647 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.129546    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-model-cache" (OuterVolumeSpecName: "model-cache") pod "07eeff86-1b57-465e-bbd4-dd2245ca32c9" (UID: "07eeff86-1b57-465e-bbd4-dd2245ca32c9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:34:59.129761 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.129658    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-home" (OuterVolumeSpecName: "home") pod "07eeff86-1b57-465e-bbd4-dd2245ca32c9" (UID: "07eeff86-1b57-465e-bbd4-dd2245ca32c9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:34:59.129761 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.129666    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "07eeff86-1b57-465e-bbd4-dd2245ca32c9" (UID: "07eeff86-1b57-465e-bbd4-dd2245ca32c9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:34:59.129856 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.129804    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-model-cache\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:34:59.129856 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.129815    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-tmp-dir\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:34:59.129856 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.129828    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-home\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:34:59.131641 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.131619    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07eeff86-1b57-465e-bbd4-dd2245ca32c9-kube-api-access-rrr65" (OuterVolumeSpecName: "kube-api-access-rrr65") pod "07eeff86-1b57-465e-bbd4-dd2245ca32c9" (UID: "07eeff86-1b57-465e-bbd4-dd2245ca32c9"). InnerVolumeSpecName "kube-api-access-rrr65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:34:59.131641 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.131626    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-dshm" (OuterVolumeSpecName: "dshm") pod "07eeff86-1b57-465e-bbd4-dd2245ca32c9" (UID: "07eeff86-1b57-465e-bbd4-dd2245ca32c9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:34:59.131775 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.131636    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07eeff86-1b57-465e-bbd4-dd2245ca32c9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "07eeff86-1b57-465e-bbd4-dd2245ca32c9" (UID: "07eeff86-1b57-465e-bbd4-dd2245ca32c9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:34:59.230955 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.230933    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07eeff86-1b57-465e-bbd4-dd2245ca32c9-dshm\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:34:59.230955 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.230954    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07eeff86-1b57-465e-bbd4-dd2245ca32c9-tls-certs\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:34:59.231112 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.230964    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrr65\" (UniqueName: \"kubernetes.io/projected/07eeff86-1b57-465e-bbd4-dd2245ca32c9-kube-api-access-rrr65\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:34:59.694918 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.694861    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5" podUID="989157d1-5d7a-44b9-89ea-841361a56b47" containerName="main" containerID="cri-o://346b691575e1a45bc574cd421726b7b636dcbfde9a37bf85b5afbd156f5d78ef" gracePeriod=45
Jul 14 22:34:59.741411 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.741367    2583 generic.go:356] "Generic (PLEG): container finished" podID="07eeff86-1b57-465e-bbd4-dd2245ca32c9" containerID="5aef527627cf6078a91f04c28e5b0318dd21222e7d74a9635bb31cd311895059" exitCode=0
Jul 14 22:34:59.741532 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.741412    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz" event={"ID":"07eeff86-1b57-465e-bbd4-dd2245ca32c9","Type":"ContainerDied","Data":"5aef527627cf6078a91f04c28e5b0318dd21222e7d74a9635bb31cd311895059"}
Jul 14 22:34:59.741532 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.741428    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"
Jul 14 22:34:59.741532 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.741452    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz" event={"ID":"07eeff86-1b57-465e-bbd4-dd2245ca32c9","Type":"ContainerDied","Data":"5d162a625e8a11923b1f55bbe7dfc30d2c64809f9758323dd1a5ce37a9fc636b"}
Jul 14 22:34:59.741532 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.741475    2583 scope.go:117] "RemoveContainer" containerID="5aef527627cf6078a91f04c28e5b0318dd21222e7d74a9635bb31cd311895059"
Jul 14 22:34:59.764627 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.764598    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"]
Jul 14 22:34:59.768094 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.768074    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fdfd38/auth-test-model-fdfd38-kserve-64f587f9f9-5k9sz"]
Jul 14 22:34:59.806733 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.806601    2583 scope.go:117] "RemoveContainer" containerID="5aef527627cf6078a91f04c28e5b0318dd21222e7d74a9635bb31cd311895059"
Jul 14 22:34:59.807101 ip-10-0-142-126 kubenswrapper[2583]: E0714 22:34:59.806936    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5aef527627cf6078a91f04c28e5b0318dd21222e7d74a9635bb31cd311895059\": container with ID starting with 5aef527627cf6078a91f04c28e5b0318dd21222e7d74a9635bb31cd311895059 not found: ID does not exist" containerID="5aef527627cf6078a91f04c28e5b0318dd21222e7d74a9635bb31cd311895059"
Jul 14 22:34:59.807101 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.806971    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5aef527627cf6078a91f04c28e5b0318dd21222e7d74a9635bb31cd311895059"} err="failed to get container status \"5aef527627cf6078a91f04c28e5b0318dd21222e7d74a9635bb31cd311895059\": rpc error: code = NotFound desc = could not find container \"5aef527627cf6078a91f04c28e5b0318dd21222e7d74a9635bb31cd311895059\": container with ID starting with 5aef527627cf6078a91f04c28e5b0318dd21222e7d74a9635bb31cd311895059 not found: ID does not exist"
Jul 14 22:34:59.943207 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:34:59.943180    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:35:00.037805 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.037776    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-home\") pod \"989157d1-5d7a-44b9-89ea-841361a56b47\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") "
Jul 14 22:35:00.037978 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.037811    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-dshm\") pod \"989157d1-5d7a-44b9-89ea-841361a56b47\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") "
Jul 14 22:35:00.037978 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.037866    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2lj8\" (UniqueName: \"kubernetes.io/projected/989157d1-5d7a-44b9-89ea-841361a56b47-kube-api-access-k2lj8\") pod \"989157d1-5d7a-44b9-89ea-841361a56b47\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") "
Jul 14 22:35:00.037978 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.037885    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989157d1-5d7a-44b9-89ea-841361a56b47-tls-certs\") pod \"989157d1-5d7a-44b9-89ea-841361a56b47\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") "
Jul 14 22:35:00.037978 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.037917    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-tmp-dir\") pod \"989157d1-5d7a-44b9-89ea-841361a56b47\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") "
Jul 14 22:35:00.038219 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.038009    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-model-cache\") pod \"989157d1-5d7a-44b9-89ea-841361a56b47\" (UID: \"989157d1-5d7a-44b9-89ea-841361a56b47\") "
Jul 14 22:35:00.038219 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.038083    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-home" (OuterVolumeSpecName: "home") pod "989157d1-5d7a-44b9-89ea-841361a56b47" (UID: "989157d1-5d7a-44b9-89ea-841361a56b47"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:35:00.038329 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.038284    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-model-cache" (OuterVolumeSpecName: "model-cache") pod "989157d1-5d7a-44b9-89ea-841361a56b47" (UID: "989157d1-5d7a-44b9-89ea-841361a56b47"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:35:00.038329 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.038297    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "989157d1-5d7a-44b9-89ea-841361a56b47" (UID: "989157d1-5d7a-44b9-89ea-841361a56b47"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:35:00.038449 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.038360    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-model-cache\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:35:00.038449 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.038382    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-home\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:35:00.040152 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.040124    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/989157d1-5d7a-44b9-89ea-841361a56b47-kube-api-access-k2lj8" (OuterVolumeSpecName: "kube-api-access-k2lj8") pod "989157d1-5d7a-44b9-89ea-841361a56b47" (UID: "989157d1-5d7a-44b9-89ea-841361a56b47"). InnerVolumeSpecName "kube-api-access-k2lj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:35:00.040152 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.040134    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/989157d1-5d7a-44b9-89ea-841361a56b47-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "989157d1-5d7a-44b9-89ea-841361a56b47" (UID: "989157d1-5d7a-44b9-89ea-841361a56b47"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:35:00.040338 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.040134    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-dshm" (OuterVolumeSpecName: "dshm") pod "989157d1-5d7a-44b9-89ea-841361a56b47" (UID: "989157d1-5d7a-44b9-89ea-841361a56b47"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:35:00.139639 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.139577    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-dshm\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:35:00.139639 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.139599    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2lj8\" (UniqueName: \"kubernetes.io/projected/989157d1-5d7a-44b9-89ea-841361a56b47-kube-api-access-k2lj8\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:35:00.139639 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.139609    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/989157d1-5d7a-44b9-89ea-841361a56b47-tls-certs\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:35:00.139639 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.139619    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989157d1-5d7a-44b9-89ea-841361a56b47-tmp-dir\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:35:00.747781 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.747746    2583 generic.go:356] "Generic (PLEG): container finished" podID="989157d1-5d7a-44b9-89ea-841361a56b47" containerID="346b691575e1a45bc574cd421726b7b636dcbfde9a37bf85b5afbd156f5d78ef" exitCode=0
Jul 14 22:35:00.747937 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.747786    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"
Jul 14 22:35:00.747937 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.747820    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5" event={"ID":"989157d1-5d7a-44b9-89ea-841361a56b47","Type":"ContainerDied","Data":"346b691575e1a45bc574cd421726b7b636dcbfde9a37bf85b5afbd156f5d78ef"}
Jul 14 22:35:00.747937 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.747862    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5" event={"ID":"989157d1-5d7a-44b9-89ea-841361a56b47","Type":"ContainerDied","Data":"0a47a11272b27e51224e592790278b1ee34087f6bbe3b4a849d625f8bc247b00"}
Jul 14 22:35:00.747937 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.747884    2583 scope.go:117] "RemoveContainer" containerID="346b691575e1a45bc574cd421726b7b636dcbfde9a37bf85b5afbd156f5d78ef"
Jul 14 22:35:00.757723 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.757669    2583 scope.go:117] "RemoveContainer" containerID="346b691575e1a45bc574cd421726b7b636dcbfde9a37bf85b5afbd156f5d78ef"
Jul 14 22:35:00.758097 ip-10-0-142-126 kubenswrapper[2583]: E0714 22:35:00.758037    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"346b691575e1a45bc574cd421726b7b636dcbfde9a37bf85b5afbd156f5d78ef\": container with ID starting with 346b691575e1a45bc574cd421726b7b636dcbfde9a37bf85b5afbd156f5d78ef not found: ID does not exist" containerID="346b691575e1a45bc574cd421726b7b636dcbfde9a37bf85b5afbd156f5d78ef"
Jul 14 22:35:00.758097 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.758068    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"346b691575e1a45bc574cd421726b7b636dcbfde9a37bf85b5afbd156f5d78ef"} err="failed to get container status \"346b691575e1a45bc574cd421726b7b636dcbfde9a37bf85b5afbd156f5d78ef\": rpc error: code = NotFound desc = could not find container \"346b691575e1a45bc574cd421726b7b636dcbfde9a37bf85b5afbd156f5d78ef\": container with ID starting with 346b691575e1a45bc574cd421726b7b636dcbfde9a37bf85b5afbd156f5d78ef not found: ID does not exist"
Jul 14 22:35:00.771191 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.771170    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"]
Jul 14 22:35:00.774717 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:00.774693    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/auth-test-model-32d7b3-kserve-687dd8f475-vfpn5"]
Jul 14 22:35:01.584738 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:01.584706    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07eeff86-1b57-465e-bbd4-dd2245ca32c9" path="/var/lib/kubelet/pods/07eeff86-1b57-465e-bbd4-dd2245ca32c9/volumes"
Jul 14 22:35:01.585123 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:01.585107    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="989157d1-5d7a-44b9-89ea-841361a56b47" path="/var/lib/kubelet/pods/989157d1-5d7a-44b9-89ea-841361a56b47/volumes"
Jul 14 22:35:03.400801 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:03.400768    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:35:35.488515 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.488428    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"]
Jul 14 22:35:35.489172 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.488887    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07eeff86-1b57-465e-bbd4-dd2245ca32c9" containerName="main"
Jul 14 22:35:35.489172 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.488901    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="07eeff86-1b57-465e-bbd4-dd2245ca32c9" containerName="main"
Jul 14 22:35:35.489172 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.488926    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="989157d1-5d7a-44b9-89ea-841361a56b47" containerName="main"
Jul 14 22:35:35.489172 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.488934    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="989157d1-5d7a-44b9-89ea-841361a56b47" containerName="main"
Jul 14 22:35:35.489172 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.489013    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="07eeff86-1b57-465e-bbd4-dd2245ca32c9" containerName="main"
Jul 14 22:35:35.489172 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.489027    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="989157d1-5d7a-44b9-89ea-841361a56b47" containerName="main"
Jul 14 22:35:35.492269 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.492242    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.497265 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.497245    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-32d7b3\"/\"openshift-service-ca.crt\""
Jul 14 22:35:35.498439 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.498421    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-32d7b3\"/\"default-dockercfg-6xknl\""
Jul 14 22:35:35.498535 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.498447    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-32d7b3\"/\"sub-test-model-32d7b3-kserve-self-signed-certs\""
Jul 14 22:35:35.498535 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.498421    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-32d7b3\"/\"kube-root-ca.crt\""
Jul 14 22:35:35.507717 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.507690    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"]
Jul 14 22:35:35.558914 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.558871    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-model-cache\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.559114 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.558931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-home\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.559114 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.558963    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j77fg\" (UniqueName: \"kubernetes.io/projected/bc7a378f-9015-48b5-9270-e90d8890d969-kube-api-access-j77fg\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.559114 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.559006    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-tmp-dir\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.559226 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.559120    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-dshm\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.559226 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.559147    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc7a378f-9015-48b5-9270-e90d8890d969-tls-certs\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.660607 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.660573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-model-cache\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.660828 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.660634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-home\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.660828 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.660659    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j77fg\" (UniqueName: \"kubernetes.io/projected/bc7a378f-9015-48b5-9270-e90d8890d969-kube-api-access-j77fg\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.660828 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.660679    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-tmp-dir\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.660828 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.660766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-dshm\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.660828 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.660801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc7a378f-9015-48b5-9270-e90d8890d969-tls-certs\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.661131 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.660967    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-model-cache\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.661131 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.661085    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-home\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.661274 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.661254    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-tmp-dir\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.663021 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.662984    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-dshm\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.663361 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.663346    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc7a378f-9015-48b5-9270-e90d8890d969-tls-certs\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.668331 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.668311    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j77fg\" (UniqueName: \"kubernetes.io/projected/bc7a378f-9015-48b5-9270-e90d8890d969-kube-api-access-j77fg\") pod \"sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") " pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.802777 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.802738    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:35.931232 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:35.931209    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"]
Jul 14 22:35:35.933257 ip-10-0-142-126 kubenswrapper[2583]: W0714 22:35:35.933225    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc7a378f_9015_48b5_9270_e90d8890d969.slice/crio-87fa0e2f6932bb3b448c2c0909e7ff4cd431e47298a8b5db093a34a13d57a066 WatchSource:0}: Error finding container 87fa0e2f6932bb3b448c2c0909e7ff4cd431e47298a8b5db093a34a13d57a066: Status 404 returned error can't find the container with id 87fa0e2f6932bb3b448c2c0909e7ff4cd431e47298a8b5db093a34a13d57a066
Jul 14 22:35:36.909849 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:36.909804    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd" event={"ID":"bc7a378f-9015-48b5-9270-e90d8890d969","Type":"ContainerStarted","Data":"5c6641b1251866c024723573e8e6fbd909906e90d71eb7bb78191d3d1a2f9ae0"}
Jul 14 22:35:36.909849 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:36.909854    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd" event={"ID":"bc7a378f-9015-48b5-9270-e90d8890d969","Type":"ContainerStarted","Data":"87fa0e2f6932bb3b448c2c0909e7ff4cd431e47298a8b5db093a34a13d57a066"}
Jul 14 22:35:36.930513 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:36.930471    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd" podStartSLOduration=1.9304578430000001 podStartE2EDuration="1.930457843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:35:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:35:36.92781261 +0000 UTC m=+2695.839652069" watchObservedRunningTime="2026-07-14 22:35:36.930457843 +0000 UTC m=+2695.842297377"
Jul 14 22:35:40.588547 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:40.588502    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:35:41.754242 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:41.754214    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:35:41.764047 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:41.764029    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mx67w_471d7d22-f3fb-409a-9f56-076ce8317934/ovn-acl-logging/0.log"
Jul 14 22:35:45.803394 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:45.803363    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:45.803788 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:45.803425    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:45.815513 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:45.815492    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:45.962509 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:45.962485    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:35:55.892008 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:35:55.891958    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:36:13.487158 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:13.487114    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"]
Jul 14 22:36:17.785453 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:17.785417    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:36:20.090877 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.090842    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"]
Jul 14 22:36:20.094251 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.094236    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.098499 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.098472    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fdfd38\"/\"openshift-service-ca.crt\""
Jul 14 22:36:20.098633 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.098502    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fdfd38\"/\"default-dockercfg-r6g2p\""
Jul 14 22:36:20.098707 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.098630    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fdfd38\"/\"kube-root-ca.crt\""
Jul 14 22:36:20.098707 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.098651    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fdfd38\"/\"rate-test-model-fdfd38-kserve-self-signed-certs\""
Jul 14 22:36:20.107039 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.107017    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"]
Jul 14 22:36:20.153850 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.153821    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-home\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.154051 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.153886    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-model-cache\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.154051 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.153923    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-tmp-dir\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.154051 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.153954    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vhsd\" (UniqueName: \"kubernetes.io/projected/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-kube-api-access-8vhsd\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.154189 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.154070    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-dshm\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.154189 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.154093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-tls-certs\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.255232 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.255195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-dshm\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.255232 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.255230    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-tls-certs\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.255436 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.255327    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-home\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.255436 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.255404    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-model-cache\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.255436 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.255425    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-tmp-dir\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.255563 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.255448    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vhsd\" (UniqueName: \"kubernetes.io/projected/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-kube-api-access-8vhsd\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.255737 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.255716    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-home\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.255847 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.255793    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-tmp-dir\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.255909 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.255872    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-model-cache\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.257639 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.257613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-dshm\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.257840 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.257824    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-tls-certs\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.264451 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.264431    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vhsd\" (UniqueName: \"kubernetes.io/projected/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-kube-api-access-8vhsd\") pod \"rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") " pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.404231 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.404137    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:20.533376 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:20.533354    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"]
Jul 14 22:36:20.535154 ip-10-0-142-126 kubenswrapper[2583]: W0714 22:36:20.535127    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e2dfed4_5e9b_4510_bd6a_54e74f29c585.slice/crio-d4d3b19eb992d6406c73c97c64fef835ef4dcd360093393f81262334522787d0 WatchSource:0}: Error finding container d4d3b19eb992d6406c73c97c64fef835ef4dcd360093393f81262334522787d0: Status 404 returned error can't find the container with id d4d3b19eb992d6406c73c97c64fef835ef4dcd360093393f81262334522787d0
Jul 14 22:36:21.126843 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:21.126806    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42" event={"ID":"4e2dfed4-5e9b-4510-bd6a-54e74f29c585","Type":"ContainerStarted","Data":"384e5bf4647d11a30d78dcef2c674fb32c541851345f08285d90bd89067dfdc0"}
Jul 14 22:36:21.126843 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:21.126848    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42" event={"ID":"4e2dfed4-5e9b-4510-bd6a-54e74f29c585","Type":"ContainerStarted","Data":"d4d3b19eb992d6406c73c97c64fef835ef4dcd360093393f81262334522787d0"}
Jul 14 22:36:21.144169 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:21.144127    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42" podStartSLOduration=1.1441131549999999 podStartE2EDuration="1.144113155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:36:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:36:21.143854046 +0000 UTC m=+2740.055693521" watchObservedRunningTime="2026-07-14 22:36:21.144113155 +0000 UTC m=+2740.055952615"
Jul 14 22:36:28.507963 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.507910    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd" podUID="bc7a378f-9015-48b5-9270-e90d8890d969" containerName="main" containerID="cri-o://5c6641b1251866c024723573e8e6fbd909906e90d71eb7bb78191d3d1a2f9ae0" gracePeriod=45
Jul 14 22:36:28.754086 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.754063    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:36:28.836003 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.835962    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-home\") pod \"bc7a378f-9015-48b5-9270-e90d8890d969\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") "
Jul 14 22:36:28.836183 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.836069    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j77fg\" (UniqueName: \"kubernetes.io/projected/bc7a378f-9015-48b5-9270-e90d8890d969-kube-api-access-j77fg\") pod \"bc7a378f-9015-48b5-9270-e90d8890d969\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") "
Jul 14 22:36:28.836183 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.836101    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc7a378f-9015-48b5-9270-e90d8890d969-tls-certs\") pod \"bc7a378f-9015-48b5-9270-e90d8890d969\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") "
Jul 14 22:36:28.836310 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.836275    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-home" (OuterVolumeSpecName: "home") pod "bc7a378f-9015-48b5-9270-e90d8890d969" (UID: "bc7a378f-9015-48b5-9270-e90d8890d969"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:36:28.836310 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.836283    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-tmp-dir\") pod \"bc7a378f-9015-48b5-9270-e90d8890d969\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") "
Jul 14 22:36:28.836425 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.836357    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-dshm\") pod \"bc7a378f-9015-48b5-9270-e90d8890d969\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") "
Jul 14 22:36:28.836425 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.836409    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-model-cache\") pod \"bc7a378f-9015-48b5-9270-e90d8890d969\" (UID: \"bc7a378f-9015-48b5-9270-e90d8890d969\") "
Jul 14 22:36:28.836557 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.836524    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bc7a378f-9015-48b5-9270-e90d8890d969" (UID: "bc7a378f-9015-48b5-9270-e90d8890d969"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:36:28.836759 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.836726    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-model-cache" (OuterVolumeSpecName: "model-cache") pod "bc7a378f-9015-48b5-9270-e90d8890d969" (UID: "bc7a378f-9015-48b5-9270-e90d8890d969"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:36:28.836866 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.836782    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-tmp-dir\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:36:28.836866 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.836802    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-home\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:36:28.838335 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.838312    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc7a378f-9015-48b5-9270-e90d8890d969-kube-api-access-j77fg" (OuterVolumeSpecName: "kube-api-access-j77fg") pod "bc7a378f-9015-48b5-9270-e90d8890d969" (UID: "bc7a378f-9015-48b5-9270-e90d8890d969"). InnerVolumeSpecName "kube-api-access-j77fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:36:28.838597 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.838573    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-dshm" (OuterVolumeSpecName: "dshm") pod "bc7a378f-9015-48b5-9270-e90d8890d969" (UID: "bc7a378f-9015-48b5-9270-e90d8890d969"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:36:28.838693 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.838593    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc7a378f-9015-48b5-9270-e90d8890d969-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bc7a378f-9015-48b5-9270-e90d8890d969" (UID: "bc7a378f-9015-48b5-9270-e90d8890d969"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:36:28.937757 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.937721    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j77fg\" (UniqueName: \"kubernetes.io/projected/bc7a378f-9015-48b5-9270-e90d8890d969-kube-api-access-j77fg\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:36:28.937757 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.937749    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc7a378f-9015-48b5-9270-e90d8890d969-tls-certs\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:36:28.937757 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.937758    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-dshm\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:36:28.937757 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:28.937765    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc7a378f-9015-48b5-9270-e90d8890d969-model-cache\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:36:29.167677 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:29.167594    2583 generic.go:356] "Generic (PLEG): container finished" podID="bc7a378f-9015-48b5-9270-e90d8890d969" containerID="5c6641b1251866c024723573e8e6fbd909906e90d71eb7bb78191d3d1a2f9ae0" exitCode=0
Jul 14 22:36:29.167677 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:29.167633    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"
Jul 14 22:36:29.167677 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:29.167657    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd" event={"ID":"bc7a378f-9015-48b5-9270-e90d8890d969","Type":"ContainerDied","Data":"5c6641b1251866c024723573e8e6fbd909906e90d71eb7bb78191d3d1a2f9ae0"}
Jul 14 22:36:29.167914 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:29.167691    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd" event={"ID":"bc7a378f-9015-48b5-9270-e90d8890d969","Type":"ContainerDied","Data":"87fa0e2f6932bb3b448c2c0909e7ff4cd431e47298a8b5db093a34a13d57a066"}
Jul 14 22:36:29.167914 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:29.167709    2583 scope.go:117] "RemoveContainer" containerID="5c6641b1251866c024723573e8e6fbd909906e90d71eb7bb78191d3d1a2f9ae0"
Jul 14 22:36:29.176623 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:29.176607    2583 scope.go:117] "RemoveContainer" containerID="5c6641b1251866c024723573e8e6fbd909906e90d71eb7bb78191d3d1a2f9ae0"
Jul 14 22:36:29.176862 ip-10-0-142-126 kubenswrapper[2583]: E0714 22:36:29.176842    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c6641b1251866c024723573e8e6fbd909906e90d71eb7bb78191d3d1a2f9ae0\": container with ID starting with 5c6641b1251866c024723573e8e6fbd909906e90d71eb7bb78191d3d1a2f9ae0 not found: ID does not exist" containerID="5c6641b1251866c024723573e8e6fbd909906e90d71eb7bb78191d3d1a2f9ae0"
Jul 14 22:36:29.176926 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:29.176875    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c6641b1251866c024723573e8e6fbd909906e90d71eb7bb78191d3d1a2f9ae0"} err="failed to get container status \"5c6641b1251866c024723573e8e6fbd909906e90d71eb7bb78191d3d1a2f9ae0\": rpc error: code = NotFound desc = could not find container \"5c6641b1251866c024723573e8e6fbd909906e90d71eb7bb78191d3d1a2f9ae0\": container with ID starting with 5c6641b1251866c024723573e8e6fbd909906e90d71eb7bb78191d3d1a2f9ae0 not found: ID does not exist"
Jul 14 22:36:29.188523 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:29.188499    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"]
Jul 14 22:36:29.192372 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:29.192354    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/sub-test-model-32d7b3-kserve-86ddbcc94f-dkjgd"]
Jul 14 22:36:29.584605 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:29.584569    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc7a378f-9015-48b5-9270-e90d8890d969" path="/var/lib/kubelet/pods/bc7a378f-9015-48b5-9270-e90d8890d969/volumes"
Jul 14 22:36:30.405040 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:30.404957    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:30.407043 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:30.405059    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:30.417594 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:30.417567    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:31.189979 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:31.189943    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:36:31.789358 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:31.789320    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:36:40.987607 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:40.987568    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"]
Jul 14 22:36:40.987985 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:40.987968    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc7a378f-9015-48b5-9270-e90d8890d969" containerName="main"
Jul 14 22:36:40.987985 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:40.987982    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc7a378f-9015-48b5-9270-e90d8890d969" containerName="main"
Jul 14 22:36:40.988102 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:40.988084    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc7a378f-9015-48b5-9270-e90d8890d969" containerName="main"
Jul 14 22:36:40.991022 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:40.991002    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:40.994734 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:40.994717    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-32d7b3\"/\"default-dockercfg-6xknl\""
Jul 14 22:36:40.994837 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:40.994760    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-32d7b3\"/\"openshift-service-ca.crt\""
Jul 14 22:36:40.994909 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:40.994837    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-32d7b3\"/\"kube-root-ca.crt\""
Jul 14 22:36:40.994909 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:40.994842    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-32d7b3\"/\"rate-test-model-32d7b3-kserve-self-signed-certs\""
Jul 14 22:36:41.000608 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.000586    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"]
Jul 14 22:36:41.054201 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.054176    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-tls-certs\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.054299 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.054207    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-tmp-dir\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.054299 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.054279    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-model-cache\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.054372 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.054315    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-dshm\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.054406 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.054378    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl64v\" (UniqueName: \"kubernetes.io/projected/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-kube-api-access-bl64v\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.054406 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.054403    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-home\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.155916 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.155542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl64v\" (UniqueName: \"kubernetes.io/projected/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-kube-api-access-bl64v\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.155916 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.155605    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-home\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.155916 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.155668    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-tls-certs\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.155916 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.155706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-tmp-dir\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.155916 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.155773    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-model-cache\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.156286 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.156205    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-model-cache\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.156483 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.156454    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-dshm\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.156587 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.156481    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-tmp-dir\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.156982 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.156955    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-home\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.162089 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.159092    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-dshm\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.162089 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.159535    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-tls-certs\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.164700 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.164674    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl64v\" (UniqueName: \"kubernetes.io/projected/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-kube-api-access-bl64v\") pod \"rate-test-model-32d7b3-kserve-cc5bdb46c-85thf\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") " pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.301334 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.301256    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:41.428902 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:41.428867    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"]
Jul 14 22:36:41.432005 ip-10-0-142-126 kubenswrapper[2583]: W0714 22:36:41.431967    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ca44108_5c24_4bc4_bf4c_3ca1bdeb6e13.slice/crio-55a8da37f97404d0e0a5a78914434a5b1990516ce4adb56ade59cc7676428669 WatchSource:0}: Error finding container 55a8da37f97404d0e0a5a78914434a5b1990516ce4adb56ade59cc7676428669: Status 404 returned error can't find the container with id 55a8da37f97404d0e0a5a78914434a5b1990516ce4adb56ade59cc7676428669
Jul 14 22:36:42.231741 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:42.231663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf" event={"ID":"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13","Type":"ContainerStarted","Data":"3454af4a35b89a4ffe5ea097727b337514138dfdde85a07e476f815669091037"}
Jul 14 22:36:42.231741 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:42.231714    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf" event={"ID":"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13","Type":"ContainerStarted","Data":"55a8da37f97404d0e0a5a78914434a5b1990516ce4adb56ade59cc7676428669"}
Jul 14 22:36:42.247338 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:42.247267    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf" podStartSLOduration=2.24725084 podStartE2EDuration="2.24725084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 22:36:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:36:42.247021985 +0000 UTC m=+2761.158861447" watchObservedRunningTime="2026-07-14 22:36:42.24725084 +0000 UTC m=+2761.159090302"
Jul 14 22:36:49.188094 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:49.188060    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:36:51.301654 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:51.301619    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:51.302104 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:51.301888    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:51.314174 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:51.314154    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:36:52.296100 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:36:52.296074    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:37:03.996373 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:03.996287    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:37:20.486961 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:20.486927    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:37:26.580550 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:26.580516    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"]
Jul 14 22:37:27.607106 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:27.607070    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"]
Jul 14 22:37:39.685500 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:39.685464    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:37:41.600417 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:41.600381    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42" podUID="4e2dfed4-5e9b-4510-bd6a-54e74f29c585" containerName="main" containerID="cri-o://384e5bf4647d11a30d78dcef2c674fb32c541851345f08285d90bd89067dfdc0" gracePeriod=45
Jul 14 22:37:41.845409 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:41.845382    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:37:42.016030 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.015935    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-tls-certs\") pod \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") "
Jul 14 22:37:42.016030 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.015974    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-home\") pod \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") "
Jul 14 22:37:42.016030 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.016014    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-tmp-dir\") pod \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") "
Jul 14 22:37:42.016295 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.016111    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vhsd\" (UniqueName: \"kubernetes.io/projected/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-kube-api-access-8vhsd\") pod \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") "
Jul 14 22:37:42.016295 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.016155    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-model-cache\") pod \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") "
Jul 14 22:37:42.016295 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.016181    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-dshm\") pod \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\" (UID: \"4e2dfed4-5e9b-4510-bd6a-54e74f29c585\") "
Jul 14 22:37:42.016295 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.016178    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-home" (OuterVolumeSpecName: "home") pod "4e2dfed4-5e9b-4510-bd6a-54e74f29c585" (UID: "4e2dfed4-5e9b-4510-bd6a-54e74f29c585"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:37:42.016295 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.016283    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4e2dfed4-5e9b-4510-bd6a-54e74f29c585" (UID: "4e2dfed4-5e9b-4510-bd6a-54e74f29c585"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:37:42.016544 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.016423    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-model-cache" (OuterVolumeSpecName: "model-cache") pod "4e2dfed4-5e9b-4510-bd6a-54e74f29c585" (UID: "4e2dfed4-5e9b-4510-bd6a-54e74f29c585"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:37:42.016544 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.016449    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-home\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:37:42.016544 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.016461    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-tmp-dir\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:37:42.018138 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.018109    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-kube-api-access-8vhsd" (OuterVolumeSpecName: "kube-api-access-8vhsd") pod "4e2dfed4-5e9b-4510-bd6a-54e74f29c585" (UID: "4e2dfed4-5e9b-4510-bd6a-54e74f29c585"). InnerVolumeSpecName "kube-api-access-8vhsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:37:42.018138 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.018123    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4e2dfed4-5e9b-4510-bd6a-54e74f29c585" (UID: "4e2dfed4-5e9b-4510-bd6a-54e74f29c585"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:37:42.018282 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.018132    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-dshm" (OuterVolumeSpecName: "dshm") pod "4e2dfed4-5e9b-4510-bd6a-54e74f29c585" (UID: "4e2dfed4-5e9b-4510-bd6a-54e74f29c585"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:37:42.117745 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.117715    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vhsd\" (UniqueName: \"kubernetes.io/projected/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-kube-api-access-8vhsd\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:37:42.117745 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.117739    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-model-cache\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:37:42.117745 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.117749    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-dshm\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:37:42.117950 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.117756    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e2dfed4-5e9b-4510-bd6a-54e74f29c585-tls-certs\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:37:42.521381 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.521342    2583 generic.go:356] "Generic (PLEG): container finished" podID="4e2dfed4-5e9b-4510-bd6a-54e74f29c585" containerID="384e5bf4647d11a30d78dcef2c674fb32c541851345f08285d90bd89067dfdc0" exitCode=0
Jul 14 22:37:42.521381 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.521385    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"
Jul 14 22:37:42.521606 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.521381    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42" event={"ID":"4e2dfed4-5e9b-4510-bd6a-54e74f29c585","Type":"ContainerDied","Data":"384e5bf4647d11a30d78dcef2c674fb32c541851345f08285d90bd89067dfdc0"}
Jul 14 22:37:42.521606 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.521503    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42" event={"ID":"4e2dfed4-5e9b-4510-bd6a-54e74f29c585","Type":"ContainerDied","Data":"d4d3b19eb992d6406c73c97c64fef835ef4dcd360093393f81262334522787d0"}
Jul 14 22:37:42.521606 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.521526    2583 scope.go:117] "RemoveContainer" containerID="384e5bf4647d11a30d78dcef2c674fb32c541851345f08285d90bd89067dfdc0"
Jul 14 22:37:42.531064 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.531048    2583 scope.go:117] "RemoveContainer" containerID="384e5bf4647d11a30d78dcef2c674fb32c541851345f08285d90bd89067dfdc0"
Jul 14 22:37:42.531323 ip-10-0-142-126 kubenswrapper[2583]: E0714 22:37:42.531304    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"384e5bf4647d11a30d78dcef2c674fb32c541851345f08285d90bd89067dfdc0\": container with ID starting with 384e5bf4647d11a30d78dcef2c674fb32c541851345f08285d90bd89067dfdc0 not found: ID does not exist" containerID="384e5bf4647d11a30d78dcef2c674fb32c541851345f08285d90bd89067dfdc0"
Jul 14 22:37:42.531391 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.531331    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"384e5bf4647d11a30d78dcef2c674fb32c541851345f08285d90bd89067dfdc0"} err="failed to get container status \"384e5bf4647d11a30d78dcef2c674fb32c541851345f08285d90bd89067dfdc0\": rpc error: code = NotFound desc = could not find container \"384e5bf4647d11a30d78dcef2c674fb32c541851345f08285d90bd89067dfdc0\": container with ID starting with 384e5bf4647d11a30d78dcef2c674fb32c541851345f08285d90bd89067dfdc0 not found: ID does not exist"
Jul 14 22:37:42.543380 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.543355    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"]
Jul 14 22:37:42.547265 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.547237    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fdfd38/rate-test-model-fdfd38-kserve-5f59d4c5d7-lvp42"]
Jul 14 22:37:42.627053 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.627023    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf" podUID="8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13" containerName="main" containerID="cri-o://3454af4a35b89a4ffe5ea097727b337514138dfdde85a07e476f815669091037" gracePeriod=45
Jul 14 22:37:42.873693 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:42.873668    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:37:43.026835 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.026809    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl64v\" (UniqueName: \"kubernetes.io/projected/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-kube-api-access-bl64v\") pod \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") "
Jul 14 22:37:43.027021 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.026855    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-model-cache\") pod \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") "
Jul 14 22:37:43.027021 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.026894    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-tmp-dir\") pod \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") "
Jul 14 22:37:43.027112 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.027068    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-tls-certs\") pod \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") "
Jul 14 22:37:43.027112 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.027104    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13" (UID: "8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:37:43.027178 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.027136    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-home\") pod \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") "
Jul 14 22:37:43.027178 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.027153    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-model-cache" (OuterVolumeSpecName: "model-cache") pod "8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13" (UID: "8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:37:43.027244 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.027164    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-dshm\") pod \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\" (UID: \"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13\") "
Jul 14 22:37:43.027359 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.027343    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-home" (OuterVolumeSpecName: "home") pod "8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13" (UID: "8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:37:43.027515 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.027501    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-model-cache\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:37:43.027577 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.027517    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-tmp-dir\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:37:43.027577 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.027525    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-home\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:37:43.029128 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.029109    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-dshm" (OuterVolumeSpecName: "dshm") pod "8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13" (UID: "8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 22:37:43.029223 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.029123    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13" (UID: "8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 22:37:43.029223 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.029154    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-kube-api-access-bl64v" (OuterVolumeSpecName: "kube-api-access-bl64v") pod "8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13" (UID: "8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13"). InnerVolumeSpecName "kube-api-access-bl64v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:37:43.128343 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.128318    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-tls-certs\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:37:43.128343 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.128340    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-dshm\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:37:43.128343 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.128349    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl64v\" (UniqueName: \"kubernetes.io/projected/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13-kube-api-access-bl64v\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:37:43.530185 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.530108    2583 generic.go:356] "Generic (PLEG): container finished" podID="8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13" containerID="3454af4a35b89a4ffe5ea097727b337514138dfdde85a07e476f815669091037" exitCode=0
Jul 14 22:37:43.530185 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.530160    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"
Jul 14 22:37:43.530395 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.530190    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf" event={"ID":"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13","Type":"ContainerDied","Data":"3454af4a35b89a4ffe5ea097727b337514138dfdde85a07e476f815669091037"}
Jul 14 22:37:43.530395 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.530230    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf" event={"ID":"8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13","Type":"ContainerDied","Data":"55a8da37f97404d0e0a5a78914434a5b1990516ce4adb56ade59cc7676428669"}
Jul 14 22:37:43.530395 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.530246    2583 scope.go:117] "RemoveContainer" containerID="3454af4a35b89a4ffe5ea097727b337514138dfdde85a07e476f815669091037"
Jul 14 22:37:43.538977 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.538962    2583 scope.go:117] "RemoveContainer" containerID="3454af4a35b89a4ffe5ea097727b337514138dfdde85a07e476f815669091037"
Jul 14 22:37:43.539244 ip-10-0-142-126 kubenswrapper[2583]: E0714 22:37:43.539227    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3454af4a35b89a4ffe5ea097727b337514138dfdde85a07e476f815669091037\": container with ID starting with 3454af4a35b89a4ffe5ea097727b337514138dfdde85a07e476f815669091037 not found: ID does not exist" containerID="3454af4a35b89a4ffe5ea097727b337514138dfdde85a07e476f815669091037"
Jul 14 22:37:43.539298 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.539252    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3454af4a35b89a4ffe5ea097727b337514138dfdde85a07e476f815669091037"} err="failed to get container status \"3454af4a35b89a4ffe5ea097727b337514138dfdde85a07e476f815669091037\": rpc error: code = NotFound desc = could not find container \"3454af4a35b89a4ffe5ea097727b337514138dfdde85a07e476f815669091037\": container with ID starting with 3454af4a35b89a4ffe5ea097727b337514138dfdde85a07e476f815669091037 not found: ID does not exist"
Jul 14 22:37:43.551582 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.551560    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"]
Jul 14 22:37:43.561243 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.555649    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-32d7b3/rate-test-model-32d7b3-kserve-cc5bdb46c-85thf"]
Jul 14 22:37:43.584100 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.584078    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e2dfed4-5e9b-4510-bd6a-54e74f29c585" path="/var/lib/kubelet/pods/4e2dfed4-5e9b-4510-bd6a-54e74f29c585/volumes"
Jul 14 22:37:43.584468 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.584455    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13" path="/var/lib/kubelet/pods/8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13/volumes"
Jul 14 22:37:43.993248 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.993218    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7567-139871593329696"]
Jul 14 22:37:43.993635 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.993584    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13" containerName="main"
Jul 14 22:37:43.993635 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.993595    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13" containerName="main"
Jul 14 22:37:43.993635 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.993631    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e2dfed4-5e9b-4510-bd6a-54e74f29c585" containerName="main"
Jul 14 22:37:43.993635 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.993637    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e2dfed4-5e9b-4510-bd6a-54e74f29c585" containerName="main"
Jul 14 22:37:43.993779 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.993692    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e2dfed4-5e9b-4510-bd6a-54e74f29c585" containerName="main"
Jul 14 22:37:43.993779 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.993703    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ca44108-5c24-4bc4-bf4c-3ca1bdeb6e13" containerName="main"
Jul 14 22:37:43.998110 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:43.998095    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7567-139871593329696"
Jul 14 22:37:44.000744 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:44.000724    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vx6fh\""
Jul 14 22:37:44.001197 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:44.001179    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7567-139871593329696"]
Jul 14 22:37:44.138083 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:44.138048    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hkhh\" (UniqueName: \"kubernetes.io/projected/7f976130-86ca-47e7-ad66-90e5c91b63a8-kube-api-access-9hkhh\") pod \"test-curl-7567-139871593329696\" (UID: \"7f976130-86ca-47e7-ad66-90e5c91b63a8\") " pod="opendatahub/test-curl-7567-139871593329696"
Jul 14 22:37:44.238563 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:44.238531    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hkhh\" (UniqueName: \"kubernetes.io/projected/7f976130-86ca-47e7-ad66-90e5c91b63a8-kube-api-access-9hkhh\") pod \"test-curl-7567-139871593329696\" (UID: \"7f976130-86ca-47e7-ad66-90e5c91b63a8\") " pod="opendatahub/test-curl-7567-139871593329696"
Jul 14 22:37:44.246797 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:44.246737    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hkhh\" (UniqueName: \"kubernetes.io/projected/7f976130-86ca-47e7-ad66-90e5c91b63a8-kube-api-access-9hkhh\") pod \"test-curl-7567-139871593329696\" (UID: \"7f976130-86ca-47e7-ad66-90e5c91b63a8\") " pod="opendatahub/test-curl-7567-139871593329696"
Jul 14 22:37:44.307757 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:44.307727    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7567-139871593329696"
Jul 14 22:37:44.432676 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:44.432651    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7567-139871593329696"]
Jul 14 22:37:44.435363 ip-10-0-142-126 kubenswrapper[2583]: W0714 22:37:44.435332    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f976130_86ca_47e7_ad66_90e5c91b63a8.slice/crio-64ae24f49cd315e90c785824ad74384c7b500503dcafeeb8e82dbc5ffb60180b WatchSource:0}: Error finding container 64ae24f49cd315e90c785824ad74384c7b500503dcafeeb8e82dbc5ffb60180b: Status 404 returned error can't find the container with id 64ae24f49cd315e90c785824ad74384c7b500503dcafeeb8e82dbc5ffb60180b
Jul 14 22:37:44.436673 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:44.436654    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 22:37:44.537659 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:44.537570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7567-139871593329696" event={"ID":"7f976130-86ca-47e7-ad66-90e5c91b63a8","Type":"ContainerStarted","Data":"64ae24f49cd315e90c785824ad74384c7b500503dcafeeb8e82dbc5ffb60180b"}
Jul 14 22:37:45.543819 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:45.543724    2583 generic.go:356] "Generic (PLEG): container finished" podID="7f976130-86ca-47e7-ad66-90e5c91b63a8" containerID="fb2c92b9db7597eb0c191a5dfc77e214c34d61a521228a0a988665f82eda5031" exitCode=0
Jul 14 22:37:45.544219 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:45.543817    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7567-139871593329696" event={"ID":"7f976130-86ca-47e7-ad66-90e5c91b63a8","Type":"ContainerDied","Data":"fb2c92b9db7597eb0c191a5dfc77e214c34d61a521228a0a988665f82eda5031"}
Jul 14 22:37:46.677307 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:46.677284    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7567-139871593329696"
Jul 14 22:37:46.715750 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:46.715726    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7567-139871593329696_7f976130-86ca-47e7-ad66-90e5c91b63a8/test-curl-7567-139871593329696/0.log"
Jul 14 22:37:46.742606 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:46.742575    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7567-139871593329696"]
Jul 14 22:37:46.746578 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:46.746558    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7567-139871593329696"]
Jul 14 22:37:46.861460 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:46.861435    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hkhh\" (UniqueName: \"kubernetes.io/projected/7f976130-86ca-47e7-ad66-90e5c91b63a8-kube-api-access-9hkhh\") pod \"7f976130-86ca-47e7-ad66-90e5c91b63a8\" (UID: \"7f976130-86ca-47e7-ad66-90e5c91b63a8\") "
Jul 14 22:37:46.863518 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:46.863495    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f976130-86ca-47e7-ad66-90e5c91b63a8-kube-api-access-9hkhh" (OuterVolumeSpecName: "kube-api-access-9hkhh") pod "7f976130-86ca-47e7-ad66-90e5c91b63a8" (UID: "7f976130-86ca-47e7-ad66-90e5c91b63a8"). InnerVolumeSpecName "kube-api-access-9hkhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 22:37:46.962809 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:46.962784    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hkhh\" (UniqueName: \"kubernetes.io/projected/7f976130-86ca-47e7-ad66-90e5c91b63a8-kube-api-access-9hkhh\") on node \"ip-10-0-142-126.ec2.internal\" DevicePath \"\""
Jul 14 22:37:47.554270 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:47.554238    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7567-139871593329696"
Jul 14 22:37:47.554270 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:47.554265    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64ae24f49cd315e90c785824ad74384c7b500503dcafeeb8e82dbc5ffb60180b"
Jul 14 22:37:47.564463 ip-10-0-142-126 kubenswrapper[2583]: E0714 22:37:47.564430    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7567-139871593329696\" is forbidden: User \"system:node:ip-10-0-142-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-126.ec2.internal' and this object" podUID="7f976130-86ca-47e7-ad66-90e5c91b63a8" pod="opendatahub/test-curl-7567-139871593329696"
Jul 14 22:37:47.584335 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:37:47.584304    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f976130-86ca-47e7-ad66-90e5c91b63a8" path="/var/lib/kubelet/pods/7f976130-86ca-47e7-ad66-90e5c91b63a8/volumes"
Jul 14 22:38:00.883845 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:00.883813    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:38:26.796133 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:26.796104    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-g4bd5"]
Jul 14 22:38:39.503756 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:39.503678    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85bbc67d46-fx6pk_ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e/authorino/0.log"
Jul 14 22:38:44.539173 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:44.539144    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cb88b8588-jkr44_9580f277-2f69-445b-8397-b06752747bc4/manager/0.log"
Jul 14 22:38:44.658984 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:44.658953    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vwjl9_6de41562-8b66-4928-ab3a-ec033d603ee7/server/0.log"
Jul 14 22:38:44.772986 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:44.772953    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tqjgl_d511f6dc-503f-4812-a85e-7b455e866e97/manager/0.log"
Jul 14 22:38:44.887215 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:44.887189    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c99649887-6t6k7_5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0/copy-manifests/0.log"
Jul 14 22:38:44.896285 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:44.896258    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c99649887-6t6k7_5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0/manager/0.log"
Jul 14 22:38:48.578021 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:48.577980    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85bbc67d46-fx6pk_ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e/authorino/0.log"
Jul 14 22:38:49.283782 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:49.283747    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-g4bd5_c4088940-5dcb-4712-b512-d9f85e0e51a9/limitador/0.log"
Jul 14 22:38:50.108016 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:50.107973    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9dcf98947-zv2cs_54f901ff-51a4-459a-9b66-3f2eccbd1e0a/kube-auth-proxy/0.log"
Jul 14 22:38:50.579627 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:50.579598    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56769d696d-kg2rh_04d61ecd-f296-4911-ab2f-05cd8db74221/router/0.log"
Jul 14 22:38:50.929818 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:50.929741    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-77dw8_7651312c-1adf-4f14-8d14-9d2ca3fc5bfc/main/0.log"
Jul 14 22:38:51.159651 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:51.159614    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-fvcbj_a13a6985-b2bb-4cd1-b754-d3347ec37909/main/0.log"
Jul 14 22:38:51.493863 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:51.493834    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-n9xmj_64fc0c68-230b-4a55-bb3f-7cb027e7aea9/main/0.log"
Jul 14 22:38:58.812034 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:58.811977    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4g2l8_8b178bec-d3fb-425d-bf9b-e7a9c57d559e/global-pull-secret-syncer/0.log"
Jul 14 22:38:58.984809 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:58.984777    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jjhrt_d7985261-d01a-4a06-9a47-7e92ce099f3f/konnectivity-agent/0.log"
Jul 14 22:38:59.087490 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:38:59.087407    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-126.ec2.internal_0679c59103ee362599b21375dbd0b93a/haproxy/0.log"
Jul 14 22:39:04.783962 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:04.783927    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85bbc67d46-fx6pk_ad03179c-3a11-4e5e-af4d-ab00a1ae3e5e/authorino/0.log"
Jul 14 22:39:05.144252 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:05.144221    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-g4bd5_c4088940-5dcb-4712-b512-d9f85e0e51a9/limitador/0.log"
Jul 14 22:39:07.153423 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.153390    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-6kl8x_0f7ebb7b-17e8-4466-8ec6-6244fa0897ed/cluster-monitoring-operator/0.log"
Jul 14 22:39:07.293215 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.293187    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6b659b4f5f-wdlpf_ca31f28d-7d36-4a4a-bec0-1eabf96c6d25/metrics-server/0.log"
Jul 14 22:39:07.536646 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.536573    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ggbsx_c6da7c89-ff51-41f0-b1f7-ef2562be7777/node-exporter/0.log"
Jul 14 22:39:07.560298 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.560279    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ggbsx_c6da7c89-ff51-41f0-b1f7-ef2562be7777/kube-rbac-proxy/0.log"
Jul 14 22:39:07.587528 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.587511    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ggbsx_c6da7c89-ff51-41f0-b1f7-ef2562be7777/init-textfile/0.log"
Jul 14 22:39:07.617879 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.617857    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-m59rz_fbfd31bf-a993-411a-b286-7f5225bd7c0d/kube-rbac-proxy-main/0.log"
Jul 14 22:39:07.641102 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.641082    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-m59rz_fbfd31bf-a993-411a-b286-7f5225bd7c0d/kube-rbac-proxy-self/0.log"
Jul 14 22:39:07.664733 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.664718    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-m59rz_fbfd31bf-a993-411a-b286-7f5225bd7c0d/openshift-state-metrics/0.log"
Jul 14 22:39:07.716749 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.716728    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2936c37d-4f84-4a27-913c-90525953dcc5/prometheus/0.log"
Jul 14 22:39:07.740390 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.740371    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2936c37d-4f84-4a27-913c-90525953dcc5/config-reloader/0.log"
Jul 14 22:39:07.766284 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.766269    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2936c37d-4f84-4a27-913c-90525953dcc5/thanos-sidecar/0.log"
Jul 14 22:39:07.791562 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.791511    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2936c37d-4f84-4a27-913c-90525953dcc5/kube-rbac-proxy-web/0.log"
Jul 14 22:39:07.815127 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.815110    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2936c37d-4f84-4a27-913c-90525953dcc5/kube-rbac-proxy/0.log"
Jul 14 22:39:07.841459 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.841444    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2936c37d-4f84-4a27-913c-90525953dcc5/kube-rbac-proxy-thanos/0.log"
Jul 14 22:39:07.866604 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.866588    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2936c37d-4f84-4a27-913c-90525953dcc5/init-config-reloader/0.log"
Jul 14 22:39:07.977523 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:07.977484    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fdfd8d658-gftb6_ba80b577-be74-43cd-ac44-7d9aa37b5e02/telemeter-client/0.log"
Jul 14 22:39:08.001730 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:08.001711    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fdfd8d658-gftb6_ba80b577-be74-43cd-ac44-7d9aa37b5e02/reload/0.log"
Jul 14 22:39:08.027094 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:08.027063    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6fdfd8d658-gftb6_ba80b577-be74-43cd-ac44-7d9aa37b5e02/kube-rbac-proxy/0.log"
Jul 14 22:39:08.061965 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:08.061947    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75f887f58-rv5bd_bb2651a3-5d90-4e91-84f5-9c545d2c080d/thanos-query/0.log"
Jul 14 22:39:08.084586 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:08.084568    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75f887f58-rv5bd_bb2651a3-5d90-4e91-84f5-9c545d2c080d/kube-rbac-proxy-web/0.log"
Jul 14 22:39:08.113391 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:08.113369    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75f887f58-rv5bd_bb2651a3-5d90-4e91-84f5-9c545d2c080d/kube-rbac-proxy/0.log"
Jul 14 22:39:08.135884 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:08.135866    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75f887f58-rv5bd_bb2651a3-5d90-4e91-84f5-9c545d2c080d/prom-label-proxy/0.log"
Jul 14 22:39:08.160653 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:08.160638    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75f887f58-rv5bd_bb2651a3-5d90-4e91-84f5-9c545d2c080d/kube-rbac-proxy-rules/0.log"
Jul 14 22:39:08.188095 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:08.188074    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75f887f58-rv5bd_bb2651a3-5d90-4e91-84f5-9c545d2c080d/kube-rbac-proxy-metrics/0.log"
Jul 14 22:39:09.210292 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.210259    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"]
Jul 14 22:39:09.210686 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.210643    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f976130-86ca-47e7-ad66-90e5c91b63a8" containerName="test-curl-7567-139871593329696"
Jul 14 22:39:09.210686 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.210656    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f976130-86ca-47e7-ad66-90e5c91b63a8" containerName="test-curl-7567-139871593329696"
Jul 14 22:39:09.210785 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.210747    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f976130-86ca-47e7-ad66-90e5c91b63a8" containerName="test-curl-7567-139871593329696"
Jul 14 22:39:09.213786 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.213765    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.216367 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.216344    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tpwxp\"/\"kube-root-ca.crt\""
Jul 14 22:39:09.216495 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.216344    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tpwxp\"/\"openshift-service-ca.crt\""
Jul 14 22:39:09.216495 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.216380    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tpwxp\"/\"default-dockercfg-m2k6m\""
Jul 14 22:39:09.224407 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.224388    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"]
Jul 14 22:39:09.406370 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.406322    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/462140d8-0a54-4951-9ef5-c86a82193278-podres\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.406536 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.406413    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/462140d8-0a54-4951-9ef5-c86a82193278-lib-modules\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.406536 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.406434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/462140d8-0a54-4951-9ef5-c86a82193278-sys\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.406536 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.406454    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trklj\" (UniqueName: \"kubernetes.io/projected/462140d8-0a54-4951-9ef5-c86a82193278-kube-api-access-trklj\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.406536 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.406512    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/462140d8-0a54-4951-9ef5-c86a82193278-proc\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.507451 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.507387    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/462140d8-0a54-4951-9ef5-c86a82193278-proc\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.507451 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.507430    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/462140d8-0a54-4951-9ef5-c86a82193278-podres\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.507612 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.507482    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/462140d8-0a54-4951-9ef5-c86a82193278-lib-modules\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.507612 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.507500    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/462140d8-0a54-4951-9ef5-c86a82193278-sys\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.507612 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.507504    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/462140d8-0a54-4951-9ef5-c86a82193278-proc\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.507612 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.507519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trklj\" (UniqueName: \"kubernetes.io/projected/462140d8-0a54-4951-9ef5-c86a82193278-kube-api-access-trklj\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.507612 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.507589    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/462140d8-0a54-4951-9ef5-c86a82193278-podres\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.507612 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.507606    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/462140d8-0a54-4951-9ef5-c86a82193278-sys\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.507820 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.507630    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/462140d8-0a54-4951-9ef5-c86a82193278-lib-modules\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.516227 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.516206    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trklj\" (UniqueName: \"kubernetes.io/projected/462140d8-0a54-4951-9ef5-c86a82193278-kube-api-access-trklj\") pod \"perf-node-gather-daemonset-vnqd8\" (UID: \"462140d8-0a54-4951-9ef5-c86a82193278\") " pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.524465 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.524443    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.652521 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.652497    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"]
Jul 14 22:39:09.655226 ip-10-0-142-126 kubenswrapper[2583]: W0714 22:39:09.655201    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod462140d8_0a54_4951_9ef5_c86a82193278.slice/crio-81db27c4454a3009e720154fe398c9e0f211ace2fcf795a5f764cf14360c64f7 WatchSource:0}: Error finding container 81db27c4454a3009e720154fe398c9e0f211ace2fcf795a5f764cf14360c64f7: Status 404 returned error can't find the container with id 81db27c4454a3009e720154fe398c9e0f211ace2fcf795a5f764cf14360c64f7
Jul 14 22:39:09.935394 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.935358    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8" event={"ID":"462140d8-0a54-4951-9ef5-c86a82193278","Type":"ContainerStarted","Data":"64b33ef79c549390aa2fa7d05b56e7d921b7406a18614b497824e871c51bb930"}
Jul 14 22:39:09.935585 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.935430    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8" event={"ID":"462140d8-0a54-4951-9ef5-c86a82193278","Type":"ContainerStarted","Data":"81db27c4454a3009e720154fe398c9e0f211ace2fcf795a5f764cf14360c64f7"}
Jul 14 22:39:09.935585 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.935474    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:09.951794 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:09.951749    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8" podStartSLOduration=0.951735601 podStartE2EDuration="951.735601ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 22:39:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 22:39:09.950758095 +0000 UTC m=+2908.862597576" watchObservedRunningTime="2026-07-14 22:39:09.951735601 +0000 UTC m=+2908.863575062"
Jul 14 22:39:12.341918 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:12.341878    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d44xw_b54191fc-df69-4163-982d-4d527c25655e/dns/0.log"
Jul 14 22:39:12.371847 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:12.371826    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d44xw_b54191fc-df69-4163-982d-4d527c25655e/kube-rbac-proxy/0.log"
Jul 14 22:39:12.503691 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:12.503665    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qh9ns_ce0c7cdb-5105-4e28-acc6-f4ce42c233ec/dns-node-resolver/0.log"
Jul 14 22:39:13.131836 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:13.131806    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4ctzt_c91692a9-5187-4ef7-ab60-702349a28c5b/node-ca/0.log"
Jul 14 22:39:14.366697 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:14.366668    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9dcf98947-zv2cs_54f901ff-51a4-459a-9b66-3f2eccbd1e0a/kube-auth-proxy/0.log"
Jul 14 22:39:14.516923 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:14.516894    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56769d696d-kg2rh_04d61ecd-f296-4911-ab2f-05cd8db74221/router/0.log"
Jul 14 22:39:15.265158 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:15.265131    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t9b2c_cfcb488d-3e32-4a99-a49a-f6e76c404001/serve-healthcheck-canary/0.log"
Jul 14 22:39:15.755867 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:15.755832    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-xb9m6_abec354f-45af-43a7-a75b-dd4f722fa7f5/insights-operator/0.log"
Jul 14 22:39:15.756388 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:15.756301    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-xb9m6_abec354f-45af-43a7-a75b-dd4f722fa7f5/insights-operator/1.log"
Jul 14 22:39:15.777008 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:15.776972    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kh8wx_b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e/kube-rbac-proxy/0.log"
Jul 14 22:39:15.801034 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:15.801014    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kh8wx_b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e/exporter/0.log"
Jul 14 22:39:15.827497 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:15.827477    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kh8wx_b64b1f9c-c0c9-4d50-a6aa-5c138dc7f62e/extractor/0.log"
Jul 14 22:39:15.950148 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:15.950127    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tpwxp/perf-node-gather-daemonset-vnqd8"
Jul 14 22:39:18.633385 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:18.633359    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cb88b8588-jkr44_9580f277-2f69-445b-8397-b06752747bc4/manager/0.log"
Jul 14 22:39:18.656622 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:18.656597    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vwjl9_6de41562-8b66-4928-ab3a-ec033d603ee7/server/0.log"
Jul 14 22:39:18.730769 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:18.730707    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tqjgl_d511f6dc-503f-4812-a85e-7b455e866e97/manager/0.log"
Jul 14 22:39:18.757542 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:18.757524    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c99649887-6t6k7_5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0/manager/0.log"
Jul 14 22:39:18.787538 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:18.787521    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c99649887-6t6k7_5c7dc0b1-6f4c-4138-9dd2-5f7009938bc0/copy-manifests/0.log"
Jul 14 22:39:20.275678 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:20.275649    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-676d99795d-4tbsq_f5d56901-8802-46fb-8f77-f5d12f223fa5/manager/0.log"
Jul 14 22:39:20.508643 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:20.508619    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9dcf98947-zv2cs_54f901ff-51a4-459a-9b66-3f2eccbd1e0a/kube-auth-proxy/0.log"
Jul 14 22:39:20.628743 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:20.628697    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56769d696d-kg2rh_04d61ecd-f296-4911-ab2f-05cd8db74221/router/0.log"
Jul 14 22:39:22.041974 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:22.041945    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9dcf98947-zv2cs_54f901ff-51a4-459a-9b66-3f2eccbd1e0a/kube-auth-proxy/0.log"
Jul 14 22:39:22.160564 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:22.160536    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56769d696d-kg2rh_04d61ecd-f296-4911-ab2f-05cd8db74221/router/0.log"
Jul 14 22:39:27.079312 ip-10-0-142-126 kubenswrapper[2583]: I0714 22:39:27.079286    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4swhd_9e728bee-45ad-401c-a4e2-96307e102e2b/kube-multus/0.log"