Jul 06 19:27:13.302978 ip-10-0-137-0 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.709054    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716448    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716462    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716466    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716468    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716472    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716475    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716478    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716481    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:27:13.804863 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716484    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:27:13.794176 ip-10-0-137-0 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716491    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716494    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716497    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716499    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716502    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716505    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716507    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716510    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716513    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716515    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716520    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716524    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716529    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716532    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716536    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716539    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716542    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716546    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:27:13.806600 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716555    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716559    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716562    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716566    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716569    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716572    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716575    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716578    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716581    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716584    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716587    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716590    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716593    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716597    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716600    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716602    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716605    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716608    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716610    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716613    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:27:13.808553 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716616    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716618    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716621    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716623    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716626    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716628    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716631    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716633    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716636    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716638    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716641    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716643    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716646    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716649    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716651    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716654    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716656    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716659    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716661    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:27:13.836594 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716664    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716668    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716671    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716673    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716676    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716692    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716695    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716698    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716701    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716704    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716709    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716712    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716715    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716717    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716720    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716723    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716725    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716728    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716731    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716733    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:27:13.839026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716736    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716738    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716741    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716744    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716747    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716749    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716752    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716754    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716757    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716761    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716763    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716766    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.716768    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717486    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717492    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717496    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717500    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717504    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717507    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717509    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:27:13.852535 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717512    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717515    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717518    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717520    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717523    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717526    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717528    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717530    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717533    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717535    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717538    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717540    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717543    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717545    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717548    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717550    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717553    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717556    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717559    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717562    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:27:13.855490 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717564    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717567    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717569    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717572    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717575    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717577    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717580    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717583    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717585    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717588    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717590    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717594    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717597    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717599    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717602    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717604    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717607    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717609    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717612    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717614    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:27:13.889310 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717617    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717619    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717622    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717624    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717627    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717629    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717633    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717636    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717639    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717643    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717647    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717650    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717653    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717656    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717659    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717662    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717665    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717668    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717671    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:27:14.019923 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717674    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717677    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717679    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717699    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717702    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717704    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717707    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717710    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717713    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717716    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717718    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717721    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717723    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717729    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717731    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717734    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717736    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717739    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717741    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717745    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:27:14.021185 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717748    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717752    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717755    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717758    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717761    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717763    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717766    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717768    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717771    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717773    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717776    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717778    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.717781    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718168    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718173    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718176    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718179    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718182    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718185    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718188    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:27:14.022086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718191    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718193    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718196    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718199    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718201    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718205    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718208    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718210    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718213    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718216    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718218    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718223    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718225    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718228    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718230    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718233    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718235    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718238    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718240    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718243    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:27:14.022882 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718246    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718248    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718251    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718253    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718256    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718258    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718261    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718263    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718266    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718270    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718274    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718277    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718280    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718283    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718286    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718288    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718291    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718294    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718297    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:27:14.023580 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718300    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718302    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718305    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718307    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718311    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718314    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718316    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718319    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718321    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718324    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718327    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718330    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718333    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718336    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718338    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718341    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718343    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718346    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718348    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718351    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:27:14.024385 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718353    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718356    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718358    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718361    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718364    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718366    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718369    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718371    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718373    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718376    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718379    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718382    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718384    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718387    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718389    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718392    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718395    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718398    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718400    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718403    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:27:14.025000 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718405    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718410    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718412    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718415    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718417    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718421    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718425    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718427    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718430    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718433    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718436    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718440    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.718443    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718523    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718533    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718543    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718550    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718556    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718559    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718564    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:27:14.025575 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718569    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718572    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718576    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718580    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718583    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718586    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718589    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718592    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718596    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718599    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718602    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718606    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718609    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718612    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718615    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718619    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718623    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718626    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718630    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718633    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718636    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718639    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718642    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718645    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:27:14.026185 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718648    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718653    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718656    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718659    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718662    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718665    2576 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718668    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718673    2576 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718676    2576 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718692    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718697    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718700    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718704    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718707    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718710    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718713    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718718    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718721    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718724    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718727    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718730    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718732    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718735    2576 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718739    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718743    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:27:14.026881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718746    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718749    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718752    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718755    2576 flags.go:64] FLAG: --help="false"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718758    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718761    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718764    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718766    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718770    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718773    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718776    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718778    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718781    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718784    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718788    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718791    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718794    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718798    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718801    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718804    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718807    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718810    2576 flags.go:64] FLAG: --lock-file=""
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718812    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718817    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:27:14.027721 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718820    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718825    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718828    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718831    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718834    2576 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718837    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718840    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718843    2576 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718846    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718850    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718853    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718858    2576 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718861    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718864    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718867    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718870    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718873    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718876    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718879    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718886    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718889    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718892    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718895    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:27:14.028827 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718898    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718904    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718907    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718912    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718915    2576 flags.go:64] FLAG: --port="10250"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718918    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718922    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fa434e1fc002de52"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718925    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718929    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718932    2576 flags.go:64] FLAG: --register-node="true"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718935    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718939    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718942    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718944    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718947    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718951    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718954    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718957    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718960    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718962    2576 flags.go:64] FLAG: --runonce="false"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718965    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718968    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718971    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718974    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718977    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718980    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:27:14.029496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718983    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718987    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718989    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718993    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718995    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.718998    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719001    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719004    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719007    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719014    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719017    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719020    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719024    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719028    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719032    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719035    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719038    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719041    2576 flags.go:64] FLAG: --v="2"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719045    2576 flags.go:64] FLAG: --version="false"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719049    2576 flags.go:64] FLAG: --vmodule=""
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719053    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.719056    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719175    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719179    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:27:14.194894 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719182    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719185    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719188    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719191    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719193    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719196    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719198    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719201    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719203    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719206    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719208    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719211    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719213    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719216    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719218    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719221    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719224    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719228    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719231    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719233    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:27:14.195742 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719236    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719238    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719242    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719245    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719247    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719250    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719252    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719255    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719257    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719260    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719262    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719265    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719268    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719270    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719273    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719275    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719278    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719281    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719283    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719286    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:27:14.196334 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719288    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719291    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719295    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719297    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719299    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719302    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719306    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719310    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719313    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719318    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719320    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719323    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719325    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719328    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719331    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719334    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719337    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719339    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719342    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719344    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:27:14.196953 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719347    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719350    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719361    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719364    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719367    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719369    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719372    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719375    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719378    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719380    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719384    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719388    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719391    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719394    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719397    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719399    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719402    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719404    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:27:14.197513 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719407    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719411    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719414    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719435    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719440    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719443    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719446    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719449    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719453    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719456    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719459    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719462    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719465    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719467    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719470    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719473    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719475    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719478    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:27:14.198053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.719480    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.720170    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.728137    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.728156    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.728174    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.728180    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728234    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728239    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728243    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728247    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728251    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728254    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728257    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728260    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:27:14.198532 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728262    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728265    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728268    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728271    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728274    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728278    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728281    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728284    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728286    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728289    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728291    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728294    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728297    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728299    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728302    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728305    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728308    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728310    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728313    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728316    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:27:14.198984 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728319    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728321    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728324    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728326    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728329    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728331    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728334    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728336    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728340    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728342    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728345    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728347    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728350    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728352    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728355    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728357    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728360    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728363    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728367    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:27:14.199533 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728371    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728373    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728376    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728379    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728381    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728384    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728386    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728389    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728391    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728394    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728397    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728399    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728402    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728405    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728408    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728411    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728413    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728416    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728419    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728421    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:27:14.200096 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728423    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728426    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728428    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728431    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728433    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728436    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728438    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728441    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728444    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728446    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728449    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728451    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728454    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728457    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728459    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728462    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728464    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728468    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728471    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:27:14.200627 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728474    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728477    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728480    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728484    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728486    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728489    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728494    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728497    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728500    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728503    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728506    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728509    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728512    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.728517    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728628    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:27:14.201187 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728636    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728639    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728641    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728644    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728647    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728649    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728652    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728654    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728657    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728659    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728662    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728665    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728667    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728670    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728672    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728675    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728677    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728695    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728698    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728701    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:27:14.201609 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728703    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728706    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728709    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728711    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728716    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728720    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728723    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728725    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728729    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728732    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728735    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728739    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728742    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728745    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728747    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728750    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728753    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728756    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728760    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:27:14.202207 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728763    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728767    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728770    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728773    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728776    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728779    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728781    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728784    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728787    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728789    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728792    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728794    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728796    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728799    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728802    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728805    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728807    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728811    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728814    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728816    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:27:14.202760 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728819    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728821    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728824    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728826    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728830    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728833    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728836    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728838    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728841    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728843    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728846    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728849    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728851    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728854    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728856    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728859    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728861    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728864    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728867    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728869    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:27:14.203320 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728872    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728874    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728876    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728879    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728882    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728884    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728887    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728889    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728892    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728896    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728898    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728901    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728903    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728906    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728908    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728911    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728915    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728918    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:27:14.203877 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:13.728920    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:27:14.204397 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.728925    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:27:14.204397 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.729044    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:27:14.204397 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.732652    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:27:14.204397 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.734293    2576 server.go:1019] "Starting client certificate rotation"
Jul 06 19:27:14.204397 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.734386    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:27:14.204397 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.734421    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:27:14.204397 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.737141    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:27:14.204397 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.738306    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:27:14.204397 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.751715    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:27:14.204397 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.754044    2576 log.go:25] "Validated CRI v1 image API"
Jul 06 19:27:14.204397 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.757081    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:27:14.204397 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.759764    2576 fs.go:135] Filesystem UUIDs: map[6a293cee-27de-4f30-8e63-8a6786b0048c:/dev/nvme0n1p4 6dad06db-320b-43d5-87a0-049fb9aa05b4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 06 19:27:14.204755 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.759788    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:27:14.204860 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.764910    2576 manager.go:216] Machine: {Timestamp:2026-07-06 19:27:13.763451668 +0000 UTC m=+0.352686329 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3136553 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f2f677699b5cf189942ec8fac66aa SystemUUID:ec2f2f67-7699-b5cf-1899-42ec8fac66aa BootID:e67a10e1-bd25-4ae4-98c9-e91bd6b7a44a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:19:5e:d6:39:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:19:5e:d6:39:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:f2:0b:a0:12:28 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:27:14.204860 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.768012    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:27:14.204860 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.768159    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:27:14.204860 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.772284    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:27:14.204860 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.772500    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-0.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:27:14.204860 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.773445    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:27:14.204860 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.773456    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:27:14.204860 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.773464    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.774323    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.776250    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.777268    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.780800    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.780942    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.780976    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.780990    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.781006    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.781016    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.781025    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.781402    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.781418    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.783985    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.786359    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.786404    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.787907    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.787924    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.787933    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.787943    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.787954    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.787960    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.787968    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.787973    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.787980    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.787986    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.787994    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.788002    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.789643    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.789651    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.793146    2576 server.go:1268] "Started kubelet"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.793250    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.793311    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.793379    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.793889    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-0.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.794138    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.794219    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.795500    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.795511    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:27:14.205454 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.800984    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.803869    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.803872    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.804033    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.802770    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-0.ec2.internal.18bfc9f584bc6f51  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-0.ec2.internal,UID:ip-10-0-137-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-0.ec2.internal,},FirstTimestamp:2026-07-06 19:27:13.793118033 +0000 UTC m=+0.382352675,LastTimestamp:2026-07-06 19:27:13.793118033 +0000 UTC m=+0.382352675,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-0.ec2.internal,}"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.804631    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.804824    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.804842    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.805663    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.805674    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.805924    2576 factory.go:55] Registering systemd factory
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.805945    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.807508    2576 factory.go:153] Registering CRI-O factory
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.807559    2576 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.807629    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.807780    2576 factory.go:103] Registering Raw factory
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.807805    2576 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.808307    2576 manager.go:349] Starting recovery of all containers
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.811291    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.811402    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.822036    2576 manager.go:354] Recovery completed
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.826885    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.828891    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.828922    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.828935    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.829507    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.829521    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.829541    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.829546    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.830212    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.830236    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.830247    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.831615    2576 policy_none.go:49] "None policy: Start"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.831637    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:27:14.402502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.831650    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:27:14.405602 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.832113    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-0.ec2.internal.18bfc9f586de8753  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-0.ec2.internal,UID:ip-10-0-137-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-0.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-0.ec2.internal,},FirstTimestamp:2026-07-06 19:27:13.828906835 +0000 UTC m=+0.418141477,LastTimestamp:2026-07-06 19:27:13.828906835 +0000 UTC m=+0.418141477,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-0.ec2.internal,}"
Jul 06 19:27:14.405602 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.833603    2576 policy_none.go:47] "Start"
Jul 06 19:27:14.405602 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.845947    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-0.ec2.internal.18bfc9f586dede50  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-0.ec2.internal,UID:ip-10-0-137-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-0.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-0.ec2.internal,},FirstTimestamp:2026-07-06 19:27:13.828929104 +0000 UTC m=+0.418163747,LastTimestamp:2026-07-06 19:27:13.828929104 +0000 UTC m=+0.418163747,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-0.ec2.internal,}"
Jul 06 19:27:14.405602 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.856524    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-0.ec2.internal.18bfc9f586df1cf7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-0.ec2.internal,UID:ip-10-0-137-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-0.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-0.ec2.internal,},FirstTimestamp:2026-07-06 19:27:13.828945143 +0000 UTC m=+0.418179784,LastTimestamp:2026-07-06 19:27:13.828945143 +0000 UTC m=+0.418179784,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-0.ec2.internal,}"
Jul 06 19:27:14.405602 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.869636    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9sqx6"
Jul 06 19:27:14.405602 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.874640    2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-0.ec2.internal.18bfc9f586de8753\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-0.ec2.internal.18bfc9f586de8753  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-0.ec2.internal,UID:ip-10-0-137-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-0.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-0.ec2.internal,},FirstTimestamp:2026-07-06 19:27:13.828906835 +0000 UTC m=+0.418141477,LastTimestamp:2026-07-06 19:27:13.830222895 +0000 UTC m=+0.419457547,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-0.ec2.internal,}"
Jul 06 19:27:14.405602 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.885022    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9sqx6"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.888959    2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-0.ec2.internal.18bfc9f586dede50\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-0.ec2.internal.18bfc9f586dede50  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-0.ec2.internal,UID:ip-10-0-137-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-0.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-0.ec2.internal,},FirstTimestamp:2026-07-06 19:27:13.828929104 +0000 UTC m=+0.418163747,LastTimestamp:2026-07-06 19:27:13.830240439 +0000 UTC m=+0.419475087,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-0.ec2.internal,}"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.899338    2576 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.899380    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.899393    2576 server.go:87] "Starting device plugin registration server"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.899727    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.899740    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.899848    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.899932    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.899946    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.900499    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.900549    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.915573    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.916759    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.916797    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.916820    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:13.916862    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:13.922414    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.000870    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.003972    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.004003    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.004014    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.004046    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.017532    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"]
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.017606    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.019611    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.019638    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.019650    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.020885    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:14.020907    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-0.ec2.internal\": node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.021986    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:27:14.405941 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.022104    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.022135    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.022868    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.022898    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.022922    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.024049    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.024072    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.024082    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.026185    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.026210    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.026878    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.026900    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.026909    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:14.087573    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-0.ec2.internal\" not found" node="ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:14.092382    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-0.ec2.internal\" not found" node="ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:14.105293    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.106324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b1d74e42ceb43a9b530a01d1402eeb7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"8b1d74e42ceb43a9b530a01d1402eeb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.106354    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b1d74e42ceb43a9b530a01d1402eeb7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"8b1d74e42ceb43a9b530a01d1402eeb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.106371    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d342b56abfb66b655ff620fd56373386-config\") pod \"kube-apiserver-proxy-ip-10-0-137-0.ec2.internal\" (UID: \"d342b56abfb66b655ff620fd56373386\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:14.205361    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.206511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b1d74e42ceb43a9b530a01d1402eeb7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"8b1d74e42ceb43a9b530a01d1402eeb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.206539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d342b56abfb66b655ff620fd56373386-config\") pod \"kube-apiserver-proxy-ip-10-0-137-0.ec2.internal\" (UID: \"d342b56abfb66b655ff620fd56373386\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.406922 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.206560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b1d74e42ceb43a9b530a01d1402eeb7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"8b1d74e42ceb43a9b530a01d1402eeb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.407572 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.206616    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b1d74e42ceb43a9b530a01d1402eeb7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"8b1d74e42ceb43a9b530a01d1402eeb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.407572 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.206669    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d342b56abfb66b655ff620fd56373386-config\") pod \"kube-apiserver-proxy-ip-10-0-137-0.ec2.internal\" (UID: \"d342b56abfb66b655ff620fd56373386\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.407572 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.206719    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8b1d74e42ceb43a9b530a01d1402eeb7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"8b1d74e42ceb43a9b530a01d1402eeb7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.407572 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:14.305446    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:14.407572 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.390559    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.407572 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.395605    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:14.407572 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:14.406497    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:14.538505 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:14.506976    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:14.659443 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:14.607404    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:14.659443 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.648767    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:27:14.718445 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:14.707857    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:16.261607 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.733083    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:27:16.261607 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.733235    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:27:16.261607 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:14.733272    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:27:16.261607 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:16.170084    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:16.261607 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:16.212462    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:27:16.261607 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:16.248559    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:22:15 +0000 UTC" deadline="2027-12-10 23:17:07.751994441 +0000 UTC"
Jul 06 19:27:16.261607 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:16.248600    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12531h49m51.503403938s"
Jul 06 19:27:16.362327 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:16.270151    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:16.362327 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:16.271233    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:27:16.362327 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:16.272156    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:27:16.362327 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:16.272185    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:27:16.362327 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:16.272200    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:27:16.551382 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:16.371187    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:16.551382 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:16.471639    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:16.745951 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:16.572051    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 06 19:27:16.745951 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:16.601639    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd342b56abfb66b655ff620fd56373386.slice/crio-b6f7bdfa81fb147af71fbb7a76297a0ca26df901d489d04ed11bf89f9adaaeec WatchSource:0}: Error finding container b6f7bdfa81fb147af71fbb7a76297a0ca26df901d489d04ed11bf89f9adaaeec: Status 404 returned error can't find the container with id b6f7bdfa81fb147af71fbb7a76297a0ca26df901d489d04ed11bf89f9adaaeec
Jul 06 19:27:16.745951 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:16.602380    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b1d74e42ceb43a9b530a01d1402eeb7.slice/crio-09bb38d1c217f6fb58173383bae6c0f3795a5f1d5119d9501c74bc1567548af0 WatchSource:0}: Error finding container 09bb38d1c217f6fb58173383bae6c0f3795a5f1d5119d9501c74bc1567548af0: Status 404 returned error can't find the container with id 09bb38d1c217f6fb58173383bae6c0f3795a5f1d5119d9501c74bc1567548af0
Jul 06 19:27:16.745951 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:16.607182    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:27:16.745951 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:16.622513    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:27:16.745951 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:16.666315    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:16.745951 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:16.683112    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:27:16.745951 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:16.684246    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
Jul 06 19:27:16.745951 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:16.694273    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.143505    2576 apiserver.go:52] "Watching apiserver"
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.154721    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.155160    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-qvkp8","openshift-image-registry/node-ca-6blqc","openshift-multus/multus-wmttv","openshift-multus/network-metrics-daemon-9flkj","openshift-ovn-kubernetes/ovnkube-node-rjvls","kube-system/konnectivity-agent-pckcb","kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal","openshift-dns/node-resolver-cbtfq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal","openshift-multus/multus-additional-cni-plugins-vjcg5","openshift-network-diagnostics/network-check-target-mldf8","openshift-network-operator/iptables-alerter-9qlch","kube-system/global-pull-secret-syncer-hfsmd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"]
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.157918    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.160021    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.160100    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.160958    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.161012    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.160958    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.161174    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.161351    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bbbsc\""
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.161370    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.162169    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.164324    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.164380    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.165319    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h99cc\""
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.165539    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.166811    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.167871    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.169673    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pckcb"
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.171319    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.171507    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.171541    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.171543    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.171576    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:27:17.191058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.171740    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.171950    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.172364    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gwvng\""
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.172561    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.172847    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.172981    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6s68c\""
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.174169    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cbtfq"
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175029    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175038    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175084    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175218    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs\") pod \"network-metrics-daemon-9flkj\" (UID: \"dc38d204-c217-4aa1-8dab-cbfd88600f21\") " pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175233    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z9rrt\""
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/750b8e20-d2eb-41b0-a423-affe1f95b71b-os-release\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175257    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-dbus\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-cnibin\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d42ace3-1b66-428a-818f-7824bdba8f06-cni-binary-copy\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-multus-socket-dir-parent\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-run-k8s-cni-cncf-io\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-run-netns\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.194995 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175364    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-cni-netd\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175380    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-var-lib-cni-bin\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175421    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-hostroot\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-run-multus-certs\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-etc-kubernetes\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175489    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m448f\" (UniqueName: \"kubernetes.io/projected/5d42ace3-1b66-428a-818f-7824bdba8f06-kube-api-access-m448f\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175508    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-systemd-units\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-run-ovn\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/750b8e20-d2eb-41b0-a423-affe1f95b71b-system-cni-dir\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175602    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpvgh\" (UniqueName: \"kubernetes.io/projected/750b8e20-d2eb-41b0-a423-affe1f95b71b-kube-api-access-kpvgh\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-kubelet-config\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175645    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-system-cni-dir\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175680    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-multus-conf-dir\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.196246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175710    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-var-lib-openvswitch\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.198534 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175730    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-ovnkube-script-lib\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.198534 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fzwx\" (UniqueName: \"kubernetes.io/projected/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-kube-api-access-6fzwx\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.198534 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175781    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-var-lib-cni-multus\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.198534 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qbpn\" (UniqueName: \"kubernetes.io/projected/dc38d204-c217-4aa1-8dab-cbfd88600f21-kube-api-access-2qbpn\") pod \"network-metrics-daemon-9flkj\" (UID: \"dc38d204-c217-4aa1-8dab-cbfd88600f21\") " pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:17.198534 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-kubelet\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.198534 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-run-netns\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.198534 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175894    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-cni-bin\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.198534 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175917    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:17.198534 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-run-openvswitch\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.198534 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.175983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-node-log\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.198534 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-run-ovn-kubernetes\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.198534 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-ovn-node-metrics-cert\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.198534 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/750b8e20-d2eb-41b0-a423-affe1f95b71b-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176072    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/750b8e20-d2eb-41b0-a423-affe1f95b71b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-multus-cni-dir\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-slash\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-run-systemd\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-etc-openvswitch\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176157    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-ovnkube-config\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/750b8e20-d2eb-41b0-a423-affe1f95b71b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/750b8e20-d2eb-41b0-a423-affe1f95b71b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-os-release\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-log-socket\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-env-overrides\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176245    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/750b8e20-d2eb-41b0-a423-affe1f95b71b-cnibin\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-var-lib-kubelet\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.199332 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d42ace3-1b66-428a-818f-7824bdba8f06-multus-daemon-config\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176429    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6blqc"
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176675    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.176827    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sq7z5\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.177161    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.178646    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.179322    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.179380    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qvtqt\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.179328    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.179776    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.180989    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.181038    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.182535    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.182575    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.182779    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cck9p\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.183276    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9qlch"
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.185010    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.186646    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.186891    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.186913    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9hz74\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.187100    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.211475    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v8jdz"
Jul 06 19:27:17.263061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.220112    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v8jdz"
Jul 06 19:27:17.268288 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.268265    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:27:17.276588 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-slash\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.276740 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/750b8e20-d2eb-41b0-a423-affe1f95b71b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.276740 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-var-lib-kubelet\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.276740 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs\") pod \"network-metrics-daemon-9flkj\" (UID: \"dc38d204-c217-4aa1-8dab-cbfd88600f21\") " pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:17.276740 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-log-socket\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.276740 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276700    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d42ace3-1b66-428a-818f-7824bdba8f06-multus-daemon-config\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.276740 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-modprobe-d\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.277035 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-tuned\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.277035 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276772    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-cnibin\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.277035 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-run-netns\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.277035 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276801    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-var-lib-kubelet\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.277035 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276814    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-slash\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.277035 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276859    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-var-lib-cni-bin\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.277035 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-var-lib-cni-bin\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.277035 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.276900    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:17.277035 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276944    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-cnibin\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.277035 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.276985    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-run-netns\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.277035 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277001    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-log-socket\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.277035 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.277007    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs podName:dc38d204-c217-4aa1-8dab-cbfd88600f21 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:17.776964978 +0000 UTC m=+3.004957976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs") pod "network-metrics-daemon-9flkj" (UID: "dc38d204-c217-4aa1-8dab-cbfd88600f21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277043    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-etc-kubernetes\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-sys-fs\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277122    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-etc-kubernetes\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277153    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-hostroot\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277198    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-hostroot\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277221    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-kubelet-config\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qbpn\" (UniqueName: \"kubernetes.io/projected/dc38d204-c217-4aa1-8dab-cbfd88600f21-kube-api-access-2qbpn\") pod \"network-metrics-daemon-9flkj\" (UID: \"dc38d204-c217-4aa1-8dab-cbfd88600f21\") " pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3fbace5-3965-4e94-8b3e-a92366cbb38f-hosts-file\") pod \"node-resolver-cbtfq\" (UID: \"b3fbace5-3965-4e94-8b3e-a92366cbb38f\") " pod="openshift-dns/node-resolver-cbtfq"
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277294    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-run\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277315    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-sys\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277318    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-kubelet-config\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-ovnkube-script-lib\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.277476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277364    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fzwx\" (UniqueName: \"kubernetes.io/projected/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-kube-api-access-6fzwx\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbvxc\" (UniqueName: \"kubernetes.io/projected/b781508a-c55b-4154-9a5b-4d745c745c60-kube-api-access-mbvxc\") pod \"node-ca-6blqc\" (UID: \"b781508a-c55b-4154-9a5b-4d745c745c60\") " pod="openshift-image-registry/node-ca-6blqc"
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277407    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-host\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277458    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-run-netns\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277463    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/750b8e20-d2eb-41b0-a423-affe1f95b71b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277480    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-cni-bin\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-device-dir\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277559    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d42ace3-1b66-428a-818f-7824bdba8f06-multus-daemon-config\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277573    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.277599    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3fbace5-3965-4e94-8b3e-a92366cbb38f-tmp-dir\") pod \"node-resolver-cbtfq\" (UID: \"b3fbace5-3965-4e94-8b3e-a92366cbb38f\") " pod="openshift-dns/node-resolver-cbtfq"
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277616    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-cni-bin\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.277676    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret podName:89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:17.777660862 +0000 UTC m=+3.005653847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret") pod "global-pull-secret-syncer-hfsmd" (UID: "89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:17.278003 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23a7b05a-6a70-47bc-aef8-1505552c763f-tmp\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277716    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-run-netns\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-os-release\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d42ace3-1b66-428a-818f-7824bdba8f06-cni-binary-copy\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-var-lib-cni-multus\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-run-openvswitch\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277843    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-ovnkube-script-lib\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-run-ovn-kubernetes\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277893    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-run-openvswitch\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-ovn-node-metrics-cert\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277967    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-os-release\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.277973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/750b8e20-d2eb-41b0-a423-affe1f95b71b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278005    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-var-lib-cni-multus\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-multus-cni-dir\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278066    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-run-systemd\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.278654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278284    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-multus-cni-dir\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-etc-openvswitch\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278350    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-ovnkube-config\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278388    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278514    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/750b8e20-d2eb-41b0-a423-affe1f95b71b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278548    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/750b8e20-d2eb-41b0-a423-affe1f95b71b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278563    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-run-systemd\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278564    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d42ace3-1b66-428a-818f-7824bdba8f06-cni-binary-copy\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278590    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-etc-openvswitch\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278633    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-run-ovn-kubernetes\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/750b8e20-d2eb-41b0-a423-affe1f95b71b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-socket-dir\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n2g5\" (UniqueName: \"kubernetes.io/projected/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-kube-api-access-7n2g5\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-sysctl-d\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.279350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278827    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-ovnkube-config\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw6kt\" (UniqueName: \"kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt\") pod \"network-check-target-mldf8\" (UID: \"bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4\") " pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-env-overrides\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.278947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/750b8e20-d2eb-41b0-a423-affe1f95b71b-cnibin\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279048    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5e24cbe-0ac2-41f0-9417-e4d3aca0283b-konnectivity-ca\") pod \"konnectivity-agent-pckcb\" (UID: \"b5e24cbe-0ac2-41f0-9417-e4d3aca0283b\") " pod="kube-system/konnectivity-agent-pckcb"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc7jr\" (UniqueName: \"kubernetes.io/projected/23a7b05a-6a70-47bc-aef8-1505552c763f-kube-api-access-lc7jr\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/750b8e20-d2eb-41b0-a423-affe1f95b71b-os-release\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-dbus\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-multus-socket-dir-parent\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279292    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-env-overrides\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279298    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-dbus\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m448f\" (UniqueName: \"kubernetes.io/projected/5d42ace3-1b66-428a-818f-7824bdba8f06-kube-api-access-m448f\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279350    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/750b8e20-d2eb-41b0-a423-affe1f95b71b-cnibin\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhmtk\" (UniqueName: \"kubernetes.io/projected/b3fbace5-3965-4e94-8b3e-a92366cbb38f-kube-api-access-hhmtk\") pod \"node-resolver-cbtfq\" (UID: \"b3fbace5-3965-4e94-8b3e-a92366cbb38f\") " pod="openshift-dns/node-resolver-cbtfq"
Jul 06 19:27:17.280020 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-sysctl-conf\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279395    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-multus-socket-dir-parent\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45-host-slash\") pod \"iptables-alerter-9qlch\" (UID: \"7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45\") " pod="openshift-network-operator/iptables-alerter-9qlch"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-cni-netd\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279474    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/750b8e20-d2eb-41b0-a423-affe1f95b71b-os-release\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-run-multus-certs\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279508    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-lib-modules\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279515    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-run-multus-certs\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-systemd-units\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279567    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-run-ovn\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/750b8e20-d2eb-41b0-a423-affe1f95b71b-system-cni-dir\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpvgh\" (UniqueName: \"kubernetes.io/projected/750b8e20-d2eb-41b0-a423-affe1f95b71b-kube-api-access-kpvgh\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-system-cni-dir\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.280697 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279709    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-systemd-units\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-multus-conf-dir\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279754    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279754    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-registration-dir\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279771    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-multus-conf-dir\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279798    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/750b8e20-d2eb-41b0-a423-affe1f95b71b-system-cni-dir\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279841    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-run-ovn\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279841    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-cni-netd\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-var-lib-openvswitch\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279903    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-system-cni-dir\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279911    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5e24cbe-0ac2-41f0-9417-e4d3aca0283b-agent-certs\") pod \"konnectivity-agent-pckcb\" (UID: \"b5e24cbe-0ac2-41f0-9417-e4d3aca0283b\") " pod="kube-system/konnectivity-agent-pckcb"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279967    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b781508a-c55b-4154-9a5b-4d745c745c60-serviceca\") pod \"node-ca-6blqc\" (UID: \"b781508a-c55b-4154-9a5b-4d745c745c60\") " pod="openshift-image-registry/node-ca-6blqc"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279969    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-var-lib-openvswitch\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.279993    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-sysconfig\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.281399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.280017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-kubernetes\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.282074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.280052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-var-lib-kubelet\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.282074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.280086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42nhq\" (UniqueName: \"kubernetes.io/projected/7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45-kube-api-access-42nhq\") pod \"iptables-alerter-9qlch\" (UID: \"7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45\") " pod="openshift-network-operator/iptables-alerter-9qlch"
Jul 06 19:27:17.282074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.280135    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-kubelet\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.282074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.280212    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-host-kubelet\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.282074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.280289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-systemd\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.282074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.280316    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45-iptables-alerter-script\") pod \"iptables-alerter-9qlch\" (UID: \"7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45\") " pod="openshift-network-operator/iptables-alerter-9qlch"
Jul 06 19:27:17.282074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.280368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-run-k8s-cni-cncf-io\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.282074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.280424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-node-log\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.282074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.280450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/750b8e20-d2eb-41b0-a423-affe1f95b71b-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.282074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.280511    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d42ace3-1b66-428a-818f-7824bdba8f06-host-run-k8s-cni-cncf-io\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.282074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.280559    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-node-log\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.282074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.280625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b781508a-c55b-4154-9a5b-4d745c745c60-host\") pod \"node-ca-6blqc\" (UID: \"b781508a-c55b-4154-9a5b-4d745c745c60\") " pod="openshift-image-registry/node-ca-6blqc"
Jul 06 19:27:17.282074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.281139    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/750b8e20-d2eb-41b0-a423-affe1f95b71b-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.282675 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.282167    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-ovn-node-metrics-cert\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.284832 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.284765    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal" event={"ID":"8b1d74e42ceb43a9b530a01d1402eeb7","Type":"ContainerStarted","Data":"09bb38d1c217f6fb58173383bae6c0f3795a5f1d5119d9501c74bc1567548af0"}
Jul 06 19:27:17.286745 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.286698    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal" event={"ID":"d342b56abfb66b655ff620fd56373386","Type":"ContainerStarted","Data":"b6f7bdfa81fb147af71fbb7a76297a0ca26df901d489d04ed11bf89f9adaaeec"}
Jul 06 19:27:17.288462 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.288365    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fzwx\" (UniqueName: \"kubernetes.io/projected/1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795-kube-api-access-6fzwx\") pod \"ovnkube-node-rjvls\" (UID: \"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795\") " pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.290014 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.289978    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qbpn\" (UniqueName: \"kubernetes.io/projected/dc38d204-c217-4aa1-8dab-cbfd88600f21-kube-api-access-2qbpn\") pod \"network-metrics-daemon-9flkj\" (UID: \"dc38d204-c217-4aa1-8dab-cbfd88600f21\") " pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:17.296143 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.296102    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpvgh\" (UniqueName: \"kubernetes.io/projected/750b8e20-d2eb-41b0-a423-affe1f95b71b-kube-api-access-kpvgh\") pod \"multus-additional-cni-plugins-vjcg5\" (UID: \"750b8e20-d2eb-41b0-a423-affe1f95b71b\") " pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.296737 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.296715    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m448f\" (UniqueName: \"kubernetes.io/projected/5d42ace3-1b66-428a-818f-7824bdba8f06-kube-api-access-m448f\") pod \"multus-wmttv\" (UID: \"5d42ace3-1b66-428a-818f-7824bdba8f06\") " pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b781508a-c55b-4154-9a5b-4d745c745c60-host\") pod \"node-ca-6blqc\" (UID: \"b781508a-c55b-4154-9a5b-4d745c745c60\") " pod="openshift-image-registry/node-ca-6blqc"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-modprobe-d\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-tuned\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382520    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-sys-fs\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3fbace5-3965-4e94-8b3e-a92366cbb38f-hosts-file\") pod \"node-resolver-cbtfq\" (UID: \"b3fbace5-3965-4e94-8b3e-a92366cbb38f\") " pod="openshift-dns/node-resolver-cbtfq"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382597    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-run\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-sys\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382646    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvxc\" (UniqueName: \"kubernetes.io/projected/b781508a-c55b-4154-9a5b-4d745c745c60-kube-api-access-mbvxc\") pod \"node-ca-6blqc\" (UID: \"b781508a-c55b-4154-9a5b-4d745c745c60\") " pod="openshift-image-registry/node-ca-6blqc"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382668    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-host\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382722    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-device-dir\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3fbace5-3965-4e94-8b3e-a92366cbb38f-tmp-dir\") pod \"node-resolver-cbtfq\" (UID: \"b3fbace5-3965-4e94-8b3e-a92366cbb38f\") " pod="openshift-dns/node-resolver-cbtfq"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23a7b05a-6a70-47bc-aef8-1505552c763f-tmp\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.383004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-socket-dir\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n2g5\" (UniqueName: \"kubernetes.io/projected/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-kube-api-access-7n2g5\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-sysctl-d\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6kt\" (UniqueName: \"kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt\") pod \"network-check-target-mldf8\" (UID: \"bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4\") " pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382971    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5e24cbe-0ac2-41f0-9417-e4d3aca0283b-konnectivity-ca\") pod \"konnectivity-agent-pckcb\" (UID: \"b5e24cbe-0ac2-41f0-9417-e4d3aca0283b\") " pod="kube-system/konnectivity-agent-pckcb"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.382993    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc7jr\" (UniqueName: \"kubernetes.io/projected/23a7b05a-6a70-47bc-aef8-1505552c763f-kube-api-access-lc7jr\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383025    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhmtk\" (UniqueName: \"kubernetes.io/projected/b3fbace5-3965-4e94-8b3e-a92366cbb38f-kube-api-access-hhmtk\") pod \"node-resolver-cbtfq\" (UID: \"b3fbace5-3965-4e94-8b3e-a92366cbb38f\") " pod="openshift-dns/node-resolver-cbtfq"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-sysctl-conf\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45-host-slash\") pod \"iptables-alerter-9qlch\" (UID: \"7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45\") " pod="openshift-network-operator/iptables-alerter-9qlch"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383091    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-lib-modules\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383122    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-registration-dir\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5e24cbe-0ac2-41f0-9417-e4d3aca0283b-agent-certs\") pod \"konnectivity-agent-pckcb\" (UID: \"b5e24cbe-0ac2-41f0-9417-e4d3aca0283b\") " pod="kube-system/konnectivity-agent-pckcb"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383166    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b781508a-c55b-4154-9a5b-4d745c745c60-serviceca\") pod \"node-ca-6blqc\" (UID: \"b781508a-c55b-4154-9a5b-4d745c745c60\") " pod="openshift-image-registry/node-ca-6blqc"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-sysconfig\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.383806 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-kubernetes\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.384432 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-var-lib-kubelet\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.384432 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42nhq\" (UniqueName: \"kubernetes.io/projected/7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45-kube-api-access-42nhq\") pod \"iptables-alerter-9qlch\" (UID: \"7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45\") " pod="openshift-network-operator/iptables-alerter-9qlch"
Jul 06 19:27:17.384432 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-systemd\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.384432 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45-iptables-alerter-script\") pod \"iptables-alerter-9qlch\" (UID: \"7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45\") " pod="openshift-network-operator/iptables-alerter-9qlch"
Jul 06 19:27:17.384432 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383773    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b781508a-c55b-4154-9a5b-4d745c745c60-host\") pod \"node-ca-6blqc\" (UID: \"b781508a-c55b-4154-9a5b-4d745c745c60\") " pod="openshift-image-registry/node-ca-6blqc"
Jul 06 19:27:17.384432 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383904    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-modprobe-d\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.384432 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.383977    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45-iptables-alerter-script\") pod \"iptables-alerter-9qlch\" (UID: \"7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45\") " pod="openshift-network-operator/iptables-alerter-9qlch"
Jul 06 19:27:17.384432 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.384115    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-sysctl-d\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.384889 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.384862    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b5e24cbe-0ac2-41f0-9417-e4d3aca0283b-konnectivity-ca\") pod \"konnectivity-agent-pckcb\" (UID: \"b5e24cbe-0ac2-41f0-9417-e4d3aca0283b\") " pod="kube-system/konnectivity-agent-pckcb"
Jul 06 19:27:17.385437 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.385398    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-sysctl-conf\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.385519 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.385452    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45-host-slash\") pod \"iptables-alerter-9qlch\" (UID: \"7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45\") " pod="openshift-network-operator/iptables-alerter-9qlch"
Jul 06 19:27:17.385579 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.385539    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-lib-modules\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.385678 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.385595    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-registration-dir\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386039    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-kubernetes\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386214    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386296    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-sys-fs\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386344    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3fbace5-3965-4e94-8b3e-a92366cbb38f-hosts-file\") pod \"node-resolver-cbtfq\" (UID: \"b3fbace5-3965-4e94-8b3e-a92366cbb38f\") " pod="openshift-dns/node-resolver-cbtfq"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386392    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-run\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386436    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-sys\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386466    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b781508a-c55b-4154-9a5b-4d745c745c60-serviceca\") pod \"node-ca-6blqc\" (UID: \"b781508a-c55b-4154-9a5b-4d745c745c60\") " pod="openshift-image-registry/node-ca-6blqc"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386518    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-etc-selinux\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386534    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-sysconfig\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386565    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-host\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386617    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-systemd\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386659    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23a7b05a-6a70-47bc-aef8-1505552c763f-var-lib-kubelet\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386682    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-socket-dir\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.386716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386701    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-device-dir\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.387465 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.386835    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3fbace5-3965-4e94-8b3e-a92366cbb38f-tmp-dir\") pod \"node-resolver-cbtfq\" (UID: \"b3fbace5-3965-4e94-8b3e-a92366cbb38f\") " pod="openshift-dns/node-resolver-cbtfq"
Jul 06 19:27:17.389233 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.388916    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23a7b05a-6a70-47bc-aef8-1505552c763f-tmp\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.389351 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.389327    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/23a7b05a-6a70-47bc-aef8-1505552c763f-etc-tuned\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.391041 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.390987    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b5e24cbe-0ac2-41f0-9417-e4d3aca0283b-agent-certs\") pod \"konnectivity-agent-pckcb\" (UID: \"b5e24cbe-0ac2-41f0-9417-e4d3aca0283b\") " pod="kube-system/konnectivity-agent-pckcb"
Jul 06 19:27:17.395620 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.394595    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:27:17.395620 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.394618    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:27:17.395620 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.394632    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kw6kt for pod openshift-network-diagnostics/network-check-target-mldf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:17.395620 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.394738    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt podName:bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:17.894719368 +0000 UTC m=+3.122712374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kw6kt" (UniqueName: "kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt") pod "network-check-target-mldf8" (UID: "bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:17.398485 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.398431    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n2g5\" (UniqueName: \"kubernetes.io/projected/2d052fcb-1de4-45cd-adb2-a96bc7e52d7f-kube-api-access-7n2g5\") pod \"aws-ebs-csi-driver-node-fqll8\" (UID: \"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.398485 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.398471    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42nhq\" (UniqueName: \"kubernetes.io/projected/7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45-kube-api-access-42nhq\") pod \"iptables-alerter-9qlch\" (UID: \"7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45\") " pod="openshift-network-operator/iptables-alerter-9qlch"
Jul 06 19:27:17.399031 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.398718    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc7jr\" (UniqueName: \"kubernetes.io/projected/23a7b05a-6a70-47bc-aef8-1505552c763f-kube-api-access-lc7jr\") pod \"tuned-qvkp8\" (UID: \"23a7b05a-6a70-47bc-aef8-1505552c763f\") " pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.399290 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.399249    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhmtk\" (UniqueName: \"kubernetes.io/projected/b3fbace5-3965-4e94-8b3e-a92366cbb38f-kube-api-access-hhmtk\") pod \"node-resolver-cbtfq\" (UID: \"b3fbace5-3965-4e94-8b3e-a92366cbb38f\") " pod="openshift-dns/node-resolver-cbtfq"
Jul 06 19:27:17.400236 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.399835    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbvxc\" (UniqueName: \"kubernetes.io/projected/b781508a-c55b-4154-9a5b-4d745c745c60-kube-api-access-mbvxc\") pod \"node-ca-6blqc\" (UID: \"b781508a-c55b-4154-9a5b-4d745c745c60\") " pod="openshift-image-registry/node-ca-6blqc"
Jul 06 19:27:17.472781 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.472749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vjcg5"
Jul 06 19:27:17.481902 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.481873    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wmttv"
Jul 06 19:27:17.491597 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.491216    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:17.491694 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:17.491669    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d42ace3_1b66_428a_818f_7824bdba8f06.slice/crio-e44b0f48e336a2f03c1987a4b38ea6bd68cf49db1049bc6991bf23962c3401cf WatchSource:0}: Error finding container e44b0f48e336a2f03c1987a4b38ea6bd68cf49db1049bc6991bf23962c3401cf: Status 404 returned error can't find the container with id e44b0f48e336a2f03c1987a4b38ea6bd68cf49db1049bc6991bf23962c3401cf
Jul 06 19:27:17.495982 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.495708    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pckcb"
Jul 06 19:27:17.502722 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:17.502690    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ceb5ab4_495f_4a5d_b9ce_d0b4579ef795.slice/crio-49356ecf6a75b6a5e4d32557b6b6ed2b72d294782903aa618d205fdeb443b13d WatchSource:0}: Error finding container 49356ecf6a75b6a5e4d32557b6b6ed2b72d294782903aa618d205fdeb443b13d: Status 404 returned error can't find the container with id 49356ecf6a75b6a5e4d32557b6b6ed2b72d294782903aa618d205fdeb443b13d
Jul 06 19:27:17.506979 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:17.506913    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e24cbe_0ac2_41f0_9417_e4d3aca0283b.slice/crio-1f2bba5bc211077cf0f39bbeb74220d614a898dcab65e27449abbcb83ac743a0 WatchSource:0}: Error finding container 1f2bba5bc211077cf0f39bbeb74220d614a898dcab65e27449abbcb83ac743a0: Status 404 returned error can't find the container with id 1f2bba5bc211077cf0f39bbeb74220d614a898dcab65e27449abbcb83ac743a0
Jul 06 19:27:17.511730 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.511600    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8"
Jul 06 19:27:17.519818 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.519790    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cbtfq"
Jul 06 19:27:17.522966 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:17.522908    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d052fcb_1de4_45cd_adb2_a96bc7e52d7f.slice/crio-8defe4721ca2fc34b8c709f5ec71025ba3298d08cd7816e9ef9a8ee04fd075be WatchSource:0}: Error finding container 8defe4721ca2fc34b8c709f5ec71025ba3298d08cd7816e9ef9a8ee04fd075be: Status 404 returned error can't find the container with id 8defe4721ca2fc34b8c709f5ec71025ba3298d08cd7816e9ef9a8ee04fd075be
Jul 06 19:27:17.526482 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.526462    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6blqc"
Jul 06 19:27:17.534601 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.533384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qvkp8"
Jul 06 19:27:17.536710 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:17.536666    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb781508a_c55b_4154_9a5b_4d745c745c60.slice/crio-94dec6a90b1f0478c232f572c20662028efea8fca938bd1fd274f92a4b466447 WatchSource:0}: Error finding container 94dec6a90b1f0478c232f572c20662028efea8fca938bd1fd274f92a4b466447: Status 404 returned error can't find the container with id 94dec6a90b1f0478c232f572c20662028efea8fca938bd1fd274f92a4b466447
Jul 06 19:27:17.544210 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:17.544182    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a7b05a_6a70_47bc_aef8_1505552c763f.slice/crio-32a6df0de7ea68126b0629f9967da2b2a88b4be660808931aa2a39ab9333e8a1 WatchSource:0}: Error finding container 32a6df0de7ea68126b0629f9967da2b2a88b4be660808931aa2a39ab9333e8a1: Status 404 returned error can't find the container with id 32a6df0de7ea68126b0629f9967da2b2a88b4be660808931aa2a39ab9333e8a1
Jul 06 19:27:17.564418 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.564384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9qlch"
Jul 06 19:27:17.577021 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:17.576982    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d962ff2_bbb8_4ddc_a925_9f8cf32d6b45.slice/crio-088a81895b198c492e618babd94263963b8aadcb7cafdd3b7bc638177eb673cf WatchSource:0}: Error finding container 088a81895b198c492e618babd94263963b8aadcb7cafdd3b7bc638177eb673cf: Status 404 returned error can't find the container with id 088a81895b198c492e618babd94263963b8aadcb7cafdd3b7bc638177eb673cf
Jul 06 19:27:17.591643 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.591613    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:27:17.786393 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.786275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs\") pod \"network-metrics-daemon-9flkj\" (UID: \"dc38d204-c217-4aa1-8dab-cbfd88600f21\") " pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:17.786393 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.786323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:17.786615 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.786452    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:17.786615 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.786456    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:17.786615 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.786520    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret podName:89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:18.786503174 +0000 UTC m=+4.014496154 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret") pod "global-pull-secret-syncer-hfsmd" (UID: "89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:17.786615 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.786540    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs podName:dc38d204-c217-4aa1-8dab-cbfd88600f21 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:18.786530139 +0000 UTC m=+4.014523120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs") pod "network-metrics-daemon-9flkj" (UID: "dc38d204-c217-4aa1-8dab-cbfd88600f21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:17.987637 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:17.987572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6kt\" (UniqueName: \"kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt\") pod \"network-check-target-mldf8\" (UID: \"bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4\") " pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:17.987958 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.987734    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:27:17.987958 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.987753    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:27:17.987958 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.987766    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kw6kt for pod openshift-network-diagnostics/network-check-target-mldf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:17.987958 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:17.987831    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt podName:bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:18.987810857 +0000 UTC m=+4.215803867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kw6kt" (UniqueName: "kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt") pod "network-check-target-mldf8" (UID: "bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:18.223509 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.223377    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:22:17 +0000 UTC" deadline="2028-02-12 20:40:21.333206477 +0000 UTC"
Jul 06 19:27:18.223509 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.223456    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14065h13m3.109754466s"
Jul 06 19:27:18.291145 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.291039    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qvkp8" event={"ID":"23a7b05a-6a70-47bc-aef8-1505552c763f","Type":"ContainerStarted","Data":"32a6df0de7ea68126b0629f9967da2b2a88b4be660808931aa2a39ab9333e8a1"}
Jul 06 19:27:18.292742 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.292682    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cbtfq" event={"ID":"b3fbace5-3965-4e94-8b3e-a92366cbb38f","Type":"ContainerStarted","Data":"a89ea005bfd26e39b0628229b6e780b142b05c4c57ef20ed1411590d89d946e0"}
Jul 06 19:27:18.294224 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.294194    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8" event={"ID":"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f","Type":"ContainerStarted","Data":"8defe4721ca2fc34b8c709f5ec71025ba3298d08cd7816e9ef9a8ee04fd075be"}
Jul 06 19:27:18.296281 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.296252    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pckcb" event={"ID":"b5e24cbe-0ac2-41f0-9417-e4d3aca0283b","Type":"ContainerStarted","Data":"1f2bba5bc211077cf0f39bbeb74220d614a898dcab65e27449abbcb83ac743a0"}
Jul 06 19:27:18.298149 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.298068    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls" event={"ID":"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795","Type":"ContainerStarted","Data":"49356ecf6a75b6a5e4d32557b6b6ed2b72d294782903aa618d205fdeb443b13d"}
Jul 06 19:27:18.301099 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.301024    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wmttv" event={"ID":"5d42ace3-1b66-428a-818f-7824bdba8f06","Type":"ContainerStarted","Data":"e44b0f48e336a2f03c1987a4b38ea6bd68cf49db1049bc6991bf23962c3401cf"}
Jul 06 19:27:18.302683 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.302626    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9qlch" event={"ID":"7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45","Type":"ContainerStarted","Data":"088a81895b198c492e618babd94263963b8aadcb7cafdd3b7bc638177eb673cf"}
Jul 06 19:27:18.305040 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.305010    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6blqc" event={"ID":"b781508a-c55b-4154-9a5b-4d745c745c60","Type":"ContainerStarted","Data":"94dec6a90b1f0478c232f572c20662028efea8fca938bd1fd274f92a4b466447"}
Jul 06 19:27:18.306693 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.306637    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjcg5" event={"ID":"750b8e20-d2eb-41b0-a423-affe1f95b71b","Type":"ContainerStarted","Data":"183bec45bb1ba7849dcc62b3506b3c915a4887f482ac0dc9df93fd198416148a"}
Jul 06 19:27:18.749152 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.749119    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:27:18.793385 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.793347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs\") pod \"network-metrics-daemon-9flkj\" (UID: \"dc38d204-c217-4aa1-8dab-cbfd88600f21\") " pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:18.793555 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.793411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:18.793555 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:18.793528    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:18.793678 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:18.793556    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:18.793678 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:18.793599    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs podName:dc38d204-c217-4aa1-8dab-cbfd88600f21 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:20.793579551 +0000 UTC m=+6.021572537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs") pod "network-metrics-daemon-9flkj" (UID: "dc38d204-c217-4aa1-8dab-cbfd88600f21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:18.793678 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:18.793623    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret podName:89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:20.793612818 +0000 UTC m=+6.021605804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret") pod "global-pull-secret-syncer-hfsmd" (UID: "89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:18.994715 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:18.994675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6kt\" (UniqueName: \"kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt\") pod \"network-check-target-mldf8\" (UID: \"bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4\") " pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:18.994905 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:18.994859    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:27:18.994905 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:18.994879    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:27:18.994905 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:18.994891    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kw6kt for pod openshift-network-diagnostics/network-check-target-mldf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:18.995131 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:18.994973    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt podName:bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:20.994951396 +0000 UTC m=+6.222944380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kw6kt" (UniqueName: "kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt") pod "network-check-target-mldf8" (UID: "bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:19.224567 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:19.224446    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:22:17 +0000 UTC" deadline="2028-01-19 21:42:07.810298039 +0000 UTC"
Jul 06 19:27:19.224567 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:19.224486    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13490h14m48.585816441s"
Jul 06 19:27:19.280071 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:19.280044    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:19.280240 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:19.280171    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:19.280578 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:19.280557    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:19.280691 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:19.280671    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:19.282274 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:19.282112    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:19.282274 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:19.282217    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:20.811573 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:20.811535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:20.812079 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:20.811650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs\") pod \"network-metrics-daemon-9flkj\" (UID: \"dc38d204-c217-4aa1-8dab-cbfd88600f21\") " pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:20.812079 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:20.811801    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:20.812079 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:20.811867    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs podName:dc38d204-c217-4aa1-8dab-cbfd88600f21 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:24.811848236 +0000 UTC m=+10.039841237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs") pod "network-metrics-daemon-9flkj" (UID: "dc38d204-c217-4aa1-8dab-cbfd88600f21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:20.812079 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:20.811944    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:20.812079 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:20.811981    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret podName:89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:24.811968489 +0000 UTC m=+10.039961472 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret") pod "global-pull-secret-syncer-hfsmd" (UID: "89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:21.015160 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:21.014493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6kt\" (UniqueName: \"kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt\") pod \"network-check-target-mldf8\" (UID: \"bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4\") " pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:21.015160 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:21.014677    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:27:21.015160 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:21.014696    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:27:21.015160 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:21.014708    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kw6kt for pod openshift-network-diagnostics/network-check-target-mldf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:21.015160 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:21.014768    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt podName:bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:25.014750138 +0000 UTC m=+10.242743134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kw6kt" (UniqueName: "kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt") pod "network-check-target-mldf8" (UID: "bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:21.282913 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:21.282838    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:21.283092 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:21.282993    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:21.283604 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:21.283355    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:21.283604 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:21.283454    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:21.283604 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:21.283496    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:21.283604 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:21.283569    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:23.279121 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:23.279055    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:23.279121 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:23.279087    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:23.279625 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:23.279179    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:23.279625 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:23.279541    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:23.279730 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:23.279641    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:23.279785 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:23.279739    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:24.843262 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:24.843163    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs\") pod \"network-metrics-daemon-9flkj\" (UID: \"dc38d204-c217-4aa1-8dab-cbfd88600f21\") " pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:24.843262 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:24.843215    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:24.843773 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:24.843316    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:24.843773 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:24.843373    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret podName:89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:32.843360195 +0000 UTC m=+18.071353175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret") pod "global-pull-secret-syncer-hfsmd" (UID: "89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:24.843773 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:24.843316    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:24.843773 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:24.843471    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs podName:dc38d204-c217-4aa1-8dab-cbfd88600f21 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:32.843453906 +0000 UTC m=+18.071446890 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs") pod "network-metrics-daemon-9flkj" (UID: "dc38d204-c217-4aa1-8dab-cbfd88600f21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:25.045525 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:25.045482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6kt\" (UniqueName: \"kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt\") pod \"network-check-target-mldf8\" (UID: \"bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4\") " pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:25.045693 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:25.045679    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:27:25.045745 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:25.045703    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:27:25.045745 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:25.045716    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kw6kt for pod openshift-network-diagnostics/network-check-target-mldf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:25.045826 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:25.045778    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt podName:bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:33.045758459 +0000 UTC m=+18.273751455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kw6kt" (UniqueName: "kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt") pod "network-check-target-mldf8" (UID: "bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:25.280083 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:25.280050    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:25.280318 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:25.280145    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:25.280318 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:25.280185    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:25.280318 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:25.280192    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:25.280318 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:25.280268    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:25.280561 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:25.280361    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:27.279041 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:27.279002    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:27.279041 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:27.279027    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:27.279572 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:27.279015    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:27.279572 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:27.279133    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:27.279572 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:27.279224    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:27.279572 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:27.279311    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:28.331478 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:28.331441    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal" event={"ID":"d342b56abfb66b655ff620fd56373386","Type":"ContainerStarted","Data":"3beaee94e5a46726a1969ec98599884c9d30b2b7bdc7b04991dd14d5485dce9c"}
Jul 06 19:27:28.356050 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:28.355998    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal" podStartSLOduration=12.355981729 podStartE2EDuration="12.355981729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:28.355608894 +0000 UTC m=+13.583601898" watchObservedRunningTime="2026-07-06 19:27:28.355981729 +0000 UTC m=+13.583974738"
Jul 06 19:27:29.279280 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:29.279030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:29.279439 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:29.279030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:29.279439 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:29.279328    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:29.279439 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:29.279030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:29.279439 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:29.279429    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:29.279649 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:29.279461    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:29.335791 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:29.335735    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qvkp8" event={"ID":"23a7b05a-6a70-47bc-aef8-1505552c763f","Type":"ContainerStarted","Data":"7f96068f9b19b46e05cc2d764aa38c36f95358839da727388626a28d65c6daf2"}
Jul 06 19:27:29.358624 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:29.357900    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qvkp8" podStartSLOduration=3.769557655 podStartE2EDuration="14.357878598s" totalImagesPullingTime="10.588320943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:29.357752404 +0000 UTC m=+14.585745408" watchObservedRunningTime="2026-07-06 19:27:29.357878598 +0000 UTC m=+14.585871605"
Jul 06 19:27:30.339055 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:30.339020    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal" event={"ID":"8b1d74e42ceb43a9b530a01d1402eeb7","Type":"ContainerStarted","Data":"837dbbd6f8466cf678992f28f037fd5d90158c289a09089335dd760ed3b4001c"}
Jul 06 19:27:30.340679 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:30.340649    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cbtfq" event={"ID":"b3fbace5-3965-4e94-8b3e-a92366cbb38f","Type":"ContainerStarted","Data":"09a7c60f5aa7fb83e7b94a1179559322a2bcb1f23b0253d572a836dd8d3644fa"}
Jul 06 19:27:30.342173 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:30.342149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8" event={"ID":"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f","Type":"ContainerStarted","Data":"66eea9c916e1eed8d3e2da1cd263582f6f8e374eaab7f96fe8bc23c7a2bfb953"}
Jul 06 19:27:30.343653 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:30.343626    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pckcb" event={"ID":"b5e24cbe-0ac2-41f0-9417-e4d3aca0283b","Type":"ContainerStarted","Data":"81236f9030bab5b40962c7ed1e1f294726cd7ac169726b6adfb3e260f312bfb1"}
Jul 06 19:27:30.345293 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:30.345256    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9qlch" event={"ID":"7d962ff2-bbb8-4ddc-a925-9f8cf32d6b45","Type":"ContainerStarted","Data":"37fd4cd262bb38556467dac71f3e754935544b441bb2f5fe6cff2b31648b24cf"}
Jul 06 19:27:30.346823 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:30.346789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6blqc" event={"ID":"b781508a-c55b-4154-9a5b-4d745c745c60","Type":"ContainerStarted","Data":"97f912aeb9c0f0329ba1577c03f1e278ae1bc4e02b89c7cdccadbf5ba254c0d7"}
Jul 06 19:27:30.348368 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:30.348347    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjcg5" event={"ID":"750b8e20-d2eb-41b0-a423-affe1f95b71b","Type":"ContainerStarted","Data":"6581ea31eaa91b6bddd05818e6129f26f57efc8cfb6b6ea364b461b07feaaa84"}
Jul 06 19:27:30.388976 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:30.388900    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pckcb" podStartSLOduration=4.794877479 podStartE2EDuration="15.388877724s" totalImagesPullingTime="10.594000245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:30.388408228 +0000 UTC m=+15.616401248" watchObservedRunningTime="2026-07-06 19:27:30.388877724 +0000 UTC m=+15.616870729"
Jul 06 19:27:30.412552 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:30.412498    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cbtfq" podStartSLOduration=4.84311704 podStartE2EDuration="15.412480474s" totalImagesPullingTime="10.569363434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:30.412280137 +0000 UTC m=+15.640273144" watchObservedRunningTime="2026-07-06 19:27:30.412480474 +0000 UTC m=+15.640473477"
Jul 06 19:27:30.455809 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:30.455758    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6blqc" podStartSLOduration=4.8614117 podStartE2EDuration="15.455737895s" totalImagesPullingTime="10.594326195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:30.455290787 +0000 UTC m=+15.683283817" watchObservedRunningTime="2026-07-06 19:27:30.455737895 +0000 UTC m=+15.683730900"
Jul 06 19:27:30.473654 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:30.471839    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9qlch" podStartSLOduration=4.910697422 podStartE2EDuration="15.471799666s" totalImagesPullingTime="10.561102244s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:30.47133263 +0000 UTC m=+15.699325633" watchObservedRunningTime="2026-07-06 19:27:30.471799666 +0000 UTC m=+15.699792670"
Jul 06 19:27:31.279355 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:31.279316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:31.279548 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:31.279454    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:31.279951 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:31.279878    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:31.280062 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:31.280004    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:31.280062 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:31.280060    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:31.280181 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:31.280150    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:31.850022 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:31.849984    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pckcb"
Jul 06 19:27:31.850609 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:31.850571    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pckcb"
Jul 06 19:27:32.910471 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:32.910431    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs\") pod \"network-metrics-daemon-9flkj\" (UID: \"dc38d204-c217-4aa1-8dab-cbfd88600f21\") " pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:32.911041 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:32.910492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:32.911041 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:32.910612    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:32.911041 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:32.910615    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:32.911041 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:32.910683    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret podName:89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:48.910663526 +0000 UTC m=+34.138656521 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret") pod "global-pull-secret-syncer-hfsmd" (UID: "89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:32.911041 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:32.910704    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs podName:dc38d204-c217-4aa1-8dab-cbfd88600f21 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:48.910694358 +0000 UTC m=+34.138687346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs") pod "network-metrics-daemon-9flkj" (UID: "dc38d204-c217-4aa1-8dab-cbfd88600f21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:33.111316 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:33.111286    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6kt\" (UniqueName: \"kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt\") pod \"network-check-target-mldf8\" (UID: \"bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4\") " pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:33.111484 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:33.111463    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:27:33.111521 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:33.111490    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:27:33.111521 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:33.111501    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kw6kt for pod openshift-network-diagnostics/network-check-target-mldf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:33.111588 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:33.111550    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt podName:bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:49.111537375 +0000 UTC m=+34.339530356 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kw6kt" (UniqueName: "kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt") pod "network-check-target-mldf8" (UID: "bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:33.278453 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:33.278420    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:33.278453 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:33.278457    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:33.278642 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:33.278430    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:33.278642 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:33.278519    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:33.278642 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:33.278620    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:33.278736 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:33.278681    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:33.355074 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:33.355024    2576 generic.go:356] "Generic (PLEG): container finished" podID="8b1d74e42ceb43a9b530a01d1402eeb7" containerID="837dbbd6f8466cf678992f28f037fd5d90158c289a09089335dd760ed3b4001c" exitCode=0
Jul 06 19:27:33.355241 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:33.355106    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal" event={"ID":"8b1d74e42ceb43a9b530a01d1402eeb7","Type":"ContainerDied","Data":"837dbbd6f8466cf678992f28f037fd5d90158c289a09089335dd760ed3b4001c"}
Jul 06 19:27:33.356824 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:33.356802    2576 generic.go:356] "Generic (PLEG): container finished" podID="750b8e20-d2eb-41b0-a423-affe1f95b71b" containerID="6581ea31eaa91b6bddd05818e6129f26f57efc8cfb6b6ea364b461b07feaaa84" exitCode=0
Jul 06 19:27:33.356917 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:33.356872    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:27:33.356917 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:33.356870    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjcg5" event={"ID":"750b8e20-d2eb-41b0-a423-affe1f95b71b","Type":"ContainerDied","Data":"6581ea31eaa91b6bddd05818e6129f26f57efc8cfb6b6ea364b461b07feaaa84"}
Jul 06 19:27:35.279531 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:35.279492    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:35.280028 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:35.279580    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:35.280028 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:35.279626    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:35.280028 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:35.279628    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:35.280028 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:35.279716    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:35.280028 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:35.279795    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:37.278976 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:37.278945    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:37.279417 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:37.278981    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:37.279417 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:37.278944    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:37.279417 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:37.279103    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:37.279417 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:37.279131    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:37.279417 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:37.279193    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:37.367942 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:37.367846    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal" event={"ID":"8b1d74e42ceb43a9b530a01d1402eeb7","Type":"ContainerStarted","Data":"e2a4095230d18756e025fd30d0993397d13f8e7cca8d917b9e9fafb37a00a9e6"}
Jul 06 19:27:37.384248 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:37.384190    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal" podStartSLOduration=21.384173322 podStartE2EDuration="21.384173322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:37.383712289 +0000 UTC m=+22.611705319" watchObservedRunningTime="2026-07-06 19:27:37.384173322 +0000 UTC m=+22.612166325"
Jul 06 19:27:37.813345 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:37.813312    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:27:38.274601 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:38.274450    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:27:37.813335649Z","UUID":"6324d9ee-63f9-40b1-adf6-94f8b1a2a71e","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:27:38.275980 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:38.275961    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:27:38.276098 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:38.275989    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:27:38.376891 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:38.376857    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls" event={"ID":"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795","Type":"ContainerStarted","Data":"e03d9710b4c1e4bd8c4d27281c6a5ed9005964ef297dfb2a71787d3cbb9cb6fa"}
Jul 06 19:27:38.377457 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:38.377000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls" event={"ID":"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795","Type":"ContainerStarted","Data":"76c6008dc2d042e46310ab7c2324fb5470435b4642fd386526fc73fcacb95683"}
Jul 06 19:27:38.377457 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:38.377048    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls" event={"ID":"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795","Type":"ContainerStarted","Data":"781d1709b94d84a8d3967ecb677ffb6b1babd1cdf8efc984e9160605b8f7e38c"}
Jul 06 19:27:38.377457 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:38.377098    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls" event={"ID":"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795","Type":"ContainerStarted","Data":"52fbeda6865aa442baf8bab7dee05cf93c229301759c9c48386f40e06b0f5bc3"}
Jul 06 19:27:38.377457 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:38.377142    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls" event={"ID":"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795","Type":"ContainerStarted","Data":"9388a05dcdedeeab813ca57dbb35a0449e19882f1c0fb881fbd4ead7c9e338a9"}
Jul 06 19:27:38.377457 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:38.377189    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls" event={"ID":"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795","Type":"ContainerStarted","Data":"7f17191576034b33061f6439ea603e99bd97994af301d1107eda862e697a0eaa"}
Jul 06 19:27:38.378745 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:38.378721    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wmttv" event={"ID":"5d42ace3-1b66-428a-818f-7824bdba8f06","Type":"ContainerStarted","Data":"0ae61a60a9442c7aa9fea3235175bf81e451a3c881255667c401aab538c0215f"}
Jul 06 19:27:38.380794 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:38.380771    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8" event={"ID":"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f","Type":"ContainerStarted","Data":"2623bd79be22e19be1c1c2400cb6779cb868343e223d6411ee90740a140c4010"}
Jul 06 19:27:38.398565 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:38.398524    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wmttv" podStartSLOduration=3.408072989 podStartE2EDuration="23.398511829s" totalImagesPullingTime="19.99043884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:38.398229324 +0000 UTC m=+23.626222327" watchObservedRunningTime="2026-07-06 19:27:38.398511829 +0000 UTC m=+23.626504828"
Jul 06 19:27:39.278936 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:39.278886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:39.278936 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:39.278913    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:39.279298 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:39.278886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:39.279298 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:39.279021    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:39.279298 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:39.279074    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:39.279298 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:39.279152    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:40.389840 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:40.389798    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls" event={"ID":"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795","Type":"ContainerStarted","Data":"9960f950840826adac5f45526a78e4cd5f5f3cc9021d66d5451903a42f98989a"}
Jul 06 19:27:40.391865 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:40.391829    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8" event={"ID":"2d052fcb-1de4-45cd-adb2-a96bc7e52d7f","Type":"ContainerStarted","Data":"8c2afc6a4e275af7da4052f244a870054cc3b5be91b25c4d58ba9e07118f1ed7"}
Jul 06 19:27:40.418770 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:40.418725    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqll8" podStartSLOduration=5.030686277 podStartE2EDuration="25.418710163s" totalImagesPullingTime="20.388023886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:40.418649281 +0000 UTC m=+25.646642283" watchObservedRunningTime="2026-07-06 19:27:40.418710163 +0000 UTC m=+25.646703167"
Jul 06 19:27:41.279325 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:41.279290    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:41.279521 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:41.279340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:41.279521 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:41.279290    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:41.279521 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:41.279429    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:41.279670 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:41.279536    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:41.279670 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:41.279611    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:43.278523 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:43.278490    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:43.278523 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:43.278526    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:43.279062 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:43.278490    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:43.279062 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:43.278610    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:43.279062 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:43.278721    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:43.279062 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:43.278812    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:44.401636 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:44.401461    2576 generic.go:356] "Generic (PLEG): container finished" podID="750b8e20-d2eb-41b0-a423-affe1f95b71b" containerID="04a16bd1f47a5867ec63fe1ee3d881c638080608f73ae1bde70e8e233dbbb64d" exitCode=0
Jul 06 19:27:44.402159 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:44.401539    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjcg5" event={"ID":"750b8e20-d2eb-41b0-a423-affe1f95b71b","Type":"ContainerDied","Data":"04a16bd1f47a5867ec63fe1ee3d881c638080608f73ae1bde70e8e233dbbb64d"}
Jul 06 19:27:44.405255 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:44.405226    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls" event={"ID":"1ceb5ab4-495f-4a5d-b9ce-d0b4579ef795","Type":"ContainerStarted","Data":"abce36d68dc05028b27d2bdf59fde0084c533efd01d5a616f0212d021ce59392"}
Jul 06 19:27:44.405529 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:44.405513    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:44.405608 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:44.405557    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:44.420910 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:44.420889    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:44.458621 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:44.458593    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pckcb"
Jul 06 19:27:44.458810 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:44.458715    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 19:27:44.459133 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:44.459109    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pckcb"
Jul 06 19:27:44.557635 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:44.557583    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls" podStartSLOduration=9.60996991 podStartE2EDuration="29.55756354s" totalImagesPullingTime="19.94759363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:44.521351528 +0000 UTC m=+29.749344531" watchObservedRunningTime="2026-07-06 19:27:44.55756354 +0000 UTC m=+29.785556543"
Jul 06 19:27:45.279069 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:45.279034    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:45.279213 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:45.279125    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:45.279266 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:45.279213    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:45.279311 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:45.279300    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:45.279350 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:45.279321    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:45.279385 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:45.279369    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:45.409818 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:45.409779    2576 generic.go:356] "Generic (PLEG): container finished" podID="750b8e20-d2eb-41b0-a423-affe1f95b71b" containerID="452ca1f32b63139b8015c5fd53faf3c4cb4cf3cdad17e3eb34e0ac5f79a145c6" exitCode=0
Jul 06 19:27:45.410220 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:45.409850    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjcg5" event={"ID":"750b8e20-d2eb-41b0-a423-affe1f95b71b","Type":"ContainerDied","Data":"452ca1f32b63139b8015c5fd53faf3c4cb4cf3cdad17e3eb34e0ac5f79a145c6"}
Jul 06 19:27:45.410689 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:45.410586    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:45.426009 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:45.425986    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:27:46.367183 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:46.367016    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mldf8"]
Jul 06 19:27:46.367351 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:46.367265    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:46.367395 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:46.367344    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:46.372346 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:46.372321    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hfsmd"]
Jul 06 19:27:46.372460 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:46.372434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:46.372556 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:46.372538    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:46.377657 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:46.377635    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9flkj"]
Jul 06 19:27:46.377760 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:46.377721    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:46.377814 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:46.377796    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:46.414643 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:46.414610    2576 generic.go:356] "Generic (PLEG): container finished" podID="750b8e20-d2eb-41b0-a423-affe1f95b71b" containerID="429efe7a10f77e148e0f72631771b6cee25c6c04dcc1a31a085e5f761eef7e0c" exitCode=0
Jul 06 19:27:46.415109 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:46.414680    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjcg5" event={"ID":"750b8e20-d2eb-41b0-a423-affe1f95b71b","Type":"ContainerDied","Data":"429efe7a10f77e148e0f72631771b6cee25c6c04dcc1a31a085e5f761eef7e0c"}
Jul 06 19:27:48.278996 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:48.278962    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:48.279532 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:48.278998    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:48.279532 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:48.279095    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:48.279532 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:48.279159    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:48.279532 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:48.279194    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:48.279532 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:48.279262    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:48.932415 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:48.932376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:48.932577 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:48.932456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs\") pod \"network-metrics-daemon-9flkj\" (UID: \"dc38d204-c217-4aa1-8dab-cbfd88600f21\") " pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:48.932577 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:48.932525    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:48.932577 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:48.932560    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:48.932709 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:48.932599    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret podName:89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:20.932580571 +0000 UTC m=+66.160573574 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret") pod "global-pull-secret-syncer-hfsmd" (UID: "89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:27:48.932709 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:48.932613    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs podName:dc38d204-c217-4aa1-8dab-cbfd88600f21 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:20.932607144 +0000 UTC m=+66.160600124 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs") pod "network-metrics-daemon-9flkj" (UID: "dc38d204-c217-4aa1-8dab-cbfd88600f21") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:27:49.133506 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:49.133477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6kt\" (UniqueName: \"kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt\") pod \"network-check-target-mldf8\" (UID: \"bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4\") " pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:49.133671 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:49.133615    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:27:49.133671 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:49.133630    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:27:49.133671 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:49.133639    2576 projected.go:196] Error preparing data for projected volume kube-api-access-kw6kt for pod openshift-network-diagnostics/network-check-target-mldf8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:49.133778 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:49.133686    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt podName:bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:21.133674384 +0000 UTC m=+66.361667365 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kw6kt" (UniqueName: "kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt") pod "network-check-target-mldf8" (UID: "bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:27:50.278489 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:50.278451    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:50.279129 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:50.278451    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:50.279129 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:50.278563    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mldf8" podUID="bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4"
Jul 06 19:27:50.279129 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:50.278664    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hfsmd" podUID="89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4"
Jul 06 19:27:50.279129 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:50.278463    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:50.279129 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:50.278785    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9flkj" podUID="dc38d204-c217-4aa1-8dab-cbfd88600f21"
Jul 06 19:27:51.049370 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.049339    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeReady"
Jul 06 19:27:51.049558 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.049507    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:27:51.127805 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.127722    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"]
Jul 06 19:27:51.144810 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.144625    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"]
Jul 06 19:27:51.144810 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.144730    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"
Jul 06 19:27:51.155770 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.155744    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:27:51.156346 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.156283    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jlcjp\""
Jul 06 19:27:51.158179 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.158143    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 19:27:51.158319 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.158296    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 19:27:51.159370 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.159352    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 19:27:51.160802 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.160785    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b584bc769-82ncm"]
Jul 06 19:27:51.160966 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.160903    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"
Jul 06 19:27:51.165982 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.165962    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:27:51.166470 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.166438    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nzcgr\""
Jul 06 19:27:51.166739 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.166721    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 19:27:51.168542 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.168518    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 19:27:51.168791 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.168768    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 19:27:51.198826 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.198796    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"]
Jul 06 19:27:51.199004 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.198966    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.211573 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.211551    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 19:27:51.216873 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.216741    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 19:27:51.217325 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.217277    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-pwrxd"]
Jul 06 19:27:51.217662 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.217633    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:27:51.223063 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.223039    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:27:51.223063 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.223076    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:27:51.223410 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.223393    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pwxwb\""
Jul 06 19:27:51.223894 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.223706    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 19:27:51.224625 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.224540    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 06 19:27:51.225081 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.225057    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wrxff\""
Jul 06 19:27:51.228282 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.228262    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 19:27:51.228500 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.228483    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 06 19:27:51.231351 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.231328    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xnpm4"]
Jul 06 19:27:51.231482 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.231453    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.243490 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.243467    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"]
Jul 06 19:27:51.243655 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.243578    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xnpm4"
Jul 06 19:27:51.249414 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.249390    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmh58\" (UniqueName: \"kubernetes.io/projected/445c63a3-5129-4382-ac75-a61c3dc3b4cc-kube-api-access-bmh58\") pod \"kube-storage-version-migrator-operator-846bf668f7-gz9d4\" (UID: \"445c63a3-5129-4382-ac75-a61c3dc3b4cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"
Jul 06 19:27:51.249541 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.249427    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxr7h\" (UniqueName: \"kubernetes.io/projected/9da2aea4-73da-4cb7-81e8-a46fe714cac0-kube-api-access-sxr7h\") pod \"service-ca-operator-5d46d9ffd4-cr9kq\" (UID: \"9da2aea4-73da-4cb7-81e8-a46fe714cac0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"
Jul 06 19:27:51.249541 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.249473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9da2aea4-73da-4cb7-81e8-a46fe714cac0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-cr9kq\" (UID: \"9da2aea4-73da-4cb7-81e8-a46fe714cac0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"
Jul 06 19:27:51.249541 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.249492    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9da2aea4-73da-4cb7-81e8-a46fe714cac0-config\") pod \"service-ca-operator-5d46d9ffd4-cr9kq\" (UID: \"9da2aea4-73da-4cb7-81e8-a46fe714cac0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"
Jul 06 19:27:51.249679 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.249586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/445c63a3-5129-4382-ac75-a61c3dc3b4cc-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-gz9d4\" (UID: \"445c63a3-5129-4382-ac75-a61c3dc3b4cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"
Jul 06 19:27:51.249727 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.249692    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/445c63a3-5129-4382-ac75-a61c3dc3b4cc-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-gz9d4\" (UID: \"445c63a3-5129-4382-ac75-a61c3dc3b4cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"
Jul 06 19:27:51.255818 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.255794    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-nfqb8"]
Jul 06 19:27:51.256083 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.256063    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:27:51.267845 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.267827    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5f94c4c7c-nxhtn"]
Jul 06 19:27:51.267955 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.267940    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.284618 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.284557    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-vdf4t"]
Jul 06 19:27:51.285740 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.284699    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.296199 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.296176    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-pwrxd"]
Jul 06 19:27:51.296323 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.296286    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vdf4t"
Jul 06 19:27:51.301037 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.301020    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"]
Jul 06 19:27:51.301173 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.301155    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xnpm4"]
Jul 06 19:27:51.301241 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.301193    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qz89z"]
Jul 06 19:27:51.314305 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.314283    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"]
Jul 06 19:27:51.314419 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.314326    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kkz26"]
Jul 06 19:27:51.314485 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.314414    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:51.324377 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.324346    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b584bc769-82ncm"]
Jul 06 19:27:51.324502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.324445    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-nfqb8"]
Jul 06 19:27:51.324502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.324466    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kkz26"
Jul 06 19:27:51.324502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.324480    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"]
Jul 06 19:27:51.340472 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.340445    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:27:51.340472 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.340459    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:27:51.342190 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.342175    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 06 19:27:51.344220 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.344204    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 19:27:51.344220 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.344212    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 19:27:51.344389 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.344235    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:27:51.345246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.345221    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qz89z"]
Jul 06 19:27:51.347615 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.347598    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:27:51.347615 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.347604    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 06 19:27:51.347864 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.347846    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qfzth\""
Jul 06 19:27:51.348139 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.348123    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 06 19:27:51.348231 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.348179    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 06 19:27:51.348289 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.348274    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 06 19:27:51.349525 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.349507    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 19:27:51.350631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpzlg\" (UniqueName: \"kubernetes.io/projected/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-kube-api-access-cpzlg\") pod \"cluster-samples-operator-56fcf86bf-54mqp\" (UID: \"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:27:51.350631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/445c63a3-5129-4382-ac75-a61c3dc3b4cc-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-gz9d4\" (UID: \"445c63a3-5129-4382-ac75-a61c3dc3b4cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"
Jul 06 19:27:51.350631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-54mqp\" (UID: \"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:27:51.350631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.350631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350255    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-bound-sa-token\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.350631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmh58\" (UniqueName: \"kubernetes.io/projected/445c63a3-5129-4382-ac75-a61c3dc3b4cc-kube-api-access-bmh58\") pod \"kube-storage-version-migrator-operator-846bf668f7-gz9d4\" (UID: \"445c63a3-5129-4382-ac75-a61c3dc3b4cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"
Jul 06 19:27:51.350631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/deefe594-347c-4702-8972-55330d020baf-registry-certificates\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.350631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pjmf\" (UniqueName: \"kubernetes.io/projected/4ed2f491-2bc3-489a-9df8-bf57ac730b1f-kube-api-access-8pjmf\") pod \"console-operator-68b757fb67-nfqb8\" (UID: \"4ed2f491-2bc3-489a-9df8-bf57ac730b1f\") " pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.350631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9da2aea4-73da-4cb7-81e8-a46fe714cac0-config\") pod \"service-ca-operator-5d46d9ffd4-cr9kq\" (UID: \"9da2aea4-73da-4cb7-81e8-a46fe714cac0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"
Jul 06 19:27:51.350631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350397    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/deefe594-347c-4702-8972-55330d020baf-ca-trust-extracted\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.350631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350421    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/deefe594-347c-4702-8972-55330d020baf-trusted-ca\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.350631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsx7m\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-kube-api-access-hsx7m\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.351235 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350462    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ed2f491-2bc3-489a-9df8-bf57ac730b1f-trusted-ca\") pod \"console-operator-68b757fb67-nfqb8\" (UID: \"4ed2f491-2bc3-489a-9df8-bf57ac730b1f\") " pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.351235 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/deefe594-347c-4702-8972-55330d020baf-image-registry-private-configuration\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.351235 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6clxl\" (UniqueName: \"kubernetes.io/projected/20d07fcc-a2c4-4f44-944b-3778ea6af854-kube-api-access-6clxl\") pod \"volume-data-source-validator-5d456fdbcd-xnpm4\" (UID: \"20d07fcc-a2c4-4f44-944b-3778ea6af854\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xnpm4"
Jul 06 19:27:51.351235 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ed2f491-2bc3-489a-9df8-bf57ac730b1f-config\") pod \"console-operator-68b757fb67-nfqb8\" (UID: \"4ed2f491-2bc3-489a-9df8-bf57ac730b1f\") " pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.351235 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-serving-cert\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.351235 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350617    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.351235 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cwng\" (UniqueName: \"kubernetes.io/projected/670e9b5a-7d3d-494a-948e-a2de70b5a967-kube-api-access-7cwng\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:27:51.351235 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.351235 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxr7h\" (UniqueName: \"kubernetes.io/projected/9da2aea4-73da-4cb7-81e8-a46fe714cac0-kube-api-access-sxr7h\") pod \"service-ca-operator-5d46d9ffd4-cr9kq\" (UID: \"9da2aea4-73da-4cb7-81e8-a46fe714cac0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"
Jul 06 19:27:51.351235 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350800    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/445c63a3-5129-4382-ac75-a61c3dc3b4cc-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-gz9d4\" (UID: \"445c63a3-5129-4382-ac75-a61c3dc3b4cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"
Jul 06 19:27:51.351235 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-tmp\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.351235 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.350968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-snapshots\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.351734 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.351014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9da2aea4-73da-4cb7-81e8-a46fe714cac0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-cr9kq\" (UID: \"9da2aea4-73da-4cb7-81e8-a46fe714cac0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"
Jul 06 19:27:51.351734 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.351047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/445c63a3-5129-4382-ac75-a61c3dc3b4cc-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-gz9d4\" (UID: \"445c63a3-5129-4382-ac75-a61c3dc3b4cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"
Jul 06 19:27:51.351734 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.351075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:27:51.351734 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.351082    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9da2aea4-73da-4cb7-81e8-a46fe714cac0-config\") pod \"service-ca-operator-5d46d9ffd4-cr9kq\" (UID: \"9da2aea4-73da-4cb7-81e8-a46fe714cac0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"
Jul 06 19:27:51.351734 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.351122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/670e9b5a-7d3d-494a-948e-a2de70b5a967-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:27:51.351734 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.351463    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdbxb\" (UniqueName: \"kubernetes.io/projected/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-kube-api-access-gdbxb\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.351734 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.351493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ed2f491-2bc3-489a-9df8-bf57ac730b1f-serving-cert\") pod \"console-operator-68b757fb67-nfqb8\" (UID: \"4ed2f491-2bc3-489a-9df8-bf57ac730b1f\") " pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.351734 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.351522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/deefe594-347c-4702-8972-55330d020baf-installation-pull-secrets\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.354316 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.354284    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"]
Jul 06 19:27:51.355416 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.355337    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f94c4c7c-nxhtn"]
Jul 06 19:27:51.356198 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.356030    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/445c63a3-5129-4382-ac75-a61c3dc3b4cc-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-gz9d4\" (UID: \"445c63a3-5129-4382-ac75-a61c3dc3b4cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"
Jul 06 19:27:51.356295 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.356095    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-vdf4t"]
Jul 06 19:27:51.356457 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.356442    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 19:27:51.356524 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.356488    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9da2aea4-73da-4cb7-81e8-a46fe714cac0-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-cr9kq\" (UID: \"9da2aea4-73da-4cb7-81e8-a46fe714cac0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"
Jul 06 19:27:51.357561 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.357540    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kkz26"]
Jul 06 19:27:51.369631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.369606    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-54x6j\""
Jul 06 19:27:51.369780 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.369735    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7f2bc\""
Jul 06 19:27:51.369780 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.369751    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:27:51.369898 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.369735    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mcn59\""
Jul 06 19:27:51.369898 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.369807    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kvhhx\""
Jul 06 19:27:51.369898 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.369858    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:27:51.387294 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.387223    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 19:27:51.388359 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.388339    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:27:51.390659 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.390637    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8w5t5\""
Jul 06 19:27:51.390800 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.390778    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6kw96\""
Jul 06 19:27:51.390912 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.390860    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:27:51.391317 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.391174    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:27:51.391317 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.391220    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:27:51.391317 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.391229    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 19:27:51.391317 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.391183    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:27:51.391562 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.391359    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 19:27:51.391562 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.391235    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qg2nr\""
Jul 06 19:27:51.391562 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.391361    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:27:51.391562 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.391454    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 06 19:27:51.391740 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.391661    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:27:51.391740 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.391685    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:27:51.426712 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.426687    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 19:27:51.433130 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.433105    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmh58\" (UniqueName: \"kubernetes.io/projected/445c63a3-5129-4382-ac75-a61c3dc3b4cc-kube-api-access-bmh58\") pod \"kube-storage-version-migrator-operator-846bf668f7-gz9d4\" (UID: \"445c63a3-5129-4382-ac75-a61c3dc3b4cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"
Jul 06 19:27:51.433262 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.433130    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxr7h\" (UniqueName: \"kubernetes.io/projected/9da2aea4-73da-4cb7-81e8-a46fe714cac0-kube-api-access-sxr7h\") pod \"service-ca-operator-5d46d9ffd4-cr9kq\" (UID: \"9da2aea4-73da-4cb7-81e8-a46fe714cac0\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"
Jul 06 19:27:51.452890 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.452862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.453088 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.452899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-bound-sa-token\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.453088 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.452944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.453088 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453068    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/deefe594-347c-4702-8972-55330d020baf-registry-certificates\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.453254 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pjmf\" (UniqueName: \"kubernetes.io/projected/4ed2f491-2bc3-489a-9df8-bf57ac730b1f-kube-api-access-8pjmf\") pod \"console-operator-68b757fb67-nfqb8\" (UID: \"4ed2f491-2bc3-489a-9df8-bf57ac730b1f\") " pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.453254 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.453254 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453156    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/deefe594-347c-4702-8972-55330d020baf-ca-trust-extracted\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.453254 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/deefe594-347c-4702-8972-55330d020baf-trusted-ca\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.453254 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsx7m\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-kube-api-access-hsx7m\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.453254 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ed2f491-2bc3-489a-9df8-bf57ac730b1f-trusted-ca\") pod \"console-operator-68b757fb67-nfqb8\" (UID: \"4ed2f491-2bc3-489a-9df8-bf57ac730b1f\") " pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.453531 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:51.453531 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7hpn\" (UniqueName: \"kubernetes.io/projected/8f1d07bb-becf-4294-ad8d-cfe48d58a638-kube-api-access-c7hpn\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.453531 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453349    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/deefe594-347c-4702-8972-55330d020baf-image-registry-private-configuration\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.453531 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clxl\" (UniqueName: \"kubernetes.io/projected/20d07fcc-a2c4-4f44-944b-3778ea6af854-kube-api-access-6clxl\") pod \"volume-data-source-validator-5d456fdbcd-xnpm4\" (UID: \"20d07fcc-a2c4-4f44-944b-3778ea6af854\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xnpm4"
Jul 06 19:27:51.453531 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d5301c7-fc16-4431-904d-a329e3d6c343-config-volume\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:51.453531 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ed2f491-2bc3-489a-9df8-bf57ac730b1f-config\") pod \"console-operator-68b757fb67-nfqb8\" (UID: \"4ed2f491-2bc3-489a-9df8-bf57ac730b1f\") " pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.453531 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-serving-cert\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.453832 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35adfd2e-17ac-4125-806e-f08293363c35-cert\") pod \"ingress-canary-kkz26\" (UID: \"35adfd2e-17ac-4125-806e-f08293363c35\") " pod="openshift-ingress-canary/ingress-canary-kkz26"
Jul 06 19:27:51.453832 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnc52\" (UniqueName: \"kubernetes.io/projected/35adfd2e-17ac-4125-806e-f08293363c35-kube-api-access-lnc52\") pod \"ingress-canary-kkz26\" (UID: \"35adfd2e-17ac-4125-806e-f08293363c35\") " pod="openshift-ingress-canary/ingress-canary-kkz26"
Jul 06 19:27:51.453832 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453571    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.453832 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.453832 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453615    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cwng\" (UniqueName: \"kubernetes.io/projected/670e9b5a-7d3d-494a-948e-a2de70b5a967-kube-api-access-7cwng\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:27:51.453832 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453624    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/deefe594-347c-4702-8972-55330d020baf-ca-trust-extracted\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.453832 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453640    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.453832 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453685    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-tmp\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.453832 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453710    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/deefe594-347c-4702-8972-55330d020baf-registry-certificates\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.453832 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.453719    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:27:51.453832 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.453733    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b584bc769-82ncm: secret "image-registry-tls" not found
Jul 06 19:27:51.453832 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.453812    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls podName:deefe594-347c-4702-8972-55330d020baf nodeName:}" failed. No retries permitted until 2026-07-06 19:27:51.953794346 +0000 UTC m=+37.181787329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls") pod "image-registry-5b584bc769-82ncm" (UID: "deefe594-347c-4702-8972-55330d020baf") : secret "image-registry-tls" not found
Jul 06 19:27:51.454431 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.454008    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-tmp\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.454431 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.454353    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/deefe594-347c-4702-8972-55330d020baf-trusted-ca\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.454431 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.454366    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-snapshots\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.454431 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.454353    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ed2f491-2bc3-489a-9df8-bf57ac730b1f-trusted-ca\") pod \"console-operator-68b757fb67-nfqb8\" (UID: \"4ed2f491-2bc3-489a-9df8-bf57ac730b1f\") " pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.454431 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.453718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-snapshots\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.454657 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.454576    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ed2f491-2bc3-489a-9df8-bf57ac730b1f-config\") pod \"console-operator-68b757fb67-nfqb8\" (UID: \"4ed2f491-2bc3-489a-9df8-bf57ac730b1f\") " pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.455025 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.454735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:27:51.455025 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.454771    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/670e9b5a-7d3d-494a-948e-a2de70b5a967-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:27:51.455025 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.454798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-default-certificate\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.455025 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.454826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdbxb\" (UniqueName: \"kubernetes.io/projected/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-kube-api-access-gdbxb\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.455025 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.454853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ed2f491-2bc3-489a-9df8-bf57ac730b1f-serving-cert\") pod \"console-operator-68b757fb67-nfqb8\" (UID: \"4ed2f491-2bc3-489a-9df8-bf57ac730b1f\") " pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.455025 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.454882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2tg6\" (UniqueName: \"kubernetes.io/projected/6c7dc01b-dcf1-45fe-a817-78be627cff2e-kube-api-access-j2tg6\") pod \"network-check-source-989f8b8dc-vdf4t\" (UID: \"6c7dc01b-dcf1-45fe-a817-78be627cff2e\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vdf4t"
Jul 06 19:27:51.455025 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.454912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d5301c7-fc16-4431-904d-a329e3d6c343-tmp-dir\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:51.458324 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.454960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbzpz\" (UniqueName: \"kubernetes.io/projected/8d5301c7-fc16-4431-904d-a329e3d6c343-kube-api-access-mbzpz\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:51.458324 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.455898    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.458324 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.456191    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:51.458324 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.457805    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/deefe594-347c-4702-8972-55330d020baf-image-registry-private-configuration\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.458324 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.458038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/deefe594-347c-4702-8972-55330d020baf-installation-pull-secrets\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.458706 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.458606    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls podName:670e9b5a-7d3d-494a-948e-a2de70b5a967 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:51.958584971 +0000 UTC m=+37.186577966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vsrv2" (UID: "670e9b5a-7d3d-494a-948e-a2de70b5a967") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:51.458706 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.458580    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/670e9b5a-7d3d-494a-948e-a2de70b5a967-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:27:51.461316 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.458858    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"
Jul 06 19:27:51.461316 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.459016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpzlg\" (UniqueName: \"kubernetes.io/projected/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-kube-api-access-cpzlg\") pod \"cluster-samples-operator-56fcf86bf-54mqp\" (UID: \"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:27:51.461316 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.459056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-54mqp\" (UID: \"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:27:51.461316 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.459084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-stats-auth\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.461316 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.459455    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:27:51.461316 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.459508    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls podName:b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:51.959491089 +0000 UTC m=+37.187484083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-54mqp" (UID: "b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a") : secret "samples-operator-tls" not found
Jul 06 19:27:51.461316 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.460508    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ed2f491-2bc3-489a-9df8-bf57ac730b1f-serving-cert\") pod \"console-operator-68b757fb67-nfqb8\" (UID: \"4ed2f491-2bc3-489a-9df8-bf57ac730b1f\") " pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.461316 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.461111    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/deefe594-347c-4702-8972-55330d020baf-installation-pull-secrets\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.464413 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.464390    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-serving-cert\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.471494 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.471473    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"
Jul 06 19:27:51.481704 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.481679    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pjmf\" (UniqueName: \"kubernetes.io/projected/4ed2f491-2bc3-489a-9df8-bf57ac730b1f-kube-api-access-8pjmf\") pod \"console-operator-68b757fb67-nfqb8\" (UID: \"4ed2f491-2bc3-489a-9df8-bf57ac730b1f\") " pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.499145 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.499113    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6clxl\" (UniqueName: \"kubernetes.io/projected/20d07fcc-a2c4-4f44-944b-3778ea6af854-kube-api-access-6clxl\") pod \"volume-data-source-validator-5d456fdbcd-xnpm4\" (UID: \"20d07fcc-a2c4-4f44-944b-3778ea6af854\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xnpm4"
Jul 06 19:27:51.502250 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.502227    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdbxb\" (UniqueName: \"kubernetes.io/projected/bae2d09b-44d8-4ac6-bccf-e5b54a130b9d-kube-api-access-gdbxb\") pod \"insights-operator-5c847dcfc4-pwrxd\" (UID: \"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.505808 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.505779    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cwng\" (UniqueName: \"kubernetes.io/projected/670e9b5a-7d3d-494a-948e-a2de70b5a967-kube-api-access-7cwng\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:27:51.513929 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.513903    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsx7m\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-kube-api-access-hsx7m\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.516751 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.516729    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpzlg\" (UniqueName: \"kubernetes.io/projected/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-kube-api-access-cpzlg\") pod \"cluster-samples-operator-56fcf86bf-54mqp\" (UID: \"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:27:51.540176 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.540149    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-bound-sa-token\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.541025 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.541003    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd"
Jul 06 19:27:51.553942 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.553907    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xnpm4"
Jul 06 19:27:51.559448 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.559424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35adfd2e-17ac-4125-806e-f08293363c35-cert\") pod \"ingress-canary-kkz26\" (UID: \"35adfd2e-17ac-4125-806e-f08293363c35\") " pod="openshift-ingress-canary/ingress-canary-kkz26"
Jul 06 19:27:51.559560 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.559457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnc52\" (UniqueName: \"kubernetes.io/projected/35adfd2e-17ac-4125-806e-f08293363c35-kube-api-access-lnc52\") pod \"ingress-canary-kkz26\" (UID: \"35adfd2e-17ac-4125-806e-f08293363c35\") " pod="openshift-ingress-canary/ingress-canary-kkz26"
Jul 06 19:27:51.559635 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.559606    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-default-certificate\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.559689 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.559643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2tg6\" (UniqueName: \"kubernetes.io/projected/6c7dc01b-dcf1-45fe-a817-78be627cff2e-kube-api-access-j2tg6\") pod \"network-check-source-989f8b8dc-vdf4t\" (UID: \"6c7dc01b-dcf1-45fe-a817-78be627cff2e\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vdf4t"
Jul 06 19:27:51.559689 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.559671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d5301c7-fc16-4431-904d-a329e3d6c343-tmp-dir\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:51.559782 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.559697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbzpz\" (UniqueName: \"kubernetes.io/projected/8d5301c7-fc16-4431-904d-a329e3d6c343-kube-api-access-mbzpz\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:51.559782 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.559759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-stats-auth\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.559889 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.559794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.559889 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.559828    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.559889 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.559863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:51.560048 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.559894    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7hpn\" (UniqueName: \"kubernetes.io/projected/8f1d07bb-becf-4294-ad8d-cfe48d58a638-kube-api-access-c7hpn\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.560204 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.560174    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d5301c7-fc16-4431-904d-a329e3d6c343-config-volume\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:51.560326 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.560222    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d5301c7-fc16-4431-904d-a329e3d6c343-tmp-dir\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:51.560326 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.560259    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:27:51.560326 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.560271    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:27:51.560326 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.560322    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls podName:8d5301c7-fc16-4431-904d-a329e3d6c343 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:52.060300151 +0000 UTC m=+37.288293168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls") pod "dns-default-qz89z" (UID: "8d5301c7-fc16-4431-904d-a329e3d6c343") : secret "dns-default-metrics-tls" not found
Jul 06 19:27:51.560522 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.560338    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs podName:8f1d07bb-becf-4294-ad8d-cfe48d58a638 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:52.060329633 +0000 UTC m=+37.288322617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs") pod "router-default-5f94c4c7c-nxhtn" (UID: "8f1d07bb-becf-4294-ad8d-cfe48d58a638") : secret "router-metrics-certs-default" not found
Jul 06 19:27:51.560522 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.560365    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle podName:8f1d07bb-becf-4294-ad8d-cfe48d58a638 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:52.060353971 +0000 UTC m=+37.288346964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle") pod "router-default-5f94c4c7c-nxhtn" (UID: "8f1d07bb-becf-4294-ad8d-cfe48d58a638") : configmap references non-existent config key: service-ca.crt
Jul 06 19:27:51.560889 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.560841    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d5301c7-fc16-4431-904d-a329e3d6c343-config-volume\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:51.562439 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.562413    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35adfd2e-17ac-4125-806e-f08293363c35-cert\") pod \"ingress-canary-kkz26\" (UID: \"35adfd2e-17ac-4125-806e-f08293363c35\") " pod="openshift-ingress-canary/ingress-canary-kkz26"
Jul 06 19:27:51.562742 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.562720    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-stats-auth\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.562826 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.562779    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-default-certificate\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.576489 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.576456    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2tg6\" (UniqueName: \"kubernetes.io/projected/6c7dc01b-dcf1-45fe-a817-78be627cff2e-kube-api-access-j2tg6\") pod \"network-check-source-989f8b8dc-vdf4t\" (UID: \"6c7dc01b-dcf1-45fe-a817-78be627cff2e\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vdf4t"
Jul 06 19:27:51.577392 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.577370    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnc52\" (UniqueName: \"kubernetes.io/projected/35adfd2e-17ac-4125-806e-f08293363c35-kube-api-access-lnc52\") pod \"ingress-canary-kkz26\" (UID: \"35adfd2e-17ac-4125-806e-f08293363c35\") " pod="openshift-ingress-canary/ingress-canary-kkz26"
Jul 06 19:27:51.580693 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.580668    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7hpn\" (UniqueName: \"kubernetes.io/projected/8f1d07bb-becf-4294-ad8d-cfe48d58a638-kube-api-access-c7hpn\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:51.581504 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.581486    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:27:51.582255 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.582236    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbzpz\" (UniqueName: \"kubernetes.io/projected/8d5301c7-fc16-4431-904d-a329e3d6c343-kube-api-access-mbzpz\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:51.606043 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.606012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vdf4t"
Jul 06 19:27:51.635530 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.635497    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kkz26"
Jul 06 19:27:51.963840 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.963808    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:51.964061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.963874    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:27:51.964061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:51.963952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-54mqp\" (UID: \"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:27:51.964061 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.964001    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:27:51.964061 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.964024    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b584bc769-82ncm: secret "image-registry-tls" not found
Jul 06 19:27:51.964061 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.964032    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:51.964273 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.964076    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls podName:deefe594-347c-4702-8972-55330d020baf nodeName:}" failed. No retries permitted until 2026-07-06 19:27:52.964061796 +0000 UTC m=+38.192054778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls") pod "image-registry-5b584bc769-82ncm" (UID: "deefe594-347c-4702-8972-55330d020baf") : secret "image-registry-tls" not found
Jul 06 19:27:51.964273 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.964083    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:27:51.964273 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.964094    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls podName:670e9b5a-7d3d-494a-948e-a2de70b5a967 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:52.964085444 +0000 UTC m=+38.192078425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vsrv2" (UID: "670e9b5a-7d3d-494a-948e-a2de70b5a967") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:51.964273 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:51.964125    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls podName:b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:52.96410866 +0000 UTC m=+38.192101645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-54mqp" (UID: "b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a") : secret "samples-operator-tls" not found
Jul 06 19:27:52.064490 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.064452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:52.064490 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.064489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:52.064754 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.064516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:52.064754 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:52.064641    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:27:52.064754 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:52.064677    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle podName:8f1d07bb-becf-4294-ad8d-cfe48d58a638 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:53.064656003 +0000 UTC m=+38.292648999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle") pod "router-default-5f94c4c7c-nxhtn" (UID: "8f1d07bb-becf-4294-ad8d-cfe48d58a638") : configmap references non-existent config key: service-ca.crt
Jul 06 19:27:52.064754 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:52.064721    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs podName:8f1d07bb-becf-4294-ad8d-cfe48d58a638 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:53.064709262 +0000 UTC m=+38.292702250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs") pod "router-default-5f94c4c7c-nxhtn" (UID: "8f1d07bb-becf-4294-ad8d-cfe48d58a638") : secret "router-metrics-certs-default" not found
Jul 06 19:27:52.064754 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:52.064649    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:27:52.064754 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:52.064756    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls podName:8d5301c7-fc16-4431-904d-a329e3d6c343 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:53.064747615 +0000 UTC m=+38.292740598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls") pod "dns-default-qz89z" (UID: "8d5301c7-fc16-4431-904d-a329e3d6c343") : secret "dns-default-metrics-tls" not found
Jul 06 19:27:52.279166 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.279090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:27:52.279166 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.279131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:27:52.279358 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.279212    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:27:52.282854 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.282827    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:27:52.283381 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.283360    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdwjn\""
Jul 06 19:27:52.283618 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.283593    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:27:52.283726 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.283704    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mjmjf\""
Jul 06 19:27:52.856758 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.856646    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4"]
Jul 06 19:27:52.860674 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:52.860644    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445c63a3_5129_4382_ac75_a61c3dc3b4cc.slice/crio-760174368f1d256629a328daa24937c49ac9c15701567af8091f85d7b3a6a8f2 WatchSource:0}: Error finding container 760174368f1d256629a328daa24937c49ac9c15701567af8091f85d7b3a6a8f2: Status 404 returned error can't find the container with id 760174368f1d256629a328daa24937c49ac9c15701567af8091f85d7b3a6a8f2
Jul 06 19:27:52.886747 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.886719    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-vdf4t"]
Jul 06 19:27:52.891903 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.891845    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq"]
Jul 06 19:27:52.895181 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.894897    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-nfqb8"]
Jul 06 19:27:52.896354 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.895648    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xnpm4"]
Jul 06 19:27:52.896849 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.896709    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kkz26"]
Jul 06 19:27:52.897701 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.897507    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-pwrxd"]
Jul 06 19:27:52.899201 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:52.899172    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae2d09b_44d8_4ac6_bccf_e5b54a130b9d.slice/crio-0f15c10861edcef0946668ea7ee2538e9c6753c559286525028140da31c27e06 WatchSource:0}: Error finding container 0f15c10861edcef0946668ea7ee2538e9c6753c559286525028140da31c27e06: Status 404 returned error can't find the container with id 0f15c10861edcef0946668ea7ee2538e9c6753c559286525028140da31c27e06
Jul 06 19:27:52.902815 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:27:52.902788    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d07fcc_a2c4_4f44_944b_3778ea6af854.slice/crio-a87584d2b5c90d7d1486265f3831850a3f8ff9f3d8033fc9ed78afd360943668 WatchSource:0}: Error finding container a87584d2b5c90d7d1486265f3831850a3f8ff9f3d8033fc9ed78afd360943668: Status 404 returned error can't find the container with id a87584d2b5c90d7d1486265f3831850a3f8ff9f3d8033fc9ed78afd360943668
Jul 06 19:27:52.974156 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.974126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:52.974297 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.974179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:27:52.974297 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:52.974218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-54mqp\" (UID: \"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:27:52.974297 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:52.974268    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:27:52.974297 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:52.974286    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b584bc769-82ncm: secret "image-registry-tls" not found
Jul 06 19:27:52.974441 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:52.974318    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:27:52.974441 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:52.974333    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls podName:deefe594-347c-4702-8972-55330d020baf nodeName:}" failed. No retries permitted until 2026-07-06 19:27:54.974318775 +0000 UTC m=+40.202311757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls") pod "image-registry-5b584bc769-82ncm" (UID: "deefe594-347c-4702-8972-55330d020baf") : secret "image-registry-tls" not found
Jul 06 19:27:52.974441 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:52.974362    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls podName:b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:54.974350332 +0000 UTC m=+40.202343313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-54mqp" (UID: "b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a") : secret "samples-operator-tls" not found
Jul 06 19:27:52.974441 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:52.974321    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:52.974441 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:52.974385    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls podName:670e9b5a-7d3d-494a-948e-a2de70b5a967 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:54.974379687 +0000 UTC m=+40.202372668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vsrv2" (UID: "670e9b5a-7d3d-494a-948e-a2de70b5a967") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:53.075250 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:53.075212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:53.075402 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:53.075268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:53.075402 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:53.075302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:53.075508 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:53.075409    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle podName:8f1d07bb-becf-4294-ad8d-cfe48d58a638 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:55.07538535 +0000 UTC m=+40.303378355 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle") pod "router-default-5f94c4c7c-nxhtn" (UID: "8f1d07bb-becf-4294-ad8d-cfe48d58a638") : configmap references non-existent config key: service-ca.crt
Jul 06 19:27:53.075508 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:53.075421    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:27:53.075508 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:53.075459    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:27:53.075508 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:53.075471    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs podName:8f1d07bb-becf-4294-ad8d-cfe48d58a638 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:55.075455783 +0000 UTC m=+40.303448763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs") pod "router-default-5f94c4c7c-nxhtn" (UID: "8f1d07bb-becf-4294-ad8d-cfe48d58a638") : secret "router-metrics-certs-default" not found
Jul 06 19:27:53.075508 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:53.075500    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls podName:8d5301c7-fc16-4431-904d-a329e3d6c343 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:55.07548745 +0000 UTC m=+40.303480449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls") pod "dns-default-qz89z" (UID: "8d5301c7-fc16-4431-904d-a329e3d6c343") : secret "dns-default-metrics-tls" not found
Jul 06 19:27:53.433507 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:53.433451    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vdf4t" event={"ID":"6c7dc01b-dcf1-45fe-a817-78be627cff2e","Type":"ContainerStarted","Data":"c76f02f8acf1c8bbca5ca419ac7fcec50752636cdcf7aaaf1ce0d32c54c9cd7c"}
Jul 06 19:27:53.437390 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:53.437356    2576 generic.go:356] "Generic (PLEG): container finished" podID="750b8e20-d2eb-41b0-a423-affe1f95b71b" containerID="b5ccb564a1fb6e2a5abe750de7c09d959efe350facac336925247d0d8ae75a8f" exitCode=0
Jul 06 19:27:53.437538 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:53.437445    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjcg5" event={"ID":"750b8e20-d2eb-41b0-a423-affe1f95b71b","Type":"ContainerDied","Data":"b5ccb564a1fb6e2a5abe750de7c09d959efe350facac336925247d0d8ae75a8f"}
Jul 06 19:27:53.439486 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:53.439454    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4" event={"ID":"445c63a3-5129-4382-ac75-a61c3dc3b4cc","Type":"ContainerStarted","Data":"760174368f1d256629a328daa24937c49ac9c15701567af8091f85d7b3a6a8f2"}
Jul 06 19:27:53.440985 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:53.440895    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq" event={"ID":"9da2aea4-73da-4cb7-81e8-a46fe714cac0","Type":"ContainerStarted","Data":"2f5d4b191fed356f3248ebaa3caecdd5b6d8ab37adcc872c9936d06781d053fe"}
Jul 06 19:27:53.442438 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:53.442401    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8" event={"ID":"4ed2f491-2bc3-489a-9df8-bf57ac730b1f","Type":"ContainerStarted","Data":"55c6f4c502453902c9779f24c6f69bc8db1d3b9eca60a91c6e4af61ba5cc349d"}
Jul 06 19:27:53.443851 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:53.443786    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xnpm4" event={"ID":"20d07fcc-a2c4-4f44-944b-3778ea6af854","Type":"ContainerStarted","Data":"a87584d2b5c90d7d1486265f3831850a3f8ff9f3d8033fc9ed78afd360943668"}
Jul 06 19:27:53.446244 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:53.446219    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd" event={"ID":"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d","Type":"ContainerStarted","Data":"0f15c10861edcef0946668ea7ee2538e9c6753c559286525028140da31c27e06"}
Jul 06 19:27:53.447626 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:53.447603    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kkz26" event={"ID":"35adfd2e-17ac-4125-806e-f08293363c35","Type":"ContainerStarted","Data":"43f467252a9b5316043752c2b49883a67f0f0c9cce20253e82b3f6eae2845fda"}
Jul 06 19:27:54.458966 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:54.457792    2576 generic.go:356] "Generic (PLEG): container finished" podID="750b8e20-d2eb-41b0-a423-affe1f95b71b" containerID="f01d9240b9f71464e12e16e220214faa7af50c485a41a87d3051ce32bc589f3d" exitCode=0
Jul 06 19:27:54.458966 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:54.458075    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjcg5" event={"ID":"750b8e20-d2eb-41b0-a423-affe1f95b71b","Type":"ContainerDied","Data":"f01d9240b9f71464e12e16e220214faa7af50c485a41a87d3051ce32bc589f3d"}
Jul 06 19:27:54.995823 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:54.994775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:54.995823 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:54.994854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:27:54.995823 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:54.994914    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-54mqp\" (UID: \"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:27:54.995823 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:54.995122    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:27:54.995823 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:54.995185    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls podName:b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a nodeName:}" failed. No retries permitted until 2026-07-06 19:27:58.995167058 +0000 UTC m=+44.223160041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-54mqp" (UID: "b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a") : secret "samples-operator-tls" not found
Jul 06 19:27:54.995823 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:54.995586    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:27:54.995823 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:54.995602    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b584bc769-82ncm: secret "image-registry-tls" not found
Jul 06 19:27:54.995823 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:54.995647    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls podName:deefe594-347c-4702-8972-55330d020baf nodeName:}" failed. No retries permitted until 2026-07-06 19:27:58.995631763 +0000 UTC m=+44.223624747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls") pod "image-registry-5b584bc769-82ncm" (UID: "deefe594-347c-4702-8972-55330d020baf") : secret "image-registry-tls" not found
Jul 06 19:27:54.995823 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:54.995705    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:54.995823 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:54.995741    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls podName:670e9b5a-7d3d-494a-948e-a2de70b5a967 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:58.995728697 +0000 UTC m=+44.223721692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vsrv2" (UID: "670e9b5a-7d3d-494a-948e-a2de70b5a967") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:55.096625 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:55.096150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:55.096625 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:55.096205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:55.096625 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:55.096237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:55.096625 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:55.096342    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle podName:8f1d07bb-becf-4294-ad8d-cfe48d58a638 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:59.096319019 +0000 UTC m=+44.324312002 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle") pod "router-default-5f94c4c7c-nxhtn" (UID: "8f1d07bb-becf-4294-ad8d-cfe48d58a638") : configmap references non-existent config key: service-ca.crt
Jul 06 19:27:55.096625 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:55.096433    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:27:55.096625 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:55.096487    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls podName:8d5301c7-fc16-4431-904d-a329e3d6c343 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:59.09647133 +0000 UTC m=+44.324464337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls") pod "dns-default-qz89z" (UID: "8d5301c7-fc16-4431-904d-a329e3d6c343") : secret "dns-default-metrics-tls" not found
Jul 06 19:27:55.096625 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:55.096551    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:27:55.096625 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:55.096597    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs podName:8f1d07bb-becf-4294-ad8d-cfe48d58a638 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:59.096584526 +0000 UTC m=+44.324577511 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs") pod "router-default-5f94c4c7c-nxhtn" (UID: "8f1d07bb-becf-4294-ad8d-cfe48d58a638") : secret "router-metrics-certs-default" not found
Jul 06 19:27:55.468187 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:55.467310    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjcg5" event={"ID":"750b8e20-d2eb-41b0-a423-affe1f95b71b","Type":"ContainerStarted","Data":"4c4ff8460965bee76c9c6d15e849706be79b1fd9fdfb11210821ff9156fa6186"}
Jul 06 19:27:55.496756 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:55.495564    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vjcg5" podStartSLOduration=11.39214743 podStartE2EDuration="40.495543495s" totalImagesPullingTime="29.103396065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:55.493937963 +0000 UTC m=+40.721930986" watchObservedRunningTime="2026-07-06 19:27:55.495543495 +0000 UTC m=+40.723536500"
Jul 06 19:27:59.033035 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:59.032992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:27:59.033492 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:59.033083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-54mqp\" (UID: \"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:27:59.033492 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:59.033175    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:59.033492 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:59.033207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:27:59.033492 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:59.033237    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:27:59.033492 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:59.033248    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls podName:670e9b5a-7d3d-494a-948e-a2de70b5a967 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:07.033230651 +0000 UTC m=+52.261223631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vsrv2" (UID: "670e9b5a-7d3d-494a-948e-a2de70b5a967") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:27:59.033492 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:59.033291    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls podName:b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a nodeName:}" failed. No retries permitted until 2026-07-06 19:28:07.033276689 +0000 UTC m=+52.261269689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-54mqp" (UID: "b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a") : secret "samples-operator-tls" not found
Jul 06 19:27:59.033492 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:59.033301    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:27:59.033492 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:59.033313    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b584bc769-82ncm: secret "image-registry-tls" not found
Jul 06 19:27:59.033492 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:59.033348    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls podName:deefe594-347c-4702-8972-55330d020baf nodeName:}" failed. No retries permitted until 2026-07-06 19:28:07.033338263 +0000 UTC m=+52.261331245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls") pod "image-registry-5b584bc769-82ncm" (UID: "deefe594-347c-4702-8972-55330d020baf") : secret "image-registry-tls" not found
Jul 06 19:27:59.134492 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:59.134457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:59.134492 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:59.134496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:27:59.134673 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:27:59.134519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:27:59.134673 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:59.134623    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle podName:8f1d07bb-becf-4294-ad8d-cfe48d58a638 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:07.134604067 +0000 UTC m=+52.362597048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle") pod "router-default-5f94c4c7c-nxhtn" (UID: "8f1d07bb-becf-4294-ad8d-cfe48d58a638") : configmap references non-existent config key: service-ca.crt
Jul 06 19:27:59.134673 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:59.134628    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:27:59.134673 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:59.134667    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs podName:8f1d07bb-becf-4294-ad8d-cfe48d58a638 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:07.134659688 +0000 UTC m=+52.362652669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs") pod "router-default-5f94c4c7c-nxhtn" (UID: "8f1d07bb-becf-4294-ad8d-cfe48d58a638") : secret "router-metrics-certs-default" not found
Jul 06 19:27:59.134814 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:59.134703    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:27:59.134814 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:27:59.134756    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls podName:8d5301c7-fc16-4431-904d-a329e3d6c343 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:07.134743414 +0000 UTC m=+52.362736394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls") pod "dns-default-qz89z" (UID: "8d5301c7-fc16-4431-904d-a329e3d6c343") : secret "dns-default-metrics-tls" not found
Jul 06 19:28:00.483397 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.483152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4" event={"ID":"445c63a3-5129-4382-ac75-a61c3dc3b4cc","Type":"ContainerStarted","Data":"ccbc87203e9ae71532490933074c19126c7045e964f7c94792d23c5a88225965"}
Jul 06 19:28:00.486796 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.486325    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq" event={"ID":"9da2aea4-73da-4cb7-81e8-a46fe714cac0","Type":"ContainerStarted","Data":"e212917955c6159ac654ee11cc08b927029fb417303df2a3c8b3e92e3f03d9b6"}
Jul 06 19:28:00.490146 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.489594    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8" event={"ID":"4ed2f491-2bc3-489a-9df8-bf57ac730b1f","Type":"ContainerStarted","Data":"0a74e6c35373d3e3a6d1c9e662f8b3992630426190363fd88f0c08514426b214"}
Jul 06 19:28:00.490146 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.490106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:28:00.492628 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.492462    2576 patch_prober.go:28] interesting pod/console-operator-68b757fb67-nfqb8 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" start-of-body=
Jul 06 19:28:00.492628 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.492530    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8" podUID="4ed2f491-2bc3-489a-9df8-bf57ac730b1f" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused"
Jul 06 19:28:00.494819 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.494338    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xnpm4" event={"ID":"20d07fcc-a2c4-4f44-944b-3778ea6af854","Type":"ContainerStarted","Data":"013b7d914e163b54117d7ec455cf061c6e9528f7758a3b199e9de8b9ed4db076"}
Jul 06 19:28:00.498462 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.497963    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd" event={"ID":"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d","Type":"ContainerStarted","Data":"38b71f7e57dd18c36f048551d922781c6af619523680677cbcd0411ce6db33ae"}
Jul 06 19:28:00.500690 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.500412    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kkz26" event={"ID":"35adfd2e-17ac-4125-806e-f08293363c35","Type":"ContainerStarted","Data":"0c7a9c4378c1814a88ac919ae4e52547ee458d42877d8cecc3ba4a271b5c40fc"}
Jul 06 19:28:00.503463 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.502910    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vdf4t" event={"ID":"6c7dc01b-dcf1-45fe-a817-78be627cff2e","Type":"ContainerStarted","Data":"7c63980e5d482de2393f2a40909105f2082600d209d40f449d7258756c4d829a"}
Jul 06 19:28:00.538170 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.537577    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4" podStartSLOduration=23.111201816 podStartE2EDuration="30.537553811s" totalImagesPullingTime="7.426351995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:00.514783498 +0000 UTC m=+45.742776500" watchObservedRunningTime="2026-07-06 19:28:00.537553811 +0000 UTC m=+45.765546814"
Jul 06 19:28:00.561952 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.561549    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq" podStartSLOduration=23.17976857 podStartE2EDuration="30.561526395s" totalImagesPullingTime="7.381757825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:00.53983097 +0000 UTC m=+45.767823971" watchObservedRunningTime="2026-07-06 19:28:00.561526395 +0000 UTC m=+45.789519399"
Jul 06 19:28:00.561952 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.561813    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd" podStartSLOduration=23.177747013 podStartE2EDuration="30.561803919s" totalImagesPullingTime="7.384056906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:00.561370174 +0000 UTC m=+45.789363178" watchObservedRunningTime="2026-07-06 19:28:00.561803919 +0000 UTC m=+45.789796914"
Jul 06 19:28:00.611633 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.611498    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xnpm4" podStartSLOduration=23.425586141 podStartE2EDuration="30.611477881s" totalImagesPullingTime="7.18589174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:00.5868664 +0000 UTC m=+45.814859403" watchObservedRunningTime="2026-07-06 19:28:00.611477881 +0000 UTC m=+45.839470885"
Jul 06 19:28:00.612578 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.612529    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-vdf4t" podStartSLOduration=23.225248774 podStartE2EDuration="30.612503171s" totalImagesPullingTime="7.387254397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:00.610950582 +0000 UTC m=+45.838943607" watchObservedRunningTime="2026-07-06 19:28:00.612503171 +0000 UTC m=+45.840496174"
Jul 06 19:28:00.634920 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.634864    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8" podStartSLOduration=23.248973292 podStartE2EDuration="30.634840727s" totalImagesPullingTime="7.385867435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:00.633297085 +0000 UTC m=+45.861290090" watchObservedRunningTime="2026-07-06 19:28:00.634840727 +0000 UTC m=+45.862833731"
Jul 06 19:28:00.657030 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:00.656981    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kkz26" podStartSLOduration=2.2630802389999998 podStartE2EDuration="9.656964414s" totalImagesPullingTime="7.393884175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:00.655635956 +0000 UTC m=+45.883628979" watchObservedRunningTime="2026-07-06 19:28:00.656964414 +0000 UTC m=+45.884957417"
Jul 06 19:28:01.508555 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:01.508521    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/0.log"
Jul 06 19:28:01.509079 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:01.508592    2576 generic.go:356] "Generic (PLEG): container finished" podID="4ed2f491-2bc3-489a-9df8-bf57ac730b1f" containerID="0a74e6c35373d3e3a6d1c9e662f8b3992630426190363fd88f0c08514426b214" exitCode=255
Jul 06 19:28:01.509079 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:01.508683    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8" event={"ID":"4ed2f491-2bc3-489a-9df8-bf57ac730b1f","Type":"ContainerDied","Data":"0a74e6c35373d3e3a6d1c9e662f8b3992630426190363fd88f0c08514426b214"}
Jul 06 19:28:01.509079 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:01.508988    2576 scope.go:117] "RemoveContainer" containerID="0a74e6c35373d3e3a6d1c9e662f8b3992630426190363fd88f0c08514426b214"
Jul 06 19:28:01.582054 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:01.582024    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:28:01.998027 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:01.997807    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7cpgf"]
Jul 06 19:28:02.019890 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.019861    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.026742 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.026720    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:28:02.027011 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.026997    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nmc6g\""
Jul 06 19:28:02.031392 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.031370    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:28:02.068271 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.068236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2767ceef-f6ed-4abd-8364-8036967f5e76-crio-socket\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.068271 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.068271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2767ceef-f6ed-4abd-8364-8036967f5e76-data-volume\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.068490 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.068297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpjkk\" (UniqueName: \"kubernetes.io/projected/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-api-access-dpjkk\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.068490 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.068328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.068490 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.068357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.089963 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.089917    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7cpgf"]
Jul 06 19:28:02.169791 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.169758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2767ceef-f6ed-4abd-8364-8036967f5e76-crio-socket\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.169791 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.169792    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2767ceef-f6ed-4abd-8364-8036967f5e76-data-volume\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.170034 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.169824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpjkk\" (UniqueName: \"kubernetes.io/projected/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-api-access-dpjkk\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.170034 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.169862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.170034 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.169888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.170034 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.169948    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2767ceef-f6ed-4abd-8364-8036967f5e76-crio-socket\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.170034 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:02.170023    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:28:02.170203 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:02.170050    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:28:02.170203 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:02.170088    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm podName:2767ceef-f6ed-4abd-8364-8036967f5e76 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:02.670073698 +0000 UTC m=+47.898066678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cpgf" (UID: "2767ceef-f6ed-4abd-8364-8036967f5e76") : configmap "kube-rbac-proxy" not found
Jul 06 19:28:02.170203 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:02.170101    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls podName:2767ceef-f6ed-4abd-8364-8036967f5e76 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:02.670095095 +0000 UTC m=+47.898088075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cpgf" (UID: "2767ceef-f6ed-4abd-8364-8036967f5e76") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:28:02.170203 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.170168    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2767ceef-f6ed-4abd-8364-8036967f5e76-data-volume\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.184473 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.184444    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpjkk\" (UniqueName: \"kubernetes.io/projected/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-api-access-dpjkk\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.513203 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.513173    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:28:02.513775 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.513611    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/0.log"
Jul 06 19:28:02.513775 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.513646    2576 generic.go:356] "Generic (PLEG): container finished" podID="4ed2f491-2bc3-489a-9df8-bf57ac730b1f" containerID="3c0831408827eb9d9a047861c93aba96759dff8ed199ff11717d0d88c0c0a784" exitCode=255
Jul 06 19:28:02.513775 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.513689    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8" event={"ID":"4ed2f491-2bc3-489a-9df8-bf57ac730b1f","Type":"ContainerDied","Data":"3c0831408827eb9d9a047861c93aba96759dff8ed199ff11717d0d88c0c0a784"}
Jul 06 19:28:02.513775 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.513733    2576 scope.go:117] "RemoveContainer" containerID="0a74e6c35373d3e3a6d1c9e662f8b3992630426190363fd88f0c08514426b214"
Jul 06 19:28:02.513974 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.513960    2576 scope.go:117] "RemoveContainer" containerID="3c0831408827eb9d9a047861c93aba96759dff8ed199ff11717d0d88c0c0a784"
Jul 06 19:28:02.514264 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:02.514142    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nfqb8_openshift-console-operator(4ed2f491-2bc3-489a-9df8-bf57ac730b1f)\"" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8" podUID="4ed2f491-2bc3-489a-9df8-bf57ac730b1f"
Jul 06 19:28:02.675238 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.675191    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.675419 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:02.675249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:02.675419 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:02.675310    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:28:02.675419 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:02.675368    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm podName:2767ceef-f6ed-4abd-8364-8036967f5e76 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:03.675355361 +0000 UTC m=+48.903348347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cpgf" (UID: "2767ceef-f6ed-4abd-8364-8036967f5e76") : configmap "kube-rbac-proxy" not found
Jul 06 19:28:02.675533 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:02.675411    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:28:02.675533 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:02.675476    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls podName:2767ceef-f6ed-4abd-8364-8036967f5e76 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:03.675462142 +0000 UTC m=+48.903455139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cpgf" (UID: "2767ceef-f6ed-4abd-8364-8036967f5e76") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:28:03.407299 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:03.407272    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cbtfq_b3fbace5-3965-4e94-8b3e-a92366cbb38f/dns-node-resolver/0.log"
Jul 06 19:28:03.518299 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:03.518273    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:28:03.518901 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:03.518661    2576 scope.go:117] "RemoveContainer" containerID="3c0831408827eb9d9a047861c93aba96759dff8ed199ff11717d0d88c0c0a784"
Jul 06 19:28:03.518901 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:03.518873    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nfqb8_openshift-console-operator(4ed2f491-2bc3-489a-9df8-bf57ac730b1f)\"" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8" podUID="4ed2f491-2bc3-489a-9df8-bf57ac730b1f"
Jul 06 19:28:03.686174 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:03.686085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:03.686174 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:03.686120    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:03.686394 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:03.686223    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:28:03.686394 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:03.686253    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:28:03.686394 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:03.686307    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm podName:2767ceef-f6ed-4abd-8364-8036967f5e76 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:05.686285363 +0000 UTC m=+50.914278346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cpgf" (UID: "2767ceef-f6ed-4abd-8364-8036967f5e76") : configmap "kube-rbac-proxy" not found
Jul 06 19:28:03.686394 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:03.686325    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls podName:2767ceef-f6ed-4abd-8364-8036967f5e76 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:05.686317255 +0000 UTC m=+50.914310237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cpgf" (UID: "2767ceef-f6ed-4abd-8364-8036967f5e76") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:28:04.407357 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:04.407323    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6blqc_b781508a-c55b-4154-9a5b-4d745c745c60/node-ca/0.log"
Jul 06 19:28:05.416866 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:05.416842    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kkz26_35adfd2e-17ac-4125-806e-f08293363c35/serve-healthcheck-canary/0.log"
Jul 06 19:28:05.700902 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:05.700825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:05.700902 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:05.700857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:05.701099 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:05.700966    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:28:05.701099 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:05.700967    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:28:05.701099 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:05.701021    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls podName:2767ceef-f6ed-4abd-8364-8036967f5e76 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:09.701007245 +0000 UTC m=+54.929000226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cpgf" (UID: "2767ceef-f6ed-4abd-8364-8036967f5e76") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:28:05.701099 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:05.701035    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm podName:2767ceef-f6ed-4abd-8364-8036967f5e76 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:09.70102866 +0000 UTC m=+54.929021642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cpgf" (UID: "2767ceef-f6ed-4abd-8364-8036967f5e76") : configmap "kube-rbac-proxy" not found
Jul 06 19:28:07.114767 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:07.114732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-54mqp\" (UID: \"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:28:07.115182 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:07.114900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:28:07.115182 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:07.114901    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 06 19:28:07.115182 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:07.114951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:28:07.115182 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:07.114992    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls podName:b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a nodeName:}" failed. No retries permitted until 2026-07-06 19:28:23.114967551 +0000 UTC m=+68.342960552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-54mqp" (UID: "b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a") : secret "samples-operator-tls" not found
Jul 06 19:28:07.115182 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:07.115057    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 06 19:28:07.115182 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:07.115063    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:28:07.115182 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:07.115081    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b584bc769-82ncm: secret "image-registry-tls" not found
Jul 06 19:28:07.115182 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:07.115110    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls podName:670e9b5a-7d3d-494a-948e-a2de70b5a967 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:23.11509598 +0000 UTC m=+68.343088980 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vsrv2" (UID: "670e9b5a-7d3d-494a-948e-a2de70b5a967") : secret "cluster-monitoring-operator-tls" not found
Jul 06 19:28:07.115182 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:07.115125    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls podName:deefe594-347c-4702-8972-55330d020baf nodeName:}" failed. No retries permitted until 2026-07-06 19:28:23.115117141 +0000 UTC m=+68.343110122 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls") pod "image-registry-5b584bc769-82ncm" (UID: "deefe594-347c-4702-8972-55330d020baf") : secret "image-registry-tls" not found
Jul 06 19:28:07.216388 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:07.216349    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:28:07.216523 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:07.216396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:28:07.216523 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:07.216483    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:28:07.216596 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:07.216534    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls podName:8d5301c7-fc16-4431-904d-a329e3d6c343 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:23.216522705 +0000 UTC m=+68.444515685 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls") pod "dns-default-qz89z" (UID: "8d5301c7-fc16-4431-904d-a329e3d6c343") : secret "dns-default-metrics-tls" not found
Jul 06 19:28:07.216596 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:07.216484    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 19:28:07.216596 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:07.216595    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs podName:8f1d07bb-becf-4294-ad8d-cfe48d58a638 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:23.216587049 +0000 UTC m=+68.444580039 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs") pod "router-default-5f94c4c7c-nxhtn" (UID: "8f1d07bb-becf-4294-ad8d-cfe48d58a638") : secret "router-metrics-certs-default" not found
Jul 06 19:28:07.216727 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:07.216712    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:28:07.216832 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:07.216820    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle podName:8f1d07bb-becf-4294-ad8d-cfe48d58a638 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:23.216808282 +0000 UTC m=+68.444801276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle") pod "router-default-5f94c4c7c-nxhtn" (UID: "8f1d07bb-becf-4294-ad8d-cfe48d58a638") : configmap references non-existent config key: service-ca.crt
Jul 06 19:28:09.737369 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:09.737335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:09.737369 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:09.737373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:09.737981 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:09.737473    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:28:09.737981 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:09.737498    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:28:09.737981 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:09.737551    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm podName:2767ceef-f6ed-4abd-8364-8036967f5e76 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:17.737536123 +0000 UTC m=+62.965529105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7cpgf" (UID: "2767ceef-f6ed-4abd-8364-8036967f5e76") : configmap "kube-rbac-proxy" not found
Jul 06 19:28:09.737981 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:09.737661    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls podName:2767ceef-f6ed-4abd-8364-8036967f5e76 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:17.737655032 +0000 UTC m=+62.965648013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cpgf" (UID: "2767ceef-f6ed-4abd-8364-8036967f5e76") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:28:10.490363 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:10.490333    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:28:10.490795 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:10.490778    2576 scope.go:117] "RemoveContainer" containerID="3c0831408827eb9d9a047861c93aba96759dff8ed199ff11717d0d88c0c0a784"
Jul 06 19:28:10.491020 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:10.490998    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nfqb8_openshift-console-operator(4ed2f491-2bc3-489a-9df8-bf57ac730b1f)\"" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8" podUID="4ed2f491-2bc3-489a-9df8-bf57ac730b1f"
Jul 06 19:28:11.582017 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:11.581975    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:28:11.582476 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:11.582364    2576 scope.go:117] "RemoveContainer" containerID="3c0831408827eb9d9a047861c93aba96759dff8ed199ff11717d0d88c0c0a784"
Jul 06 19:28:11.582546 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:11.582525    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nfqb8_openshift-console-operator(4ed2f491-2bc3-489a-9df8-bf57ac730b1f)\"" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8" podUID="4ed2f491-2bc3-489a-9df8-bf57ac730b1f"
Jul 06 19:28:17.428065 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:17.428036    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rjvls"
Jul 06 19:28:17.810401 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:17.810362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:17.810583 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:17.810409    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:17.810583 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:17.810540    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:28:17.810655 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:17.810607    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls podName:2767ceef-f6ed-4abd-8364-8036967f5e76 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:33.810589028 +0000 UTC m=+79.038582011 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7cpgf" (UID: "2767ceef-f6ed-4abd-8364-8036967f5e76") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:28:17.811044 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:17.811024    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2767ceef-f6ed-4abd-8364-8036967f5e76-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:20.940284 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:20.940248    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:28:20.940800 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:20.940306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs\") pod \"network-metrics-daemon-9flkj\" (UID: \"dc38d204-c217-4aa1-8dab-cbfd88600f21\") " pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:28:20.944683 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:20.944660    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:28:20.945625 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:20.945606    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:28:20.953287 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:20.953267    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc38d204-c217-4aa1-8dab-cbfd88600f21-metrics-certs\") pod \"network-metrics-daemon-9flkj\" (UID: \"dc38d204-c217-4aa1-8dab-cbfd88600f21\") " pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:28:20.953287 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:20.953278    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4-original-pull-secret\") pod \"global-pull-secret-syncer-hfsmd\" (UID: \"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4\") " pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:28:21.102951 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:21.102902    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mjmjf\""
Jul 06 19:28:21.105966 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:21.105947    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hfsmd"
Jul 06 19:28:21.109661 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:21.109642    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9flkj"
Jul 06 19:28:21.142108 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:21.142076    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw6kt\" (UniqueName: \"kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt\") pod \"network-check-target-mldf8\" (UID: \"bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4\") " pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:28:21.144799 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:21.144776    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw6kt\" (UniqueName: \"kubernetes.io/projected/bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4-kube-api-access-kw6kt\") pod \"network-check-target-mldf8\" (UID: \"bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4\") " pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:28:21.253567 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:21.253532    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9flkj"]
Jul 06 19:28:21.256198 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:28:21.256166    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc38d204_c217_4aa1_8dab_cbfd88600f21.slice/crio-f82d1b56c61e6133bb701168b96e353b16ac2140782b67368b08dc1934b73a8f WatchSource:0}: Error finding container f82d1b56c61e6133bb701168b96e353b16ac2140782b67368b08dc1934b73a8f: Status 404 returned error can't find the container with id f82d1b56c61e6133bb701168b96e353b16ac2140782b67368b08dc1934b73a8f
Jul 06 19:28:21.267061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:21.267037    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hfsmd"]
Jul 06 19:28:21.269195 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:28:21.269173    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89bafc65_ad4d_4ba9_8dbb_e3271b0f3cd4.slice/crio-7756a42b1a799ac37f854c8db75368b1a6b643598cbfa2c8bde1fcfaecef3d41 WatchSource:0}: Error finding container 7756a42b1a799ac37f854c8db75368b1a6b643598cbfa2c8bde1fcfaecef3d41: Status 404 returned error can't find the container with id 7756a42b1a799ac37f854c8db75368b1a6b643598cbfa2c8bde1fcfaecef3d41
Jul 06 19:28:21.395583 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:21.395553    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdwjn\""
Jul 06 19:28:21.402997 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:21.402977    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:28:21.531131 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:21.531098    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mldf8"]
Jul 06 19:28:21.534001 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:28:21.533972    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc0cd56_9f05_4ec8_b1db_c63bcdfd19a4.slice/crio-0291b4e02d8ea38e44818b6c2cab7a38c6c76bf0b517c49a0c16ab1905957ba9 WatchSource:0}: Error finding container 0291b4e02d8ea38e44818b6c2cab7a38c6c76bf0b517c49a0c16ab1905957ba9: Status 404 returned error can't find the container with id 0291b4e02d8ea38e44818b6c2cab7a38c6c76bf0b517c49a0c16ab1905957ba9
Jul 06 19:28:21.572848 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:21.572819    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9flkj" event={"ID":"dc38d204-c217-4aa1-8dab-cbfd88600f21","Type":"ContainerStarted","Data":"f82d1b56c61e6133bb701168b96e353b16ac2140782b67368b08dc1934b73a8f"}
Jul 06 19:28:21.573977 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:21.573954    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mldf8" event={"ID":"bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4","Type":"ContainerStarted","Data":"0291b4e02d8ea38e44818b6c2cab7a38c6c76bf0b517c49a0c16ab1905957ba9"}
Jul 06 19:28:21.575059 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:21.575037    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hfsmd" event={"ID":"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4","Type":"ContainerStarted","Data":"7756a42b1a799ac37f854c8db75368b1a6b643598cbfa2c8bde1fcfaecef3d41"}
Jul 06 19:28:22.581693 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:22.581654    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9flkj" event={"ID":"dc38d204-c217-4aa1-8dab-cbfd88600f21","Type":"ContainerStarted","Data":"565e0dc61e967e703c297492bc7325a1fb3f258e8abacd8d3433b3744fa537c6"}
Jul 06 19:28:22.582184 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:22.581759    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9flkj" event={"ID":"dc38d204-c217-4aa1-8dab-cbfd88600f21","Type":"ContainerStarted","Data":"bdf283faa1dbc0afbe219321a257ba27fa39f78c45f0080da2e21fd8f4a95f4f"}
Jul 06 19:28:22.583399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:22.583370    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mldf8" event={"ID":"bbc0cd56-9f05-4ec8-b1db-c63bcdfd19a4","Type":"ContainerStarted","Data":"d215237ee2d514c5e10e985b1a9c1627850599dd26647a942f65d4ebe47d0ca3"}
Jul 06 19:28:22.583527 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:22.583511    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:28:22.601561 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:22.601496    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9flkj" podStartSLOduration=66.497710312 podStartE2EDuration="1m7.601474473s" totalImagesPullingTime="1.103764161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:22.601268885 +0000 UTC m=+67.829261909" watchObservedRunningTime="2026-07-06 19:28:22.601474473 +0000 UTC m=+67.829467476"
Jul 06 19:28:22.624585 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:22.624482    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mldf8" podStartSLOduration=67.624467096 podStartE2EDuration="1m7.624467096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:22.623530664 +0000 UTC m=+67.851523685" watchObservedRunningTime="2026-07-06 19:28:22.624467096 +0000 UTC m=+67.852460099"
Jul 06 19:28:23.162574 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.162531    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:28:23.162750 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.162586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:28:23.162750 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.162621    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-54mqp\" (UID: \"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:28:23.165201 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.165165    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/670e9b5a-7d3d-494a-948e-a2de70b5a967-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vsrv2\" (UID: \"670e9b5a-7d3d-494a-948e-a2de70b5a967\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:28:23.165323 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.165171    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls\") pod \"image-registry-5b584bc769-82ncm\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") " pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:28:23.165323 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.165171    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-54mqp\" (UID: \"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:28:23.263571 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.263526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:28:23.263571 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.263574    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:28:23.263789 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.263597    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:28:23.264316 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.264287    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f1d07bb-becf-4294-ad8d-cfe48d58a638-service-ca-bundle\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:28:23.265887 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.265865    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d5301c7-fc16-4431-904d-a329e3d6c343-metrics-tls\") pod \"dns-default-qz89z\" (UID: \"8d5301c7-fc16-4431-904d-a329e3d6c343\") " pod="openshift-dns/dns-default-qz89z"
Jul 06 19:28:23.266071 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.266051    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f1d07bb-becf-4294-ad8d-cfe48d58a638-metrics-certs\") pod \"router-default-5f94c4c7c-nxhtn\" (UID: \"8f1d07bb-becf-4294-ad8d-cfe48d58a638\") " pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:28:23.312329 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.312300    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wrxff\""
Jul 06 19:28:23.320000 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.319981    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:28:23.332549 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.332516    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pwxwb\""
Jul 06 19:28:23.339585 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.339359    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"
Jul 06 19:28:23.370568 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.370521    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mcn59\""
Jul 06 19:28:23.378034 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.377903    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"
Jul 06 19:28:23.398107 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.398044    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8w5t5\""
Jul 06 19:28:23.406756 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.406370    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:28:23.440631 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.440596    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6kw96\""
Jul 06 19:28:23.446810 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.446285    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qz89z"
Jul 06 19:28:23.503337 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.503009    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b584bc769-82ncm"]
Jul 06 19:28:23.532389 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.532317    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2"]
Jul 06 19:28:23.535232 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:28:23.535170    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod670e9b5a_7d3d_494a_948e_a2de70b5a967.slice/crio-4c17e717aa20172e0aa0154ba2640edb90748f2b7afed22f2b46a2350136fce5 WatchSource:0}: Error finding container 4c17e717aa20172e0aa0154ba2640edb90748f2b7afed22f2b46a2350136fce5: Status 404 returned error can't find the container with id 4c17e717aa20172e0aa0154ba2640edb90748f2b7afed22f2b46a2350136fce5
Jul 06 19:28:23.565762 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.564618    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp"]
Jul 06 19:28:23.591668 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.591637    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b584bc769-82ncm" event={"ID":"deefe594-347c-4702-8972-55330d020baf","Type":"ContainerStarted","Data":"bd07ec21f41e5e0ae2e87c097d6f9f0e79f8125556bc67e1d08169dbe4f6d11e"}
Jul 06 19:28:23.594268 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.594041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2" event={"ID":"670e9b5a-7d3d-494a-948e-a2de70b5a967","Type":"ContainerStarted","Data":"4c17e717aa20172e0aa0154ba2640edb90748f2b7afed22f2b46a2350136fce5"}
Jul 06 19:28:23.614765 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.614736    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5f94c4c7c-nxhtn"]
Jul 06 19:28:23.617321 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:28:23.617284    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f1d07bb_becf_4294_ad8d_cfe48d58a638.slice/crio-ed23a17b61a8bae7b46d3a300a2bf35804607e247b67f5fad0e425c1fe97b375 WatchSource:0}: Error finding container ed23a17b61a8bae7b46d3a300a2bf35804607e247b67f5fad0e425c1fe97b375: Status 404 returned error can't find the container with id ed23a17b61a8bae7b46d3a300a2bf35804607e247b67f5fad0e425c1fe97b375
Jul 06 19:28:23.639424 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:23.639392    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qz89z"]
Jul 06 19:28:23.648752 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:28:23.648721    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5301c7_fc16_4431_904d_a329e3d6c343.slice/crio-7a9bbe3789168eadaa5fd39dd4635be76babf08ecf2f270bdf7b9fcd6a3f3e9b WatchSource:0}: Error finding container 7a9bbe3789168eadaa5fd39dd4635be76babf08ecf2f270bdf7b9fcd6a3f3e9b: Status 404 returned error can't find the container with id 7a9bbe3789168eadaa5fd39dd4635be76babf08ecf2f270bdf7b9fcd6a3f3e9b
Jul 06 19:28:24.601395 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:24.601292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f94c4c7c-nxhtn" event={"ID":"8f1d07bb-becf-4294-ad8d-cfe48d58a638","Type":"ContainerStarted","Data":"0311e7266fdbc5aecd0611f459aa0e1cee70534fbd93387bca22b6d5f3c96076"}
Jul 06 19:28:24.601395 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:24.601362    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5f94c4c7c-nxhtn" event={"ID":"8f1d07bb-becf-4294-ad8d-cfe48d58a638","Type":"ContainerStarted","Data":"ed23a17b61a8bae7b46d3a300a2bf35804607e247b67f5fad0e425c1fe97b375"}
Jul 06 19:28:24.602988 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:24.602955    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qz89z" event={"ID":"8d5301c7-fc16-4431-904d-a329e3d6c343","Type":"ContainerStarted","Data":"7a9bbe3789168eadaa5fd39dd4635be76babf08ecf2f270bdf7b9fcd6a3f3e9b"}
Jul 06 19:28:24.605381 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:24.605323    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp" event={"ID":"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a","Type":"ContainerStarted","Data":"82647a1c2dca6737db229f1ba584fb00b4f2736172596aa349df9423a56436a0"}
Jul 06 19:28:24.608023 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:24.607793    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b584bc769-82ncm" event={"ID":"deefe594-347c-4702-8972-55330d020baf","Type":"ContainerStarted","Data":"5601ea23950cb58e7b6681b987725882ec5140d834c1944e5c1b7fad0e63ad86"}
Jul 06 19:28:24.608269 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:24.608201    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:28:24.650521 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:24.649864    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5f94c4c7c-nxhtn" podStartSLOduration=54.649841103 podStartE2EDuration="54.649841103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:24.626976929 +0000 UTC m=+69.854969959" watchObservedRunningTime="2026-07-06 19:28:24.649841103 +0000 UTC m=+69.877834109"
Jul 06 19:28:25.406892 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:25.406857    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:28:25.410095 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:25.410068    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:28:25.442513 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:25.442448    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b584bc769-82ncm" podStartSLOduration=70.442427262 podStartE2EDuration="1m10.442427262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:24.650764072 +0000 UTC m=+69.878757091" watchObservedRunningTime="2026-07-06 19:28:25.442427262 +0000 UTC m=+70.670420265"
Jul 06 19:28:25.611834 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:25.611803    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:28:25.613138 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:25.613113    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5f94c4c7c-nxhtn"
Jul 06 19:28:26.113363 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.113328    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"]
Jul 06 19:28:26.118784 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.118757    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.123563 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.123532    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 19:28:26.123690 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.123618    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 19:28:26.124165 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.124142    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 19:28:26.124307 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.124278    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 19:28:26.124725 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.124706    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 19:28:26.124823 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.124798    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 19:28:26.125091 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.125071    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 19:28:26.134594 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.134568    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"]
Jul 06 19:28:26.196011 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.195975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/68a2284c-a3f0-4bfe-9757-9c90fcad0506-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.196182 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.196032    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/68a2284c-a3f0-4bfe-9757-9c90fcad0506-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.196182 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.196131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68a2284c-a3f0-4bfe-9757-9c90fcad0506-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.196283 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.196194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/68a2284c-a3f0-4bfe-9757-9c90fcad0506-hub\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.196283 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.196225    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/68a2284c-a3f0-4bfe-9757-9c90fcad0506-ca\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.196283 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.196254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgqpb\" (UniqueName: \"kubernetes.io/projected/68a2284c-a3f0-4bfe-9757-9c90fcad0506-kube-api-access-dgqpb\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.297267 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.297222    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/68a2284c-a3f0-4bfe-9757-9c90fcad0506-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.297458 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.297275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/68a2284c-a3f0-4bfe-9757-9c90fcad0506-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.297458 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.297311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68a2284c-a3f0-4bfe-9757-9c90fcad0506-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.297458 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.297335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/68a2284c-a3f0-4bfe-9757-9c90fcad0506-hub\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.297458 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.297357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/68a2284c-a3f0-4bfe-9757-9c90fcad0506-ca\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.297458 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.297381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgqpb\" (UniqueName: \"kubernetes.io/projected/68a2284c-a3f0-4bfe-9757-9c90fcad0506-kube-api-access-dgqpb\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.298100 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.298046    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/68a2284c-a3f0-4bfe-9757-9c90fcad0506-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.300195 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.300169    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/68a2284c-a3f0-4bfe-9757-9c90fcad0506-hub\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.300358 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.300338    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/68a2284c-a3f0-4bfe-9757-9c90fcad0506-ca\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.300423 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.300350    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/68a2284c-a3f0-4bfe-9757-9c90fcad0506-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.300423 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.300387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/68a2284c-a3f0-4bfe-9757-9c90fcad0506-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.307781 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.307735    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgqpb\" (UniqueName: \"kubernetes.io/projected/68a2284c-a3f0-4bfe-9757-9c90fcad0506-kube-api-access-dgqpb\") pod \"cluster-proxy-proxy-agent-7f46d94bf7-bnddz\" (UID: \"68a2284c-a3f0-4bfe-9757-9c90fcad0506\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:26.440174 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:26.440092    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"
Jul 06 19:28:27.279430 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:27.279403    2576 scope.go:117] "RemoveContainer" containerID="3c0831408827eb9d9a047861c93aba96759dff8ed199ff11717d0d88c0c0a784"
Jul 06 19:28:28.447800 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.447731    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz"]
Jul 06 19:28:28.458620 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:28:28.458279    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68a2284c_a3f0_4bfe_9757_9c90fcad0506.slice/crio-8c345c0782241107bbbe9a2634f6da5c87cb7a91d714f498b08be130398725c7 WatchSource:0}: Error finding container 8c345c0782241107bbbe9a2634f6da5c87cb7a91d714f498b08be130398725c7: Status 404 returned error can't find the container with id 8c345c0782241107bbbe9a2634f6da5c87cb7a91d714f498b08be130398725c7
Jul 06 19:28:28.633182 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.633009    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2" event={"ID":"670e9b5a-7d3d-494a-948e-a2de70b5a967","Type":"ContainerStarted","Data":"61ea5a6b6c7e2aec8d85b429ea27104a7b37c4d18721f3dddedd31766e187408"}
Jul 06 19:28:28.635561 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.635321    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qz89z" event={"ID":"8d5301c7-fc16-4431-904d-a329e3d6c343","Type":"ContainerStarted","Data":"81f4b8aec048df0eff9dc43bd21989a8154a7b5e5a826530c860f2cc71b6a770"}
Jul 06 19:28:28.637731 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.637684    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp" event={"ID":"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a","Type":"ContainerStarted","Data":"029a55e4c6fb7709f8d6bfcab56d9cdce9881d8798978b60b3f580a6455f01fe"}
Jul 06 19:28:28.637858 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.637737    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp" event={"ID":"b3c1a2d1-2fce-4939-8b6d-d0da84cdb08a","Type":"ContainerStarted","Data":"6156c1dd92c1dbe4fcd30224e2a31d2cad4a9f03cbe74caaf9060124fd2e0da3"}
Jul 06 19:28:28.639711 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.639691    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:28:28.639822 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.639782    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8" event={"ID":"4ed2f491-2bc3-489a-9df8-bf57ac730b1f","Type":"ContainerStarted","Data":"adee43624876cd316cdb46a1adae764c9bb05f3e6eed5a1da86a8a56239b0935"}
Jul 06 19:28:28.640228 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.640179    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:28:28.641595 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.641530    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz" event={"ID":"68a2284c-a3f0-4bfe-9757-9c90fcad0506","Type":"ContainerStarted","Data":"8c345c0782241107bbbe9a2634f6da5c87cb7a91d714f498b08be130398725c7"}
Jul 06 19:28:28.643114 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.643093    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hfsmd" event={"ID":"89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4","Type":"ContainerStarted","Data":"49de91f3768ad05b9d4879b32616aa1859f07a1624271cf06eafd4b87132b112"}
Jul 06 19:28:28.652690 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.652616    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vsrv2" podStartSLOduration=53.929156424 podStartE2EDuration="58.652603311s" totalImagesPullingTime="4.723446887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:28.651127499 +0000 UTC m=+73.879120530" watchObservedRunningTime="2026-07-06 19:28:28.652603311 +0000 UTC m=+73.880596313"
Jul 06 19:28:28.671198 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.671110    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-54mqp" podStartSLOduration=54.003634693 podStartE2EDuration="58.671086554s" totalImagesPullingTime="4.667451861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:28.671078399 +0000 UTC m=+73.899071403" watchObservedRunningTime="2026-07-06 19:28:28.671086554 +0000 UTC m=+73.899079558"
Jul 06 19:28:28.723300 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.723251    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hfsmd" podStartSLOduration=66.727588007 podStartE2EDuration="1m13.72322506s" totalImagesPullingTime="6.995637053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:28.720971144 +0000 UTC m=+73.948964166" watchObservedRunningTime="2026-07-06 19:28:28.72322506 +0000 UTC m=+73.951218041"
Jul 06 19:28:28.906831 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:28.906748    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-nfqb8"
Jul 06 19:28:29.651763 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:29.651722    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qz89z" event={"ID":"8d5301c7-fc16-4431-904d-a329e3d6c343","Type":"ContainerStarted","Data":"72a30ad30e69d31c96a65fdc8e62cb3ddab5c19c3a79ec2e6c3ee0ba7720cc26"}
Jul 06 19:28:29.652704 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:29.652328    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qz89z"
Jul 06 19:28:29.669280 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:29.669220    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qz89z" podStartSLOduration=34.05310498 podStartE2EDuration="38.66919815s" totalImagesPullingTime="4.61609317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:29.668483256 +0000 UTC m=+74.896476274" watchObservedRunningTime="2026-07-06 19:28:29.66919815 +0000 UTC m=+74.897191156"
Jul 06 19:28:33.874222 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:33.874192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:33.876386 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:33.876368    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2767ceef-f6ed-4abd-8364-8036967f5e76-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7cpgf\" (UID: \"2767ceef-f6ed-4abd-8364-8036967f5e76\") " pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:34.132498 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:34.132468    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nmc6g\""
Jul 06 19:28:34.140007 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:34.139983    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7cpgf"
Jul 06 19:28:34.288763 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:34.288735    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7cpgf"]
Jul 06 19:28:34.291325 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:28:34.291300    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2767ceef_f6ed_4abd_8364_8036967f5e76.slice/crio-ff9538a0209481a06cf993bd01c940fb7484eb2d7c7375c6ee9925b7235f7b68 WatchSource:0}: Error finding container ff9538a0209481a06cf993bd01c940fb7484eb2d7c7375c6ee9925b7235f7b68: Status 404 returned error can't find the container with id ff9538a0209481a06cf993bd01c940fb7484eb2d7c7375c6ee9925b7235f7b68
Jul 06 19:28:34.670528 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:34.670442    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz" event={"ID":"68a2284c-a3f0-4bfe-9757-9c90fcad0506","Type":"ContainerStarted","Data":"020dc0ea25ceccf0abfbe67cadf3a6e48ef6f221cccb1407017fec98c51db89a"}
Jul 06 19:28:34.670528 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:34.670490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz" event={"ID":"68a2284c-a3f0-4bfe-9757-9c90fcad0506","Type":"ContainerStarted","Data":"cdd5b62b5f34f096212af2d8d3a0123d7d6343384aa257d878fee02517c7794a"}
Jul 06 19:28:34.670528 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:34.670504    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz" event={"ID":"68a2284c-a3f0-4bfe-9757-9c90fcad0506","Type":"ContainerStarted","Data":"4d9efa0a57fbcc5c650a0993a3261828f06aa4bc62ae8d092a6a6619259c8400"}
Jul 06 19:28:34.671637 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:34.671611    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7cpgf" event={"ID":"2767ceef-f6ed-4abd-8364-8036967f5e76","Type":"ContainerStarted","Data":"ff9538a0209481a06cf993bd01c940fb7484eb2d7c7375c6ee9925b7235f7b68"}
Jul 06 19:28:34.691483 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:34.691430    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7f46d94bf7-bnddz" podStartSLOduration=3.413787621 podStartE2EDuration="8.691409956s" totalImagesPullingTime="5.277622335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:34.689760151 +0000 UTC m=+79.917753155" watchObservedRunningTime="2026-07-06 19:28:34.691409956 +0000 UTC m=+79.919402960"
Jul 06 19:28:38.689498 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:38.689462    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7cpgf" event={"ID":"2767ceef-f6ed-4abd-8364-8036967f5e76","Type":"ContainerStarted","Data":"a4a2028dfec23aa71da06f08998a9dd4b3e22bfdcba6648cf197ace794b58472"}
Jul 06 19:28:39.696563 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:39.696526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7cpgf" event={"ID":"2767ceef-f6ed-4abd-8364-8036967f5e76","Type":"ContainerStarted","Data":"6f6cd41252638bbe56d9f7714acdacc5a94465fcc2ab3b9a63912da4c0fed189"}
Jul 06 19:28:40.661244 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:40.661209    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qz89z"
Jul 06 19:28:41.632909 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.632874    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m6478"]
Jul 06 19:28:41.636329 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.636308    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.640270 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.640246    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:28:41.641551 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.641523    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:28:41.641551 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.641525    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fxbq4\""
Jul 06 19:28:41.641717 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.641551    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:28:41.641717 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.641529    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:28:41.706431 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.706395    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7cpgf" event={"ID":"2767ceef-f6ed-4abd-8364-8036967f5e76","Type":"ContainerStarted","Data":"9154c28863d586a21542de8a041118b9f0eef9f605e50f9fe8b281d2fefe4ec3"}
Jul 06 19:28:41.731153 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.731096    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7cpgf" podStartSLOduration=33.954367359 podStartE2EDuration="40.731079868s" totalImagesPullingTime="6.776712509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:28:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:41.730114304 +0000 UTC m=+86.958107307" watchObservedRunningTime="2026-07-06 19:28:41.731079868 +0000 UTC m=+86.959072898"
Jul 06 19:28:41.837330 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.837293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-textfile\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.837330 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.837332    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.837525 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.837390    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-tls\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.837525 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.837417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-metrics-client-ca\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.837525 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.837460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-root\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.837525 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.837486    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-wtmp\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.837525 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.837509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-sys\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.837678 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.837527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-accelerators-collector-config\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.837678 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.837583    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79rdl\" (UniqueName: \"kubernetes.io/projected/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-kube-api-access-79rdl\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.938473 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.938390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-root\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.938473 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.938425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-wtmp\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.938473 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.938455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-sys\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.938674 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.938483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-accelerators-collector-config\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.938674 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.938494    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-root\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.938674 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.938544    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-sys\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.938674 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.938561    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79rdl\" (UniqueName: \"kubernetes.io/projected/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-kube-api-access-79rdl\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.938674 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.938569    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-wtmp\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.938674 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.938596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-textfile\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.938674 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.938627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.939007 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.938706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-tls\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.939007 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.938756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-metrics-client-ca\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.939007 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:41.938855    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 19:28:41.939007 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.938882    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-textfile\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.939007 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:28:41.938917    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-tls podName:1f7ff87e-b0af-49f2-a3e6-a94c9a64344e nodeName:}" failed. No retries permitted until 2026-07-06 19:28:42.438897296 +0000 UTC m=+87.666890288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-tls") pod "node-exporter-m6478" (UID: "1f7ff87e-b0af-49f2-a3e6-a94c9a64344e") : secret "node-exporter-tls" not found
Jul 06 19:28:41.939193 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.939133    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-accelerators-collector-config\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.939331 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.939315    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-metrics-client-ca\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.941009 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.940990    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:41.950334 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:41.950304    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79rdl\" (UniqueName: \"kubernetes.io/projected/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-kube-api-access-79rdl\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:42.442417 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:42.442377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-tls\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:42.444703 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:42.444685    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f7ff87e-b0af-49f2-a3e6-a94c9a64344e-node-exporter-tls\") pod \"node-exporter-m6478\" (UID: \"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e\") " pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:42.547750 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:42.547711    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m6478"
Jul 06 19:28:42.562086 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:28:42.562053    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7ff87e_b0af_49f2_a3e6_a94c9a64344e.slice/crio-87d9a0a461847796be370e83012a05f0f8fe15c02eaee10a4f0c5031b7ebbc1e WatchSource:0}: Error finding container 87d9a0a461847796be370e83012a05f0f8fe15c02eaee10a4f0c5031b7ebbc1e: Status 404 returned error can't find the container with id 87d9a0a461847796be370e83012a05f0f8fe15c02eaee10a4f0c5031b7ebbc1e
Jul 06 19:28:42.711126 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:42.711086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6478" event={"ID":"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e","Type":"ContainerStarted","Data":"87d9a0a461847796be370e83012a05f0f8fe15c02eaee10a4f0c5031b7ebbc1e"}
Jul 06 19:28:43.716520 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:43.716487    2576 generic.go:356] "Generic (PLEG): container finished" podID="1f7ff87e-b0af-49f2-a3e6-a94c9a64344e" containerID="6218a9992c6c9d8b7af957f7c7b000f64e5e58e6ee9df9cb0e9d41da6ffd9e66" exitCode=0
Jul 06 19:28:43.716968 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:43.716564    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6478" event={"ID":"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e","Type":"ContainerDied","Data":"6218a9992c6c9d8b7af957f7c7b000f64e5e58e6ee9df9cb0e9d41da6ffd9e66"}
Jul 06 19:28:44.722650 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:44.722611    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6478" event={"ID":"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e","Type":"ContainerStarted","Data":"90e3faf5222689fa846315a1eb25f4e87da15ef43b947ec286892ece9c30287c"}
Jul 06 19:28:44.723077 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:44.722677    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6478" event={"ID":"1f7ff87e-b0af-49f2-a3e6-a94c9a64344e","Type":"ContainerStarted","Data":"e803e6905da7fa3bcb708c67a7cbb290b564a65384b7867978a39488c9dc0d25"}
Jul 06 19:28:44.748010 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:44.747958    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m6478" podStartSLOduration=2.8514660689999998 podStartE2EDuration="3.747940809s" totalImagesPullingTime="833.828069ms" totalInitContainerRuntime="62.646671ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:44.745709438 +0000 UTC m=+89.973702441" watchObservedRunningTime="2026-07-06 19:28:44.747940809 +0000 UTC m=+89.975933802"
Jul 06 19:28:45.616174 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:45.616146    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:28:48.299173 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:48.299139    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b584bc769-82ncm"]
Jul 06 19:28:53.597417 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:28:53.597380    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mldf8"
Jul 06 19:29:13.320512 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.320445    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b584bc769-82ncm" podUID="deefe594-347c-4702-8972-55330d020baf" containerName="registry" containerID="cri-o://5601ea23950cb58e7b6681b987725882ec5140d834c1944e5c1b7fad0e63ad86" gracePeriod=30
Jul 06 19:29:13.574498 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.574437    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:29:13.707979 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.707920    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/deefe594-347c-4702-8972-55330d020baf-installation-pull-secrets\") pod \"deefe594-347c-4702-8972-55330d020baf\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") "
Jul 06 19:29:13.708149 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.707995    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-bound-sa-token\") pod \"deefe594-347c-4702-8972-55330d020baf\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") "
Jul 06 19:29:13.708149 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.708024    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/deefe594-347c-4702-8972-55330d020baf-ca-trust-extracted\") pod \"deefe594-347c-4702-8972-55330d020baf\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") "
Jul 06 19:29:13.708149 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.708044    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/deefe594-347c-4702-8972-55330d020baf-trusted-ca\") pod \"deefe594-347c-4702-8972-55330d020baf\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") "
Jul 06 19:29:13.708149 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.708086    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls\") pod \"deefe594-347c-4702-8972-55330d020baf\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") "
Jul 06 19:29:13.708368 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.708216    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/deefe594-347c-4702-8972-55330d020baf-registry-certificates\") pod \"deefe594-347c-4702-8972-55330d020baf\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") "
Jul 06 19:29:13.708368 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.708254    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/deefe594-347c-4702-8972-55330d020baf-image-registry-private-configuration\") pod \"deefe594-347c-4702-8972-55330d020baf\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") "
Jul 06 19:29:13.708368 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.708318    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsx7m\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-kube-api-access-hsx7m\") pod \"deefe594-347c-4702-8972-55330d020baf\" (UID: \"deefe594-347c-4702-8972-55330d020baf\") "
Jul 06 19:29:13.708561 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.708527    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deefe594-347c-4702-8972-55330d020baf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "deefe594-347c-4702-8972-55330d020baf" (UID: "deefe594-347c-4702-8972-55330d020baf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:29:13.708637 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.708607    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/deefe594-347c-4702-8972-55330d020baf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "deefe594-347c-4702-8972-55330d020baf" (UID: "deefe594-347c-4702-8972-55330d020baf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:29:13.710667 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.710636    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "deefe594-347c-4702-8972-55330d020baf" (UID: "deefe594-347c-4702-8972-55330d020baf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:29:13.710667 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.710647    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deefe594-347c-4702-8972-55330d020baf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "deefe594-347c-4702-8972-55330d020baf" (UID: "deefe594-347c-4702-8972-55330d020baf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:29:13.710667 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.710683    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "deefe594-347c-4702-8972-55330d020baf" (UID: "deefe594-347c-4702-8972-55330d020baf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:29:13.710885 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.710749    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deefe594-347c-4702-8972-55330d020baf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "deefe594-347c-4702-8972-55330d020baf" (UID: "deefe594-347c-4702-8972-55330d020baf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:29:13.710921 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.710902    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-kube-api-access-hsx7m" (OuterVolumeSpecName: "kube-api-access-hsx7m") pod "deefe594-347c-4702-8972-55330d020baf" (UID: "deefe594-347c-4702-8972-55330d020baf"). InnerVolumeSpecName "kube-api-access-hsx7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:29:13.716793 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.716766    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deefe594-347c-4702-8972-55330d020baf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "deefe594-347c-4702-8972-55330d020baf" (UID: "deefe594-347c-4702-8972-55330d020baf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:29:13.808997 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.808950    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/deefe594-347c-4702-8972-55330d020baf-installation-pull-secrets\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:29:13.808997 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.808988    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-bound-sa-token\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:29:13.808997 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.809001    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/deefe594-347c-4702-8972-55330d020baf-ca-trust-extracted\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:29:13.809236 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.809012    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/deefe594-347c-4702-8972-55330d020baf-trusted-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:29:13.809236 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.809024    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-registry-tls\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:29:13.809236 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.809034    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/deefe594-347c-4702-8972-55330d020baf-registry-certificates\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:29:13.809236 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.809047    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/deefe594-347c-4702-8972-55330d020baf-image-registry-private-configuration\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:29:13.809236 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.809059    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsx7m\" (UniqueName: \"kubernetes.io/projected/deefe594-347c-4702-8972-55330d020baf-kube-api-access-hsx7m\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:29:13.828219 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.828128    2576 generic.go:356] "Generic (PLEG): container finished" podID="deefe594-347c-4702-8972-55330d020baf" containerID="5601ea23950cb58e7b6681b987725882ec5140d834c1944e5c1b7fad0e63ad86" exitCode=0
Jul 06 19:29:13.828219 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.828172    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b584bc769-82ncm"
Jul 06 19:29:13.828219 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.828180    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b584bc769-82ncm" event={"ID":"deefe594-347c-4702-8972-55330d020baf","Type":"ContainerDied","Data":"5601ea23950cb58e7b6681b987725882ec5140d834c1944e5c1b7fad0e63ad86"}
Jul 06 19:29:13.828462 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.828233    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b584bc769-82ncm" event={"ID":"deefe594-347c-4702-8972-55330d020baf","Type":"ContainerDied","Data":"bd07ec21f41e5e0ae2e87c097d6f9f0e79f8125556bc67e1d08169dbe4f6d11e"}
Jul 06 19:29:13.828462 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.828259    2576 scope.go:117] "RemoveContainer" containerID="5601ea23950cb58e7b6681b987725882ec5140d834c1944e5c1b7fad0e63ad86"
Jul 06 19:29:13.836342 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.836298    2576 scope.go:117] "RemoveContainer" containerID="5601ea23950cb58e7b6681b987725882ec5140d834c1944e5c1b7fad0e63ad86"
Jul 06 19:29:13.836735 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:29:13.836706    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5601ea23950cb58e7b6681b987725882ec5140d834c1944e5c1b7fad0e63ad86\": container with ID starting with 5601ea23950cb58e7b6681b987725882ec5140d834c1944e5c1b7fad0e63ad86 not found: ID does not exist" containerID="5601ea23950cb58e7b6681b987725882ec5140d834c1944e5c1b7fad0e63ad86"
Jul 06 19:29:13.836819 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.836746    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5601ea23950cb58e7b6681b987725882ec5140d834c1944e5c1b7fad0e63ad86"} err="failed to get container status \"5601ea23950cb58e7b6681b987725882ec5140d834c1944e5c1b7fad0e63ad86\": rpc error: code = NotFound desc = could not find container \"5601ea23950cb58e7b6681b987725882ec5140d834c1944e5c1b7fad0e63ad86\": container with ID starting with 5601ea23950cb58e7b6681b987725882ec5140d834c1944e5c1b7fad0e63ad86 not found: ID does not exist"
Jul 06 19:29:13.853363 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.853337    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b584bc769-82ncm"]
Jul 06 19:29:13.857133 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:13.857110    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b584bc769-82ncm"]
Jul 06 19:29:15.283212 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:15.283180    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deefe594-347c-4702-8972-55330d020baf" path="/var/lib/kubelet/pods/deefe594-347c-4702-8972-55330d020baf/volumes"
Jul 06 19:29:26.874486 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:26.874452    2576 generic.go:356] "Generic (PLEG): container finished" podID="9da2aea4-73da-4cb7-81e8-a46fe714cac0" containerID="e212917955c6159ac654ee11cc08b927029fb417303df2a3c8b3e92e3f03d9b6" exitCode=0
Jul 06 19:29:26.874897 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:26.874509    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq" event={"ID":"9da2aea4-73da-4cb7-81e8-a46fe714cac0","Type":"ContainerDied","Data":"e212917955c6159ac654ee11cc08b927029fb417303df2a3c8b3e92e3f03d9b6"}
Jul 06 19:29:26.874897 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:26.874829    2576 scope.go:117] "RemoveContainer" containerID="e212917955c6159ac654ee11cc08b927029fb417303df2a3c8b3e92e3f03d9b6"
Jul 06 19:29:27.880347 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:27.880314    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-cr9kq" event={"ID":"9da2aea4-73da-4cb7-81e8-a46fe714cac0","Type":"ContainerStarted","Data":"b718f1a790f320db57f7988a024dff32cf8936fa286549faffee3d54c5fe9f5b"}
Jul 06 19:29:31.896228 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:31.896188    2576 generic.go:356] "Generic (PLEG): container finished" podID="bae2d09b-44d8-4ac6-bccf-e5b54a130b9d" containerID="38b71f7e57dd18c36f048551d922781c6af619523680677cbcd0411ce6db33ae" exitCode=0
Jul 06 19:29:31.896613 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:31.896245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd" event={"ID":"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d","Type":"ContainerDied","Data":"38b71f7e57dd18c36f048551d922781c6af619523680677cbcd0411ce6db33ae"}
Jul 06 19:29:31.896613 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:31.896596    2576 scope.go:117] "RemoveContainer" containerID="38b71f7e57dd18c36f048551d922781c6af619523680677cbcd0411ce6db33ae"
Jul 06 19:29:32.901422 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:32.901389    2576 generic.go:356] "Generic (PLEG): container finished" podID="445c63a3-5129-4382-ac75-a61c3dc3b4cc" containerID="ccbc87203e9ae71532490933074c19126c7045e964f7c94792d23c5a88225965" exitCode=0
Jul 06 19:29:32.901887 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:32.901464    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4" event={"ID":"445c63a3-5129-4382-ac75-a61c3dc3b4cc","Type":"ContainerDied","Data":"ccbc87203e9ae71532490933074c19126c7045e964f7c94792d23c5a88225965"}
Jul 06 19:29:32.901887 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:32.901789    2576 scope.go:117] "RemoveContainer" containerID="ccbc87203e9ae71532490933074c19126c7045e964f7c94792d23c5a88225965"
Jul 06 19:29:32.903467 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:32.903445    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-pwrxd" event={"ID":"bae2d09b-44d8-4ac6-bccf-e5b54a130b9d","Type":"ContainerStarted","Data":"b2a39b7c08eac8d1dd0caa8a759ace3eda4da07f247308e2d87c260c18e0abab"}
Jul 06 19:29:33.913201 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:29:33.913166    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gz9d4" event={"ID":"445c63a3-5129-4382-ac75-a61c3dc3b4cc","Type":"ContainerStarted","Data":"31c7995ebe8e525df92073ff6c1a04974f7ca41aa551a516bf4699aae90f7620"}
Jul 06 19:32:15.173742 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:32:15.173706    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:32:15.179910 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:32:15.179880    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:32:15.184597 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:32:15.184572    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:33:55.985517 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:55.983034    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"]
Jul 06 19:33:55.985517 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:55.983636    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deefe594-347c-4702-8972-55330d020baf" containerName="registry"
Jul 06 19:33:55.985517 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:55.983657    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="deefe594-347c-4702-8972-55330d020baf" containerName="registry"
Jul 06 19:33:55.985517 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:55.983780    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="deefe594-347c-4702-8972-55330d020baf" containerName="registry"
Jul 06 19:33:55.989026 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:55.989006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:55.992263 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:55.992236    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:33:55.992383 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:55.992301    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:33:55.992383 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:55.992312    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:33:55.992467 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:55.992451    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-csv8h\""
Jul 06 19:33:55.992581 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:55.992565    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:33:56.001734 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.001710    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"]
Jul 06 19:33:56.097985 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.097948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c5e0086-8275-4d1d-afd5-c24f825f52ba-tmp\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.097985 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.097989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c5e0086-8275-4d1d-afd5-c24f825f52ba-webhook-cert\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.098204 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.098102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c5e0086-8275-4d1d-afd5-c24f825f52ba-manifests\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.098204 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.098146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c5e0086-8275-4d1d-afd5-c24f825f52ba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.098204 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.098167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhmxl\" (UniqueName: \"kubernetes.io/projected/4c5e0086-8275-4d1d-afd5-c24f825f52ba-kube-api-access-jhmxl\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.198960 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.198818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c5e0086-8275-4d1d-afd5-c24f825f52ba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.198960 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.198879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhmxl\" (UniqueName: \"kubernetes.io/projected/4c5e0086-8275-4d1d-afd5-c24f825f52ba-kube-api-access-jhmxl\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.198960 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.198950    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c5e0086-8275-4d1d-afd5-c24f825f52ba-tmp\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.199258 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.198979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c5e0086-8275-4d1d-afd5-c24f825f52ba-webhook-cert\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.199258 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.199045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c5e0086-8275-4d1d-afd5-c24f825f52ba-manifests\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.199448 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.199426    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4c5e0086-8275-4d1d-afd5-c24f825f52ba-manifests\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.201322 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.201298    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c5e0086-8275-4d1d-afd5-c24f825f52ba-tmp\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.201508 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.201486    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c5e0086-8275-4d1d-afd5-c24f825f52ba-webhook-cert\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.201627 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.201606    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4c5e0086-8275-4d1d-afd5-c24f825f52ba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.208966 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.208939    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhmxl\" (UniqueName: \"kubernetes.io/projected/4c5e0086-8275-4d1d-afd5-c24f825f52ba-kube-api-access-jhmxl\") pod \"opendatahub-operator-controller-manager-57b585888c-26kfq\" (UID: \"4c5e0086-8275-4d1d-afd5-c24f825f52ba\") " pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.298673 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.298629    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:33:56.438743 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.438714    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"]
Jul 06 19:33:56.441632 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:33:56.441597    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c5e0086_8275_4d1d_afd5_c24f825f52ba.slice/crio-ac61a28fecda9b582b4519c14c4d6daa6d0a3d9d44b47cc079dddd1697c63803 WatchSource:0}: Error finding container ac61a28fecda9b582b4519c14c4d6daa6d0a3d9d44b47cc079dddd1697c63803: Status 404 returned error can't find the container with id ac61a28fecda9b582b4519c14c4d6daa6d0a3d9d44b47cc079dddd1697c63803
Jul 06 19:33:56.443442 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.443420    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:33:56.833114 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:56.833073    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq" event={"ID":"4c5e0086-8275-4d1d-afd5-c24f825f52ba","Type":"ContainerStarted","Data":"ac61a28fecda9b582b4519c14c4d6daa6d0a3d9d44b47cc079dddd1697c63803"}
Jul 06 19:33:59.847429 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:33:59.847389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq" event={"ID":"4c5e0086-8275-4d1d-afd5-c24f825f52ba","Type":"ContainerStarted","Data":"2b522804ef00f705fcba5762864b0399553581d2ad3480d9f9e03a5300510c4c"}
Jul 06 19:34:00.852577 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:00.852483    2576 generic.go:356] "Generic (PLEG): container finished" podID="4c5e0086-8275-4d1d-afd5-c24f825f52ba" containerID="2b522804ef00f705fcba5762864b0399553581d2ad3480d9f9e03a5300510c4c" exitCode=0
Jul 06 19:34:00.852921 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:00.852570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq" event={"ID":"4c5e0086-8275-4d1d-afd5-c24f825f52ba","Type":"ContainerDied","Data":"2b522804ef00f705fcba5762864b0399553581d2ad3480d9f9e03a5300510c4c"}
Jul 06 19:34:01.858741 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:01.858708    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq" event={"ID":"4c5e0086-8275-4d1d-afd5-c24f825f52ba","Type":"ContainerStarted","Data":"1da1903f39a063d14cb7e02e5735ce4ac37bccfc8d54a0bf6f51459e5a023592"}
Jul 06 19:34:01.859162 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:01.858842    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:34:01.890539 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:01.890480    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq" podStartSLOduration=2.473848672 podStartE2EDuration="6.890464037s" totalImagesPullingTime="3.341997253s" totalInitContainerRuntime="1.074618112s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:01.888609857 +0000 UTC m=+407.116602882" watchObservedRunningTime="2026-07-06 19:34:01.890464037 +0000 UTC m=+407.118457040"
Jul 06 19:34:12.864431 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:12.864400    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57b585888c-26kfq"
Jul 06 19:34:15.335500 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.335464    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"]
Jul 06 19:34:15.341614 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.341589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"
Jul 06 19:34:15.346468 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.346438    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 19:34:15.346613 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.346572    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 19:34:15.364152 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.364119    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"]
Jul 06 19:34:15.460759 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.460721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4c52d3-7d23-46d6-bca2-98dbbf17da09-tmp\") pod \"kube-auth-proxy-58f6467984-dt9rt\" (UID: \"6b4c52d3-7d23-46d6-bca2-98dbbf17da09\") " pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"
Jul 06 19:34:15.460993 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.460789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m95w\" (UniqueName: \"kubernetes.io/projected/6b4c52d3-7d23-46d6-bca2-98dbbf17da09-kube-api-access-7m95w\") pod \"kube-auth-proxy-58f6467984-dt9rt\" (UID: \"6b4c52d3-7d23-46d6-bca2-98dbbf17da09\") " pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"
Jul 06 19:34:15.460993 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.460856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b4c52d3-7d23-46d6-bca2-98dbbf17da09-tls-certs\") pod \"kube-auth-proxy-58f6467984-dt9rt\" (UID: \"6b4c52d3-7d23-46d6-bca2-98dbbf17da09\") " pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"
Jul 06 19:34:15.562298 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.562259    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b4c52d3-7d23-46d6-bca2-98dbbf17da09-tls-certs\") pod \"kube-auth-proxy-58f6467984-dt9rt\" (UID: \"6b4c52d3-7d23-46d6-bca2-98dbbf17da09\") " pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"
Jul 06 19:34:15.562498 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.562320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4c52d3-7d23-46d6-bca2-98dbbf17da09-tmp\") pod \"kube-auth-proxy-58f6467984-dt9rt\" (UID: \"6b4c52d3-7d23-46d6-bca2-98dbbf17da09\") " pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"
Jul 06 19:34:15.562498 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.562379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m95w\" (UniqueName: \"kubernetes.io/projected/6b4c52d3-7d23-46d6-bca2-98dbbf17da09-kube-api-access-7m95w\") pod \"kube-auth-proxy-58f6467984-dt9rt\" (UID: \"6b4c52d3-7d23-46d6-bca2-98dbbf17da09\") " pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"
Jul 06 19:34:15.562498 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:34:15.562418    2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 06 19:34:15.562655 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:34:15.562526    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b4c52d3-7d23-46d6-bca2-98dbbf17da09-tls-certs podName:6b4c52d3-7d23-46d6-bca2-98dbbf17da09 nodeName:}" failed. No retries permitted until 2026-07-06 19:34:16.062510239 +0000 UTC m=+421.290503219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6b4c52d3-7d23-46d6-bca2-98dbbf17da09-tls-certs") pod "kube-auth-proxy-58f6467984-dt9rt" (UID: "6b4c52d3-7d23-46d6-bca2-98dbbf17da09") : secret "kube-auth-proxy-tls" not found
Jul 06 19:34:15.564656 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.564627    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b4c52d3-7d23-46d6-bca2-98dbbf17da09-tmp\") pod \"kube-auth-proxy-58f6467984-dt9rt\" (UID: \"6b4c52d3-7d23-46d6-bca2-98dbbf17da09\") " pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"
Jul 06 19:34:15.580372 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.580345    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m95w\" (UniqueName: \"kubernetes.io/projected/6b4c52d3-7d23-46d6-bca2-98dbbf17da09-kube-api-access-7m95w\") pod \"kube-auth-proxy-58f6467984-dt9rt\" (UID: \"6b4c52d3-7d23-46d6-bca2-98dbbf17da09\") " pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"
Jul 06 19:34:15.647014 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.646916    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-slqqq"]
Jul 06 19:34:15.649176 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.649157    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-slqqq"
Jul 06 19:34:15.656117 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.656091    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-l9q99\""
Jul 06 19:34:15.656851 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.656832    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 06 19:34:15.671089 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.671060    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-slqqq"]
Jul 06 19:34:15.764318 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.764281    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wklmh\" (UniqueName: \"kubernetes.io/projected/617844bf-63eb-4b8b-851f-e847e2db57da-kube-api-access-wklmh\") pod \"odh-model-controller-7998c67dc4-slqqq\" (UID: \"617844bf-63eb-4b8b-851f-e847e2db57da\") " pod="opendatahub/odh-model-controller-7998c67dc4-slqqq"
Jul 06 19:34:15.764318 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.764321    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/617844bf-63eb-4b8b-851f-e847e2db57da-cert\") pod \"odh-model-controller-7998c67dc4-slqqq\" (UID: \"617844bf-63eb-4b8b-851f-e847e2db57da\") " pod="opendatahub/odh-model-controller-7998c67dc4-slqqq"
Jul 06 19:34:15.865111 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.865073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wklmh\" (UniqueName: \"kubernetes.io/projected/617844bf-63eb-4b8b-851f-e847e2db57da-kube-api-access-wklmh\") pod \"odh-model-controller-7998c67dc4-slqqq\" (UID: \"617844bf-63eb-4b8b-851f-e847e2db57da\") " pod="opendatahub/odh-model-controller-7998c67dc4-slqqq"
Jul 06 19:34:15.865111 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.865107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/617844bf-63eb-4b8b-851f-e847e2db57da-cert\") pod \"odh-model-controller-7998c67dc4-slqqq\" (UID: \"617844bf-63eb-4b8b-851f-e847e2db57da\") " pod="opendatahub/odh-model-controller-7998c67dc4-slqqq"
Jul 06 19:34:15.865334 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:34:15.865315    2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 06 19:34:15.865380 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:34:15.865373    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/617844bf-63eb-4b8b-851f-e847e2db57da-cert podName:617844bf-63eb-4b8b-851f-e847e2db57da nodeName:}" failed. No retries permitted until 2026-07-06 19:34:16.36535858 +0000 UTC m=+421.593351561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/617844bf-63eb-4b8b-851f-e847e2db57da-cert") pod "odh-model-controller-7998c67dc4-slqqq" (UID: "617844bf-63eb-4b8b-851f-e847e2db57da") : secret "odh-model-controller-webhook-cert" not found
Jul 06 19:34:15.885401 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:15.885370    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wklmh\" (UniqueName: \"kubernetes.io/projected/617844bf-63eb-4b8b-851f-e847e2db57da-kube-api-access-wklmh\") pod \"odh-model-controller-7998c67dc4-slqqq\" (UID: \"617844bf-63eb-4b8b-851f-e847e2db57da\") " pod="opendatahub/odh-model-controller-7998c67dc4-slqqq"
Jul 06 19:34:16.068187 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.068151    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b4c52d3-7d23-46d6-bca2-98dbbf17da09-tls-certs\") pod \"kube-auth-proxy-58f6467984-dt9rt\" (UID: \"6b4c52d3-7d23-46d6-bca2-98dbbf17da09\") " pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"
Jul 06 19:34:16.070590 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.070572    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b4c52d3-7d23-46d6-bca2-98dbbf17da09-tls-certs\") pod \"kube-auth-proxy-58f6467984-dt9rt\" (UID: \"6b4c52d3-7d23-46d6-bca2-98dbbf17da09\") " pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"
Jul 06 19:34:16.250692 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.250652    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"
Jul 06 19:34:16.371542 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.371512    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/617844bf-63eb-4b8b-851f-e847e2db57da-cert\") pod \"odh-model-controller-7998c67dc4-slqqq\" (UID: \"617844bf-63eb-4b8b-851f-e847e2db57da\") " pod="opendatahub/odh-model-controller-7998c67dc4-slqqq"
Jul 06 19:34:16.373881 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.373855    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/617844bf-63eb-4b8b-851f-e847e2db57da-cert\") pod \"odh-model-controller-7998c67dc4-slqqq\" (UID: \"617844bf-63eb-4b8b-851f-e847e2db57da\") " pod="opendatahub/odh-model-controller-7998c67dc4-slqqq"
Jul 06 19:34:16.401249 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.401221    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58f6467984-dt9rt"]
Jul 06 19:34:16.404026 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:34:16.404000    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4c52d3_7d23_46d6_bca2_98dbbf17da09.slice/crio-e6efdc53249d58130a461689d24a787ab83f60e62ae38f8d2d788bfcc28e41dc WatchSource:0}: Error finding container e6efdc53249d58130a461689d24a787ab83f60e62ae38f8d2d788bfcc28e41dc: Status 404 returned error can't find the container with id e6efdc53249d58130a461689d24a787ab83f60e62ae38f8d2d788bfcc28e41dc
Jul 06 19:34:16.559657 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.559611    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-slqqq"
Jul 06 19:34:16.706061 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.702622    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-slqqq"]
Jul 06 19:34:16.706860 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:34:16.706814    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod617844bf_63eb_4b8b_851f_e847e2db57da.slice/crio-43df71a0a911e5a50136110455bc413adad45f41089bd20183bc5040e9b508f2 WatchSource:0}: Error finding container 43df71a0a911e5a50136110455bc413adad45f41089bd20183bc5040e9b508f2: Status 404 returned error can't find the container with id 43df71a0a911e5a50136110455bc413adad45f41089bd20183bc5040e9b508f2
Jul 06 19:34:16.722287 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.722257    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rkrkw"]
Jul 06 19:34:16.725704 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.725684    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw"
Jul 06 19:34:16.737141 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.737119    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 06 19:34:16.781835 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.781800    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rkrkw"]
Jul 06 19:34:16.876740 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.876666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbph5\" (UniqueName: \"kubernetes.io/projected/2364ecbe-fc16-4561-8614-9038f214d43f-kube-api-access-nbph5\") pod \"model-serving-api-54d89bd5fc-rkrkw\" (UID: \"2364ecbe-fc16-4561-8614-9038f214d43f\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw"
Jul 06 19:34:16.876876 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.876735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2364ecbe-fc16-4561-8614-9038f214d43f-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkrkw\" (UID: \"2364ecbe-fc16-4561-8614-9038f214d43f\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw"
Jul 06 19:34:16.918493 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.918456    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt" event={"ID":"6b4c52d3-7d23-46d6-bca2-98dbbf17da09","Type":"ContainerStarted","Data":"e6efdc53249d58130a461689d24a787ab83f60e62ae38f8d2d788bfcc28e41dc"}
Jul 06 19:34:16.919436 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.919412    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-slqqq" event={"ID":"617844bf-63eb-4b8b-851f-e847e2db57da","Type":"ContainerStarted","Data":"43df71a0a911e5a50136110455bc413adad45f41089bd20183bc5040e9b508f2"}
Jul 06 19:34:16.977876 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.977837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbph5\" (UniqueName: \"kubernetes.io/projected/2364ecbe-fc16-4561-8614-9038f214d43f-kube-api-access-nbph5\") pod \"model-serving-api-54d89bd5fc-rkrkw\" (UID: \"2364ecbe-fc16-4561-8614-9038f214d43f\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw"
Jul 06 19:34:16.978077 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.977906    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2364ecbe-fc16-4561-8614-9038f214d43f-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkrkw\" (UID: \"2364ecbe-fc16-4561-8614-9038f214d43f\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw"
Jul 06 19:34:16.978077 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:34:16.978027    2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 06 19:34:16.978157 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:34:16.978081    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2364ecbe-fc16-4561-8614-9038f214d43f-tls-certs podName:2364ecbe-fc16-4561-8614-9038f214d43f nodeName:}" failed. No retries permitted until 2026-07-06 19:34:17.478063385 +0000 UTC m=+422.706056366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2364ecbe-fc16-4561-8614-9038f214d43f-tls-certs") pod "model-serving-api-54d89bd5fc-rkrkw" (UID: "2364ecbe-fc16-4561-8614-9038f214d43f") : secret "model-serving-api-tls" not found
Jul 06 19:34:16.999790 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:16.999756    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbph5\" (UniqueName: \"kubernetes.io/projected/2364ecbe-fc16-4561-8614-9038f214d43f-kube-api-access-nbph5\") pod \"model-serving-api-54d89bd5fc-rkrkw\" (UID: \"2364ecbe-fc16-4561-8614-9038f214d43f\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw"
Jul 06 19:34:17.269374 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.269338    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"]
Jul 06 19:34:17.272398 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.272377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.275729 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.275701    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 19:34:17.276610 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.276586    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zfg8p\""
Jul 06 19:34:17.276785 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.276768    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 19:34:17.277179 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.277159    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 19:34:17.277337 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.277218    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 19:34:17.277412 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.277380    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:34:17.295400 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.295369    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"]
Jul 06 19:34:17.381261 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.381228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/727fec8c-1d46-4709-90ab-0559476fab3c-manager-config\") pod \"lws-controller-manager-7b7d6b4d5f-q7ftm\" (UID: \"727fec8c-1d46-4709-90ab-0559476fab3c\") " pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.381647 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.381274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/727fec8c-1d46-4709-90ab-0559476fab3c-cert\") pod \"lws-controller-manager-7b7d6b4d5f-q7ftm\" (UID: \"727fec8c-1d46-4709-90ab-0559476fab3c\") " pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.381647 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.381391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjl5f\" (UniqueName: \"kubernetes.io/projected/727fec8c-1d46-4709-90ab-0559476fab3c-kube-api-access-mjl5f\") pod \"lws-controller-manager-7b7d6b4d5f-q7ftm\" (UID: \"727fec8c-1d46-4709-90ab-0559476fab3c\") " pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.381647 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.381415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/727fec8c-1d46-4709-90ab-0559476fab3c-metrics-cert\") pod \"lws-controller-manager-7b7d6b4d5f-q7ftm\" (UID: \"727fec8c-1d46-4709-90ab-0559476fab3c\") " pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.482843 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.482803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/727fec8c-1d46-4709-90ab-0559476fab3c-manager-config\") pod \"lws-controller-manager-7b7d6b4d5f-q7ftm\" (UID: \"727fec8c-1d46-4709-90ab-0559476fab3c\") " pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.482843 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.482848    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/727fec8c-1d46-4709-90ab-0559476fab3c-cert\") pod \"lws-controller-manager-7b7d6b4d5f-q7ftm\" (UID: \"727fec8c-1d46-4709-90ab-0559476fab3c\") " pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.483158 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.482949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2364ecbe-fc16-4561-8614-9038f214d43f-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkrkw\" (UID: \"2364ecbe-fc16-4561-8614-9038f214d43f\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw"
Jul 06 19:34:17.483158 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.482976    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjl5f\" (UniqueName: \"kubernetes.io/projected/727fec8c-1d46-4709-90ab-0559476fab3c-kube-api-access-mjl5f\") pod \"lws-controller-manager-7b7d6b4d5f-q7ftm\" (UID: \"727fec8c-1d46-4709-90ab-0559476fab3c\") " pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.483158 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.483005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/727fec8c-1d46-4709-90ab-0559476fab3c-metrics-cert\") pod \"lws-controller-manager-7b7d6b4d5f-q7ftm\" (UID: \"727fec8c-1d46-4709-90ab-0559476fab3c\") " pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.483158 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:34:17.483120    2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 06 19:34:17.483362 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:34:17.483189    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2364ecbe-fc16-4561-8614-9038f214d43f-tls-certs podName:2364ecbe-fc16-4561-8614-9038f214d43f nodeName:}" failed. No retries permitted until 2026-07-06 19:34:18.48316821 +0000 UTC m=+423.711161200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2364ecbe-fc16-4561-8614-9038f214d43f-tls-certs") pod "model-serving-api-54d89bd5fc-rkrkw" (UID: "2364ecbe-fc16-4561-8614-9038f214d43f") : secret "model-serving-api-tls" not found
Jul 06 19:34:17.483644 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.483608    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/727fec8c-1d46-4709-90ab-0559476fab3c-manager-config\") pod \"lws-controller-manager-7b7d6b4d5f-q7ftm\" (UID: \"727fec8c-1d46-4709-90ab-0559476fab3c\") " pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.485892 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.485865    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/727fec8c-1d46-4709-90ab-0559476fab3c-metrics-cert\") pod \"lws-controller-manager-7b7d6b4d5f-q7ftm\" (UID: \"727fec8c-1d46-4709-90ab-0559476fab3c\") " pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.486001 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.485981    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/727fec8c-1d46-4709-90ab-0559476fab3c-cert\") pod \"lws-controller-manager-7b7d6b4d5f-q7ftm\" (UID: \"727fec8c-1d46-4709-90ab-0559476fab3c\") " pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.500498 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.500467    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjl5f\" (UniqueName: \"kubernetes.io/projected/727fec8c-1d46-4709-90ab-0559476fab3c-kube-api-access-mjl5f\") pod \"lws-controller-manager-7b7d6b4d5f-q7ftm\" (UID: \"727fec8c-1d46-4709-90ab-0559476fab3c\") " pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.584179 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.584089    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:17.755724 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.755687    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"]
Jul 06 19:34:17.758288 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:34:17.758253    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727fec8c_1d46_4709_90ab_0559476fab3c.slice/crio-3da245d9aa87cd60afd95914086c205f738a116d9a93341efd800f791c7cbb6b WatchSource:0}: Error finding container 3da245d9aa87cd60afd95914086c205f738a116d9a93341efd800f791c7cbb6b: Status 404 returned error can't find the container with id 3da245d9aa87cd60afd95914086c205f738a116d9a93341efd800f791c7cbb6b
Jul 06 19:34:17.926568 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:17.926477    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm" event={"ID":"727fec8c-1d46-4709-90ab-0559476fab3c","Type":"ContainerStarted","Data":"3da245d9aa87cd60afd95914086c205f738a116d9a93341efd800f791c7cbb6b"}
Jul 06 19:34:18.491263 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:18.491220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2364ecbe-fc16-4561-8614-9038f214d43f-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkrkw\" (UID: \"2364ecbe-fc16-4561-8614-9038f214d43f\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw"
Jul 06 19:34:18.498132 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:18.498103    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2364ecbe-fc16-4561-8614-9038f214d43f-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkrkw\" (UID: \"2364ecbe-fc16-4561-8614-9038f214d43f\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw"
Jul 06 19:34:18.535994 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:18.535956    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw"
Jul 06 19:34:18.734978 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:18.734941    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rkrkw"]
Jul 06 19:34:18.936735 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:18.936659    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw" event={"ID":"2364ecbe-fc16-4561-8614-9038f214d43f","Type":"ContainerStarted","Data":"ec2944b33ffbede2605790cf942c9eecf014226dbc72aeb3aaa420f78db92cdd"}
Jul 06 19:34:22.961371 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:22.961331    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt" event={"ID":"6b4c52d3-7d23-46d6-bca2-98dbbf17da09","Type":"ContainerStarted","Data":"9469d61c1613e29ba01ba5c6efa886e17cf3aa6c9e2b10bc5f86bf914a901e9c"}
Jul 06 19:34:22.962799 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:22.962767    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm" event={"ID":"727fec8c-1d46-4709-90ab-0559476fab3c","Type":"ContainerStarted","Data":"17b484a8c1e7a3a96fc479a4bebed4f8fcf17fcdb62fbd821e98434c7f0491e7"}
Jul 06 19:34:22.962975 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:22.962835    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:22.964142 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:22.964113    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-slqqq" event={"ID":"617844bf-63eb-4b8b-851f-e847e2db57da","Type":"ContainerStarted","Data":"1a69aec90f74fae26a7f01112c86c16ab7a49a052eabf283177d3a9f2ddeb5f2"}
Jul 06 19:34:22.964246 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:22.964167    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-slqqq"
Jul 06 19:34:22.965479 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:22.965459    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw" event={"ID":"2364ecbe-fc16-4561-8614-9038f214d43f","Type":"ContainerStarted","Data":"4c8dfd834fd18a064e67328a66c588fdad0bd0053f1d3062c7854b24c5cce4ad"}
Jul 06 19:34:22.965560 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:22.965536    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw"
Jul 06 19:34:22.985046 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:22.984986    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58f6467984-dt9rt" podStartSLOduration=2.103680356 podStartE2EDuration="7.984964745s" totalImagesPullingTime="5.881284389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:22.982959365 +0000 UTC m=+428.210952378" watchObservedRunningTime="2026-07-06 19:34:22.984964745 +0000 UTC m=+428.212957753"
Jul 06 19:34:23.004028 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:23.003964    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm" podStartSLOduration=1.466459159 podStartE2EDuration="6.003943839s" totalImagesPullingTime="4.53748468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:23.003444261 +0000 UTC m=+428.231437281" watchObservedRunningTime="2026-07-06 19:34:23.003943839 +0000 UTC m=+428.231936843"
Jul 06 19:34:23.026795 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:23.026733    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-slqqq" podStartSLOduration=2.441422353 podStartE2EDuration="8.026719319s" totalImagesPullingTime="5.585296966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:23.025864762 +0000 UTC m=+428.253857787" watchObservedRunningTime="2026-07-06 19:34:23.026719319 +0000 UTC m=+428.254712321"
Jul 06 19:34:23.047537 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:23.047474    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw" podStartSLOduration=3.492905612 podStartE2EDuration="7.0474507s" totalImagesPullingTime="3.554545088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:23.046764282 +0000 UTC m=+428.274757286" watchObservedRunningTime="2026-07-06 19:34:23.0474507 +0000 UTC m=+428.275443705"
Jul 06 19:34:33.973114 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:33.973072    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b7d6b4d5f-q7ftm"
Jul 06 19:34:33.973650 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:33.973153    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-slqqq"
Jul 06 19:34:33.976793 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:34:33.976770    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-rkrkw"
Jul 06 19:37:08.347399 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.347360    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:37:08.350649 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.350629    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"
Jul 06 19:37:08.353422 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.353392    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bvtdd\""
Jul 06 19:37:08.353564 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.353480    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:37:08.354647 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.354617    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:37:08.354647 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.354617    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 19:37:08.361872 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.361852    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:37:08.390646 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.390609    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:37:08.493562 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.493522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2a9cc63-c58d-4592-93a8-e21da42bb242-config-file\") pod \"limitador-limitador-54d6d988d5-vjgqc\" (UID: \"c2a9cc63-c58d-4592-93a8-e21da42bb242\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"
Jul 06 19:37:08.493729 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.493604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rznp\" (UniqueName: \"kubernetes.io/projected/c2a9cc63-c58d-4592-93a8-e21da42bb242-kube-api-access-9rznp\") pod \"limitador-limitador-54d6d988d5-vjgqc\" (UID: \"c2a9cc63-c58d-4592-93a8-e21da42bb242\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"
Jul 06 19:37:08.594781 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.594745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rznp\" (UniqueName: \"kubernetes.io/projected/c2a9cc63-c58d-4592-93a8-e21da42bb242-kube-api-access-9rznp\") pod \"limitador-limitador-54d6d988d5-vjgqc\" (UID: \"c2a9cc63-c58d-4592-93a8-e21da42bb242\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"
Jul 06 19:37:08.594999 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.594798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2a9cc63-c58d-4592-93a8-e21da42bb242-config-file\") pod \"limitador-limitador-54d6d988d5-vjgqc\" (UID: \"c2a9cc63-c58d-4592-93a8-e21da42bb242\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"
Jul 06 19:37:08.595386 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.595367    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c2a9cc63-c58d-4592-93a8-e21da42bb242-config-file\") pod \"limitador-limitador-54d6d988d5-vjgqc\" (UID: \"c2a9cc63-c58d-4592-93a8-e21da42bb242\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"
Jul 06 19:37:08.603486 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.603427    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rznp\" (UniqueName: \"kubernetes.io/projected/c2a9cc63-c58d-4592-93a8-e21da42bb242-kube-api-access-9rznp\") pod \"limitador-limitador-54d6d988d5-vjgqc\" (UID: \"c2a9cc63-c58d-4592-93a8-e21da42bb242\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"
Jul 06 19:37:08.660547 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.660502    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"
Jul 06 19:37:08.713018 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.712989    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-942kc"]
Jul 06 19:37:08.717547 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.717525    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-942kc"
Jul 06 19:37:08.723541 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.723486    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kts8m\""
Jul 06 19:37:08.735266 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.735215    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-942kc"]
Jul 06 19:37:08.796564 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.796515    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml6kz\" (UniqueName: \"kubernetes.io/projected/db78211d-f02f-493a-9e80-42ea41f0feca-kube-api-access-ml6kz\") pod \"authorino-58cd955675-942kc\" (UID: \"db78211d-f02f-493a-9e80-42ea41f0feca\") " pod="kuadrant-system/authorino-58cd955675-942kc"
Jul 06 19:37:08.799152 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.799119    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:37:08.802251 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:37:08.802225    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a9cc63_c58d_4592_93a8_e21da42bb242.slice/crio-d1ec4923824ad12806914457aa89058977264be912e57e35577db1cf8e9ecc5c WatchSource:0}: Error finding container d1ec4923824ad12806914457aa89058977264be912e57e35577db1cf8e9ecc5c: Status 404 returned error can't find the container with id d1ec4923824ad12806914457aa89058977264be912e57e35577db1cf8e9ecc5c
Jul 06 19:37:08.902251 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.897864    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6kz\" (UniqueName: \"kubernetes.io/projected/db78211d-f02f-493a-9e80-42ea41f0feca-kube-api-access-ml6kz\") pod \"authorino-58cd955675-942kc\" (UID: \"db78211d-f02f-493a-9e80-42ea41f0feca\") " pod="kuadrant-system/authorino-58cd955675-942kc"
Jul 06 19:37:08.908330 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:08.908301    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml6kz\" (UniqueName: \"kubernetes.io/projected/db78211d-f02f-493a-9e80-42ea41f0feca-kube-api-access-ml6kz\") pod \"authorino-58cd955675-942kc\" (UID: \"db78211d-f02f-493a-9e80-42ea41f0feca\") " pod="kuadrant-system/authorino-58cd955675-942kc"
Jul 06 19:37:09.030531 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:09.030492    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-942kc"
Jul 06 19:37:09.163648 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:09.163586    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-942kc"]
Jul 06 19:37:09.166110 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:37:09.166085    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb78211d_f02f_493a_9e80_42ea41f0feca.slice/crio-43098f01a447c0cfcbd0e73eb2582bbeac50147dd648b5d68032a34ccfd9e3ef WatchSource:0}: Error finding container 43098f01a447c0cfcbd0e73eb2582bbeac50147dd648b5d68032a34ccfd9e3ef: Status 404 returned error can't find the container with id 43098f01a447c0cfcbd0e73eb2582bbeac50147dd648b5d68032a34ccfd9e3ef
Jul 06 19:37:09.640689 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:09.640643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vjgqc" event={"ID":"c2a9cc63-c58d-4592-93a8-e21da42bb242","Type":"ContainerStarted","Data":"d1ec4923824ad12806914457aa89058977264be912e57e35577db1cf8e9ecc5c"}
Jul 06 19:37:09.642050 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:09.642018    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-942kc" event={"ID":"db78211d-f02f-493a-9e80-42ea41f0feca","Type":"ContainerStarted","Data":"43098f01a447c0cfcbd0e73eb2582bbeac50147dd648b5d68032a34ccfd9e3ef"}
Jul 06 19:37:13.577240 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:13.577154    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-942kc"]
Jul 06 19:37:13.665368 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:13.665333    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-942kc" event={"ID":"db78211d-f02f-493a-9e80-42ea41f0feca","Type":"ContainerStarted","Data":"25ba8d32cf45f0629948b79073b6296e9e0f13ca32c7ea8ea0f1112ede61a7de"}
Jul 06 19:37:13.666774 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:13.666747    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-vjgqc" event={"ID":"c2a9cc63-c58d-4592-93a8-e21da42bb242","Type":"ContainerStarted","Data":"60bd0dae23b0d601abc26c1e7667b43232ba9489260d00dc2ad4c4fa77ccce4d"}
Jul 06 19:37:13.666918 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:13.666894    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"
Jul 06 19:37:13.682197 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:13.682151    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-942kc" podStartSLOduration=1.6216053910000001 podStartE2EDuration="5.682135371s" totalImagesPullingTime="4.06052998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:13.681434495 +0000 UTC m=+598.909427499" watchObservedRunningTime="2026-07-06 19:37:13.682135371 +0000 UTC m=+598.910128373"
Jul 06 19:37:13.698915 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:13.698860    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-vjgqc" podStartSLOduration=1.282118095 podStartE2EDuration="5.698843748s" totalImagesPullingTime="4.416725653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:13.698307319 +0000 UTC m=+598.926300326" watchObservedRunningTime="2026-07-06 19:37:13.698843748 +0000 UTC m=+598.926836750"
Jul 06 19:37:14.671055 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:14.670992    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-942kc" podUID="db78211d-f02f-493a-9e80-42ea41f0feca" containerName="authorino" containerID="cri-o://25ba8d32cf45f0629948b79073b6296e9e0f13ca32c7ea8ea0f1112ede61a7de" gracePeriod=30
Jul 06 19:37:14.917219 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:14.917193    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-942kc"
Jul 06 19:37:15.058413 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.058378    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml6kz\" (UniqueName: \"kubernetes.io/projected/db78211d-f02f-493a-9e80-42ea41f0feca-kube-api-access-ml6kz\") pod \"db78211d-f02f-493a-9e80-42ea41f0feca\" (UID: \"db78211d-f02f-493a-9e80-42ea41f0feca\") "
Jul 06 19:37:15.060496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.060467    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db78211d-f02f-493a-9e80-42ea41f0feca-kube-api-access-ml6kz" (OuterVolumeSpecName: "kube-api-access-ml6kz") pod "db78211d-f02f-493a-9e80-42ea41f0feca" (UID: "db78211d-f02f-493a-9e80-42ea41f0feca"). InnerVolumeSpecName "kube-api-access-ml6kz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:37:15.159456 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.159420    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml6kz\" (UniqueName: \"kubernetes.io/projected/db78211d-f02f-493a-9e80-42ea41f0feca-kube-api-access-ml6kz\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:37:15.204575 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.204547    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:37:15.208174 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.207841    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:37:15.675937 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.675901    2576 generic.go:356] "Generic (PLEG): container finished" podID="db78211d-f02f-493a-9e80-42ea41f0feca" containerID="25ba8d32cf45f0629948b79073b6296e9e0f13ca32c7ea8ea0f1112ede61a7de" exitCode=0
Jul 06 19:37:15.676398 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.675971    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-942kc"
Jul 06 19:37:15.676398 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.675988    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-942kc" event={"ID":"db78211d-f02f-493a-9e80-42ea41f0feca","Type":"ContainerDied","Data":"25ba8d32cf45f0629948b79073b6296e9e0f13ca32c7ea8ea0f1112ede61a7de"}
Jul 06 19:37:15.676398 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.676043    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-942kc" event={"ID":"db78211d-f02f-493a-9e80-42ea41f0feca","Type":"ContainerDied","Data":"43098f01a447c0cfcbd0e73eb2582bbeac50147dd648b5d68032a34ccfd9e3ef"}
Jul 06 19:37:15.676398 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.676067    2576 scope.go:117] "RemoveContainer" containerID="25ba8d32cf45f0629948b79073b6296e9e0f13ca32c7ea8ea0f1112ede61a7de"
Jul 06 19:37:15.684099 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.684082    2576 scope.go:117] "RemoveContainer" containerID="25ba8d32cf45f0629948b79073b6296e9e0f13ca32c7ea8ea0f1112ede61a7de"
Jul 06 19:37:15.684375 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:37:15.684355    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25ba8d32cf45f0629948b79073b6296e9e0f13ca32c7ea8ea0f1112ede61a7de\": container with ID starting with 25ba8d32cf45f0629948b79073b6296e9e0f13ca32c7ea8ea0f1112ede61a7de not found: ID does not exist" containerID="25ba8d32cf45f0629948b79073b6296e9e0f13ca32c7ea8ea0f1112ede61a7de"
Jul 06 19:37:15.684424 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.684384    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25ba8d32cf45f0629948b79073b6296e9e0f13ca32c7ea8ea0f1112ede61a7de"} err="failed to get container status \"25ba8d32cf45f0629948b79073b6296e9e0f13ca32c7ea8ea0f1112ede61a7de\": rpc error: code = NotFound desc = could not find container \"25ba8d32cf45f0629948b79073b6296e9e0f13ca32c7ea8ea0f1112ede61a7de\": container with ID starting with 25ba8d32cf45f0629948b79073b6296e9e0f13ca32c7ea8ea0f1112ede61a7de not found: ID does not exist"
Jul 06 19:37:15.698638 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.698606    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-942kc"]
Jul 06 19:37:15.703785 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:15.703759    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-942kc"]
Jul 06 19:37:17.284030 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:17.283998    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db78211d-f02f-493a-9e80-42ea41f0feca" path="/var/lib/kubelet/pods/db78211d-f02f-493a-9e80-42ea41f0feca/volumes"
Jul 06 19:37:24.672298 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:24.672267    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"
Jul 06 19:37:40.259376 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.259292    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-92tsx"]
Jul 06 19:37:40.259865 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.259620    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db78211d-f02f-493a-9e80-42ea41f0feca" containerName="authorino"
Jul 06 19:37:40.259865 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.259632    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="db78211d-f02f-493a-9e80-42ea41f0feca" containerName="authorino"
Jul 06 19:37:40.259865 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.259687    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="db78211d-f02f-493a-9e80-42ea41f0feca" containerName="authorino"
Jul 06 19:37:40.261668 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.261652    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-92tsx"
Jul 06 19:37:40.264368 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.264347    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kts8m\""
Jul 06 19:37:40.270961 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.270919    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-92tsx"]
Jul 06 19:37:40.346584 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.346539    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhm7j\" (UniqueName: \"kubernetes.io/projected/7100279c-463f-4c19-b3d2-7cdc28675603-kube-api-access-jhm7j\") pod \"authorino-5d4b67c446-92tsx\" (UID: \"7100279c-463f-4c19-b3d2-7cdc28675603\") " pod="kuadrant-system/authorino-5d4b67c446-92tsx"
Jul 06 19:37:40.447632 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.447593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhm7j\" (UniqueName: \"kubernetes.io/projected/7100279c-463f-4c19-b3d2-7cdc28675603-kube-api-access-jhm7j\") pod \"authorino-5d4b67c446-92tsx\" (UID: \"7100279c-463f-4c19-b3d2-7cdc28675603\") " pod="kuadrant-system/authorino-5d4b67c446-92tsx"
Jul 06 19:37:40.456577 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.456543    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhm7j\" (UniqueName: \"kubernetes.io/projected/7100279c-463f-4c19-b3d2-7cdc28675603-kube-api-access-jhm7j\") pod \"authorino-5d4b67c446-92tsx\" (UID: \"7100279c-463f-4c19-b3d2-7cdc28675603\") " pod="kuadrant-system/authorino-5d4b67c446-92tsx"
Jul 06 19:37:40.503155 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.503118    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-92tsx"]
Jul 06 19:37:40.503396 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.503382    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-92tsx"
Jul 06 19:37:40.636621 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.636597    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-92tsx"]
Jul 06 19:37:40.639201 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:37:40.639173    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7100279c_463f_4c19_b3d2_7cdc28675603.slice/crio-19b1ab4318d92fa1fd8d5dd495ded6f09c4434733b63fabed6412ebf0ded6fd5 WatchSource:0}: Error finding container 19b1ab4318d92fa1fd8d5dd495ded6f09c4434733b63fabed6412ebf0ded6fd5: Status 404 returned error can't find the container with id 19b1ab4318d92fa1fd8d5dd495ded6f09c4434733b63fabed6412ebf0ded6fd5
Jul 06 19:37:40.778523 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.778434    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-92tsx" event={"ID":"7100279c-463f-4c19-b3d2-7cdc28675603","Type":"ContainerStarted","Data":"19b1ab4318d92fa1fd8d5dd495ded6f09c4434733b63fabed6412ebf0ded6fd5"}
Jul 06 19:37:40.813089 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.813052    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-787bf4c858-fqm9r"]
Jul 06 19:37:40.815809 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.815790    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-787bf4c858-fqm9r"
Jul 06 19:37:40.818668 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.818646    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 06 19:37:40.825066 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.825040    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-787bf4c858-fqm9r"]
Jul 06 19:37:40.850574 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.850544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4569aad-941b-458a-a7ed-cfc329323d26-tls-cert\") pod \"authorino-787bf4c858-fqm9r\" (UID: \"b4569aad-941b-458a-a7ed-cfc329323d26\") " pod="kuadrant-system/authorino-787bf4c858-fqm9r"
Jul 06 19:37:40.850716 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.850581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chhlc\" (UniqueName: \"kubernetes.io/projected/b4569aad-941b-458a-a7ed-cfc329323d26-kube-api-access-chhlc\") pod \"authorino-787bf4c858-fqm9r\" (UID: \"b4569aad-941b-458a-a7ed-cfc329323d26\") " pod="kuadrant-system/authorino-787bf4c858-fqm9r"
Jul 06 19:37:40.951197 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.951159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4569aad-941b-458a-a7ed-cfc329323d26-tls-cert\") pod \"authorino-787bf4c858-fqm9r\" (UID: \"b4569aad-941b-458a-a7ed-cfc329323d26\") " pod="kuadrant-system/authorino-787bf4c858-fqm9r"
Jul 06 19:37:40.951373 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.951206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chhlc\" (UniqueName: \"kubernetes.io/projected/b4569aad-941b-458a-a7ed-cfc329323d26-kube-api-access-chhlc\") pod \"authorino-787bf4c858-fqm9r\" (UID: \"b4569aad-941b-458a-a7ed-cfc329323d26\") " pod="kuadrant-system/authorino-787bf4c858-fqm9r"
Jul 06 19:37:40.953614 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.953580    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4569aad-941b-458a-a7ed-cfc329323d26-tls-cert\") pod \"authorino-787bf4c858-fqm9r\" (UID: \"b4569aad-941b-458a-a7ed-cfc329323d26\") " pod="kuadrant-system/authorino-787bf4c858-fqm9r"
Jul 06 19:37:40.965336 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:40.965309    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chhlc\" (UniqueName: \"kubernetes.io/projected/b4569aad-941b-458a-a7ed-cfc329323d26-kube-api-access-chhlc\") pod \"authorino-787bf4c858-fqm9r\" (UID: \"b4569aad-941b-458a-a7ed-cfc329323d26\") " pod="kuadrant-system/authorino-787bf4c858-fqm9r"
Jul 06 19:37:41.125784 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:41.125742    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-787bf4c858-fqm9r"
Jul 06 19:37:41.282569 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:37:41.282487    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4569aad_941b_458a_a7ed_cfc329323d26.slice/crio-0a84211fe04a3040a05b306d84de06316a714c694f28a24f0dc3b713404feb68 WatchSource:0}: Error finding container 0a84211fe04a3040a05b306d84de06316a714c694f28a24f0dc3b713404feb68: Status 404 returned error can't find the container with id 0a84211fe04a3040a05b306d84de06316a714c694f28a24f0dc3b713404feb68
Jul 06 19:37:41.284896 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:41.284878    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-787bf4c858-fqm9r"]
Jul 06 19:37:41.783911 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:41.783864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-787bf4c858-fqm9r" event={"ID":"b4569aad-941b-458a-a7ed-cfc329323d26","Type":"ContainerStarted","Data":"29530650c3afe457ae7148625c69c0a37398143722cb839b0034dd2949c90d14"}
Jul 06 19:37:41.783911 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:41.783918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-787bf4c858-fqm9r" event={"ID":"b4569aad-941b-458a-a7ed-cfc329323d26","Type":"ContainerStarted","Data":"0a84211fe04a3040a05b306d84de06316a714c694f28a24f0dc3b713404feb68"}
Jul 06 19:37:41.785310 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:41.785284    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-92tsx" event={"ID":"7100279c-463f-4c19-b3d2-7cdc28675603","Type":"ContainerStarted","Data":"dccc101cf9f46e82978df8ed3414e942fdffdca5d1f36bfd54df812eb12afbd3"}
Jul 06 19:37:41.785424 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:41.785351    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-92tsx" podUID="7100279c-463f-4c19-b3d2-7cdc28675603" containerName="authorino" containerID="cri-o://dccc101cf9f46e82978df8ed3414e942fdffdca5d1f36bfd54df812eb12afbd3" gracePeriod=30
Jul 06 19:37:41.803224 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:41.803180    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-787bf4c858-fqm9r" podStartSLOduration=1.4632062989999999 podStartE2EDuration="1.803163596s" totalImagesPullingTime="339.957297ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:41.802549109 +0000 UTC m=+627.030542113" watchObservedRunningTime="2026-07-06 19:37:41.803163596 +0000 UTC m=+627.031156599"
Jul 06 19:37:41.819665 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:41.819606    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-92tsx" podStartSLOduration=1.466428702 podStartE2EDuration="1.819583853s" totalImagesPullingTime="353.155151ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:41.819231236 +0000 UTC m=+627.047224241" watchObservedRunningTime="2026-07-06 19:37:41.819583853 +0000 UTC m=+627.047576859"
Jul 06 19:37:42.017081 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:42.017055    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-92tsx"
Jul 06 19:37:42.060523 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:42.060494    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhm7j\" (UniqueName: \"kubernetes.io/projected/7100279c-463f-4c19-b3d2-7cdc28675603-kube-api-access-jhm7j\") pod \"7100279c-463f-4c19-b3d2-7cdc28675603\" (UID: \"7100279c-463f-4c19-b3d2-7cdc28675603\") "
Jul 06 19:37:42.062603 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:42.062576    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7100279c-463f-4c19-b3d2-7cdc28675603-kube-api-access-jhm7j" (OuterVolumeSpecName: "kube-api-access-jhm7j") pod "7100279c-463f-4c19-b3d2-7cdc28675603" (UID: "7100279c-463f-4c19-b3d2-7cdc28675603"). InnerVolumeSpecName "kube-api-access-jhm7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:37:42.161317 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:42.161225    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhm7j\" (UniqueName: \"kubernetes.io/projected/7100279c-463f-4c19-b3d2-7cdc28675603-kube-api-access-jhm7j\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:37:42.790825 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:42.790737    2576 generic.go:356] "Generic (PLEG): container finished" podID="7100279c-463f-4c19-b3d2-7cdc28675603" containerID="dccc101cf9f46e82978df8ed3414e942fdffdca5d1f36bfd54df812eb12afbd3" exitCode=0
Jul 06 19:37:42.790825 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:42.790785    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-92tsx"
Jul 06 19:37:42.791329 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:42.790823    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-92tsx" event={"ID":"7100279c-463f-4c19-b3d2-7cdc28675603","Type":"ContainerDied","Data":"dccc101cf9f46e82978df8ed3414e942fdffdca5d1f36bfd54df812eb12afbd3"}
Jul 06 19:37:42.791329 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:42.790866    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-92tsx" event={"ID":"7100279c-463f-4c19-b3d2-7cdc28675603","Type":"ContainerDied","Data":"19b1ab4318d92fa1fd8d5dd495ded6f09c4434733b63fabed6412ebf0ded6fd5"}
Jul 06 19:37:42.791329 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:42.790884    2576 scope.go:117] "RemoveContainer" containerID="dccc101cf9f46e82978df8ed3414e942fdffdca5d1f36bfd54df812eb12afbd3"
Jul 06 19:37:42.799084 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:42.799066    2576 scope.go:117] "RemoveContainer" containerID="dccc101cf9f46e82978df8ed3414e942fdffdca5d1f36bfd54df812eb12afbd3"
Jul 06 19:37:42.799356 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:37:42.799340    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dccc101cf9f46e82978df8ed3414e942fdffdca5d1f36bfd54df812eb12afbd3\": container with ID starting with dccc101cf9f46e82978df8ed3414e942fdffdca5d1f36bfd54df812eb12afbd3 not found: ID does not exist" containerID="dccc101cf9f46e82978df8ed3414e942fdffdca5d1f36bfd54df812eb12afbd3"
Jul 06 19:37:42.799420 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:42.799363    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dccc101cf9f46e82978df8ed3414e942fdffdca5d1f36bfd54df812eb12afbd3"} err="failed to get container status \"dccc101cf9f46e82978df8ed3414e942fdffdca5d1f36bfd54df812eb12afbd3\": rpc error: code = NotFound desc = could not find container \"dccc101cf9f46e82978df8ed3414e942fdffdca5d1f36bfd54df812eb12afbd3\": container with ID starting with dccc101cf9f46e82978df8ed3414e942fdffdca5d1f36bfd54df812eb12afbd3 not found: ID does not exist"
Jul 06 19:37:42.812913 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:42.812887    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-92tsx"]
Jul 06 19:37:42.819117 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:42.819095    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-92tsx"]
Jul 06 19:37:43.283867 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:37:43.283831    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7100279c-463f-4c19-b3d2-7cdc28675603" path="/var/lib/kubelet/pods/7100279c-463f-4c19-b3d2-7cdc28675603/volumes"
Jul 06 19:38:19.460793 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:38:19.460761    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:38:34.701477 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:38:34.701433    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:38:43.610357 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:38:43.610320    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:38:57.197291 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:38:57.197246    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:39:02.506482 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:02.506446    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:39:23.816480 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:23.816381    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:39:39.513566 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.513523    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"]
Jul 06 19:39:39.514039 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.513850    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7100279c-463f-4c19-b3d2-7cdc28675603" containerName="authorino"
Jul 06 19:39:39.514039 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.513861    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7100279c-463f-4c19-b3d2-7cdc28675603" containerName="authorino"
Jul 06 19:39:39.514039 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.513940    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7100279c-463f-4c19-b3d2-7cdc28675603" containerName="authorino"
Jul 06 19:39:39.515739 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.515722    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.518442 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.518420    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 19:39:39.519690 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.519672    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 19:39:39.519780 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.519706    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 19:39:39.519780 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.519759    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fkdk9\""
Jul 06 19:39:39.535448 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.535425    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"]
Jul 06 19:39:39.567720 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.567689    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.567919 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.567750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.567919 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.567820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.567919 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.567852    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.567919 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.567891    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4frdd\" (UniqueName: \"kubernetes.io/projected/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-kube-api-access-4frdd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.568094 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.567946    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.669268 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.669230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.669403 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.669294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.669403 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.669345    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.669505 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.669399    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.669505 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.669443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4frdd\" (UniqueName: \"kubernetes.io/projected/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-kube-api-access-4frdd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.669505 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.669467    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.669741 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.669716    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.669866 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.669781    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.669909 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.669894    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.671646 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.671616    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.671851 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.671830    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.678864 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.678842    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4frdd\" (UniqueName: \"kubernetes.io/projected/be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa-kube-api-access-4frdd\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg\" (UID: \"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.824664 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.824553    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:39.964541 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.964515    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"]
Jul 06 19:39:39.967048 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:39:39.967019    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe1358c0_4b2d_47ba_8ccd_d5f2dc8c54aa.slice/crio-5e09b89c34b16928bd782d9d8be1504941892bf71126f962e2f3a2ca51a762a0 WatchSource:0}: Error finding container 5e09b89c34b16928bd782d9d8be1504941892bf71126f962e2f3a2ca51a762a0: Status 404 returned error can't find the container with id 5e09b89c34b16928bd782d9d8be1504941892bf71126f962e2f3a2ca51a762a0
Jul 06 19:39:39.968385 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:39.968366    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:39:40.292892 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:40.292843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg" event={"ID":"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa","Type":"ContainerStarted","Data":"5e09b89c34b16928bd782d9d8be1504941892bf71126f962e2f3a2ca51a762a0"}
Jul 06 19:39:41.298429 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:41.298389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg" event={"ID":"be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa","Type":"ContainerStarted","Data":"00a86b6f97c5ed9d57f92321c51c789565cb8dfdd06ce4c07bfbe3c9b691ee14"}
Jul 06 19:39:41.318825 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:41.318769    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg" podStartSLOduration=1.33781406 podStartE2EDuration="2.318749246s" totalImagesPullingTime="980.935186ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:39:41.318451657 +0000 UTC m=+746.546444662" watchObservedRunningTime="2026-07-06 19:39:41.318749246 +0000 UTC m=+746.546742248"
Jul 06 19:39:42.004507 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:42.004472    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:39:49.825609 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:49.825555    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:49.825609 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:49.825624    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:49.838447 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:49.838413    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:39:50.347312 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:39:50.347278    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg"
Jul 06 19:40:55.185602 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:55.185518    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-655ffcd44c-bl5w6"]
Jul 06 19:40:55.188781 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:55.188764    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-655ffcd44c-bl5w6"
Jul 06 19:40:55.194317 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:55.194294    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-655ffcd44c-bl5w6"]
Jul 06 19:40:55.216093 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:55.216057    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtvjw\" (UniqueName: \"kubernetes.io/projected/16daf124-eb84-4c77-bbec-723ba98090dc-kube-api-access-vtvjw\") pod \"authorino-655ffcd44c-bl5w6\" (UID: \"16daf124-eb84-4c77-bbec-723ba98090dc\") " pod="kuadrant-system/authorino-655ffcd44c-bl5w6"
Jul 06 19:40:55.216248 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:55.216098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/16daf124-eb84-4c77-bbec-723ba98090dc-tls-cert\") pod \"authorino-655ffcd44c-bl5w6\" (UID: \"16daf124-eb84-4c77-bbec-723ba98090dc\") " pod="kuadrant-system/authorino-655ffcd44c-bl5w6"
Jul 06 19:40:55.316880 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:55.316838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtvjw\" (UniqueName: \"kubernetes.io/projected/16daf124-eb84-4c77-bbec-723ba98090dc-kube-api-access-vtvjw\") pod \"authorino-655ffcd44c-bl5w6\" (UID: \"16daf124-eb84-4c77-bbec-723ba98090dc\") " pod="kuadrant-system/authorino-655ffcd44c-bl5w6"
Jul 06 19:40:55.316880 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:55.316875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/16daf124-eb84-4c77-bbec-723ba98090dc-tls-cert\") pod \"authorino-655ffcd44c-bl5w6\" (UID: \"16daf124-eb84-4c77-bbec-723ba98090dc\") " pod="kuadrant-system/authorino-655ffcd44c-bl5w6"
Jul 06 19:40:55.319262 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:55.319240    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/16daf124-eb84-4c77-bbec-723ba98090dc-tls-cert\") pod \"authorino-655ffcd44c-bl5w6\" (UID: \"16daf124-eb84-4c77-bbec-723ba98090dc\") " pod="kuadrant-system/authorino-655ffcd44c-bl5w6"
Jul 06 19:40:55.327207 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:55.327183    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtvjw\" (UniqueName: \"kubernetes.io/projected/16daf124-eb84-4c77-bbec-723ba98090dc-kube-api-access-vtvjw\") pod \"authorino-655ffcd44c-bl5w6\" (UID: \"16daf124-eb84-4c77-bbec-723ba98090dc\") " pod="kuadrant-system/authorino-655ffcd44c-bl5w6"
Jul 06 19:40:55.499100 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:55.499069    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-655ffcd44c-bl5w6"
Jul 06 19:40:55.644628 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:55.644599    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-655ffcd44c-bl5w6"]
Jul 06 19:40:55.647053 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:40:55.647024    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16daf124_eb84_4c77_bbec_723ba98090dc.slice/crio-dc15a96b7607e0a06c2af07e53760b658bb1208d29484c690e9306bb88c1627b WatchSource:0}: Error finding container dc15a96b7607e0a06c2af07e53760b658bb1208d29484c690e9306bb88c1627b: Status 404 returned error can't find the container with id dc15a96b7607e0a06c2af07e53760b658bb1208d29484c690e9306bb88c1627b
Jul 06 19:40:56.616671 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:56.616620    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-655ffcd44c-bl5w6" event={"ID":"16daf124-eb84-4c77-bbec-723ba98090dc","Type":"ContainerStarted","Data":"6fd52b0193d72104e627f696e8c9d10fd8de4e363fdf1ab18819cc4ee9ac9936"}
Jul 06 19:40:56.617148 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:56.616681    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-655ffcd44c-bl5w6" event={"ID":"16daf124-eb84-4c77-bbec-723ba98090dc","Type":"ContainerStarted","Data":"dc15a96b7607e0a06c2af07e53760b658bb1208d29484c690e9306bb88c1627b"}
Jul 06 19:40:56.635335 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:56.635270    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-655ffcd44c-bl5w6" podStartSLOduration=1.3188240869999999 podStartE2EDuration="1.635248048s" totalImagesPullingTime="316.423961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:40:56.633831176 +0000 UTC m=+821.861824180" watchObservedRunningTime="2026-07-06 19:40:56.635248048 +0000 UTC m=+821.863241052"
Jul 06 19:40:56.663360 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:56.663322    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-787bf4c858-fqm9r"]
Jul 06 19:40:56.663574 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:56.663546    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-787bf4c858-fqm9r" podUID="b4569aad-941b-458a-a7ed-cfc329323d26" containerName="authorino" containerID="cri-o://29530650c3afe457ae7148625c69c0a37398143722cb839b0034dd2949c90d14" gracePeriod=30
Jul 06 19:40:56.936404 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:56.936377    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-787bf4c858-fqm9r"
Jul 06 19:40:57.030012 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.029975    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4569aad-941b-458a-a7ed-cfc329323d26-tls-cert\") pod \"b4569aad-941b-458a-a7ed-cfc329323d26\" (UID: \"b4569aad-941b-458a-a7ed-cfc329323d26\") "
Jul 06 19:40:57.030012 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.030015    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chhlc\" (UniqueName: \"kubernetes.io/projected/b4569aad-941b-458a-a7ed-cfc329323d26-kube-api-access-chhlc\") pod \"b4569aad-941b-458a-a7ed-cfc329323d26\" (UID: \"b4569aad-941b-458a-a7ed-cfc329323d26\") "
Jul 06 19:40:57.032070 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.032041    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4569aad-941b-458a-a7ed-cfc329323d26-kube-api-access-chhlc" (OuterVolumeSpecName: "kube-api-access-chhlc") pod "b4569aad-941b-458a-a7ed-cfc329323d26" (UID: "b4569aad-941b-458a-a7ed-cfc329323d26"). InnerVolumeSpecName "kube-api-access-chhlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:40:57.040339 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.040312    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4569aad-941b-458a-a7ed-cfc329323d26-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b4569aad-941b-458a-a7ed-cfc329323d26" (UID: "b4569aad-941b-458a-a7ed-cfc329323d26"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:40:57.130496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.130456    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b4569aad-941b-458a-a7ed-cfc329323d26-tls-cert\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:40:57.130496 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.130488    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chhlc\" (UniqueName: \"kubernetes.io/projected/b4569aad-941b-458a-a7ed-cfc329323d26-kube-api-access-chhlc\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:40:57.622942 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.622844    2576 generic.go:356] "Generic (PLEG): container finished" podID="b4569aad-941b-458a-a7ed-cfc329323d26" containerID="29530650c3afe457ae7148625c69c0a37398143722cb839b0034dd2949c90d14" exitCode=0
Jul 06 19:40:57.622942 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.622886    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-787bf4c858-fqm9r"
Jul 06 19:40:57.623369 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.622945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-787bf4c858-fqm9r" event={"ID":"b4569aad-941b-458a-a7ed-cfc329323d26","Type":"ContainerDied","Data":"29530650c3afe457ae7148625c69c0a37398143722cb839b0034dd2949c90d14"}
Jul 06 19:40:57.623369 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.622992    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-787bf4c858-fqm9r" event={"ID":"b4569aad-941b-458a-a7ed-cfc329323d26","Type":"ContainerDied","Data":"0a84211fe04a3040a05b306d84de06316a714c694f28a24f0dc3b713404feb68"}
Jul 06 19:40:57.623369 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.623018    2576 scope.go:117] "RemoveContainer" containerID="29530650c3afe457ae7148625c69c0a37398143722cb839b0034dd2949c90d14"
Jul 06 19:40:57.635473 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.635453    2576 scope.go:117] "RemoveContainer" containerID="29530650c3afe457ae7148625c69c0a37398143722cb839b0034dd2949c90d14"
Jul 06 19:40:57.635771 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:40:57.635752    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29530650c3afe457ae7148625c69c0a37398143722cb839b0034dd2949c90d14\": container with ID starting with 29530650c3afe457ae7148625c69c0a37398143722cb839b0034dd2949c90d14 not found: ID does not exist" containerID="29530650c3afe457ae7148625c69c0a37398143722cb839b0034dd2949c90d14"
Jul 06 19:40:57.635829 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.635779    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29530650c3afe457ae7148625c69c0a37398143722cb839b0034dd2949c90d14"} err="failed to get container status \"29530650c3afe457ae7148625c69c0a37398143722cb839b0034dd2949c90d14\": rpc error: code = NotFound desc = could not find container \"29530650c3afe457ae7148625c69c0a37398143722cb839b0034dd2949c90d14\": container with ID starting with 29530650c3afe457ae7148625c69c0a37398143722cb839b0034dd2949c90d14 not found: ID does not exist"
Jul 06 19:40:57.649428 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.649391    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-787bf4c858-fqm9r"]
Jul 06 19:40:57.651551 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:57.651524    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-787bf4c858-fqm9r"]
Jul 06 19:40:59.283668 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:40:59.283626    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4569aad-941b-458a-a7ed-cfc329323d26" path="/var/lib/kubelet/pods/b4569aad-941b-458a-a7ed-cfc329323d26/volumes"
Jul 06 19:41:30.307986 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:41:30.307953    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:41:41.700181 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:41:41.700139    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:41:51.608776 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:41:51.608733    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:42:00.800727 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:42:00.800688    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:42:10.911952 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:42:10.911840    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:42:15.237345 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:42:15.237313    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:42:15.238393 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:42:15.238369    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:42:38.616318 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:42:38.616277    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:42:49.915883 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:42:49.915846    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:43:28.309650 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:43:28.304673    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:43:36.809079 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:43:36.809042    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:43:46.509835 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:43:46.509748    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:43:52.298055 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:43:52.298019    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:44:02.911164 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:44:02.911129    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:44:12.012538 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:44:12.012499    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:44:23.908220 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:44:23.908166    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:44:33.004392 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:44:33.004353    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:44:59.400513 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:44:59.400471    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:45:09.221059 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:45:09.220971    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:45:34.407804 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:45:34.407769    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:45:45.108724 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:45:45.108685    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:46:00.710610 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:46:00.710568    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:46:11.405154 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:46:11.405118    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:46:20.722980 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:46:20.722942    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:46:29.795802 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:46:29.795761    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:46:38.709287 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:46:38.709199    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:47:15.264153 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:47:15.264125    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:47:15.264754 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:47:15.264218    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:48:28.403953 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:48:28.403901    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:48:38.404494 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:48:38.404460    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:48:48.799013 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:48:48.798976    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:49:00.908118 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:49:00.908081    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:49:11.614258 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:49:11.614224    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:49:22.797712 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:49:22.797675    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:49:32.416470 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:49:32.416431    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:49:42.303250 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:49:42.303168    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:49:53.522819 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:49:53.522777    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:50:01.904981 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:50:01.904947    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:50:10.299296 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:50:10.299258    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:50:16.209542 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:50:16.209507    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:50:40.698083 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:50:40.698046    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:50:47.705472 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:50:47.705435    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:50:56.700763 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:50:56.700725    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:51:08.009268 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:51:08.009183    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:51:15.906320 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:51:15.906275    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:51:26.705276 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:51:26.705238    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:51:37.498826 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:51:37.498786    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:51:46.004278 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:51:46.004238    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:51:57.012786 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:51:57.012745    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:52:06.237908 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:52:06.237869    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:52:15.204003 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:52:15.203965    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:52:15.290075 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:52:15.290046    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:52:15.291200 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:52:15.291175    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:52:29.125450 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:52:29.125412    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:52:37.609307 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:52:37.609226    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:52:48.705552 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:52:48.705513    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:53:00.595707 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:53:00.595670    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:53:11.400548 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:53:11.400507    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:53:20.099618 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:53:20.099580    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:53:31.003159 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:53:31.003125    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:53:42.113717 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:53:42.113677    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:53:51.195502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:53:51.195465    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:54:04.297088 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:54:04.297044    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:54:12.805135 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:54:12.805047    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:54:22.001275 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:54:22.001240    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:54:39.109555 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:54:39.109470    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:54:49.697262 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:54:49.697225    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:54:58.579038 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:54:58.579002    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:55:06.708225 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:55:06.708185    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:56:28.001406 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:56:28.001365    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:56:35.200971 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:56:35.200914    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:56:44.101619 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:56:44.101584    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:56:53.694597 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:56:53.694559    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:57:00.116637 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:00.116591    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:57:15.313502 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:15.313469    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:57:15.316024 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:15.315996    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 19:57:31.000522 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:31.000482    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:57:42.106470 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.106436    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"]
Jul 06 19:57:42.106879 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.106749    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4569aad-941b-458a-a7ed-cfc329323d26" containerName="authorino"
Jul 06 19:57:42.106879 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.106759    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4569aad-941b-458a-a7ed-cfc329323d26" containerName="authorino"
Jul 06 19:57:42.106879 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.106822    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4569aad-941b-458a-a7ed-cfc329323d26" containerName="authorino"
Jul 06 19:57:42.109846 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.109828    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.113119 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.113087    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f938018c\"/\"openshift-service-ca.crt\""
Jul 06 19:57:42.114486 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.114458    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f938018c\"/\"kube-root-ca.crt\""
Jul 06 19:57:42.114612 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.114487    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f938018c\"/\"default-dockercfg-rtsvf\""
Jul 06 19:57:42.114612 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.114498    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f938018c\"/\"e2e-lifecycle-model-f938018c-kserve-self-signed-certs\""
Jul 06 19:57:42.120112 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.120088    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"]
Jul 06 19:57:42.157350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.157309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-home\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.157350 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.157352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-tmp-dir\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.157570 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.157424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-model-cache\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.157570 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.157453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-dshm\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.157570 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.157475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6be35f16-79d2-4424-9865-125e3cbcdc1f-tls-certs\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.157570 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.157535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shh92\" (UniqueName: \"kubernetes.io/projected/6be35f16-79d2-4424-9865-125e3cbcdc1f-kube-api-access-shh92\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.258615 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.258576    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-home\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.258615 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.258616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-tmp-dir\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.258863 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.258640    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-model-cache\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.258863 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.258666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-dshm\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.258863 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.258692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6be35f16-79d2-4424-9865-125e3cbcdc1f-tls-certs\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.258863 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.258740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shh92\" (UniqueName: \"kubernetes.io/projected/6be35f16-79d2-4424-9865-125e3cbcdc1f-kube-api-access-shh92\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.259099 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.259037    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-home\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.259156 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.259092    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-tmp-dir\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.259156 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.259141    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-model-cache\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.261039 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.261018    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-dshm\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.261304 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.261286    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6be35f16-79d2-4424-9865-125e3cbcdc1f-tls-certs\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.267694 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.267674    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shh92\" (UniqueName: \"kubernetes.io/projected/6be35f16-79d2-4424-9865-125e3cbcdc1f-kube-api-access-shh92\") pod \"e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") " pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.419523 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.419431    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:42.564897 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.564869    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"]
Jul 06 19:57:42.567112 ip-10-0-137-0 kubenswrapper[2576]: W0706 19:57:42.567082    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6be35f16_79d2_4424_9865_125e3cbcdc1f.slice/crio-197cfa82a3a5999022fcda087a99fb535460002d75f4a974d6ba79b2faa18f2c WatchSource:0}: Error finding container 197cfa82a3a5999022fcda087a99fb535460002d75f4a974d6ba79b2faa18f2c: Status 404 returned error can't find the container with id 197cfa82a3a5999022fcda087a99fb535460002d75f4a974d6ba79b2faa18f2c
Jul 06 19:57:42.948821 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.948786    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f" event={"ID":"6be35f16-79d2-4424-9865-125e3cbcdc1f","Type":"ContainerStarted","Data":"ad7a89ae62db543149ae7111a9c2010bd351fdcd7deea821be803201b2ebd2b3"}
Jul 06 19:57:42.948821 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.948829    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f" event={"ID":"6be35f16-79d2-4424-9865-125e3cbcdc1f","Type":"ContainerStarted","Data":"197cfa82a3a5999022fcda087a99fb535460002d75f4a974d6ba79b2faa18f2c"}
Jul 06 19:57:42.970204 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:42.970141    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f" podStartSLOduration=0.970125704 podStartE2EDuration="970.125704ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:57:42.968154386 +0000 UTC m=+1828.196147389" watchObservedRunningTime="2026-07-06 19:57:42.970125704 +0000 UTC m=+1828.198118707"
Jul 06 19:57:45.412192 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:45.412159    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:57:52.420537 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:52.420497    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:52.421082 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:52.420561    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:52.433234 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:52.433206    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:53.004058 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:53.004026    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:57:57.105206 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:57:57.105169    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:58:09.308444 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:09.308410    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:58:10.441258 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:10.441222    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"]
Jul 06 19:58:25.461699 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.461635    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f" podUID="6be35f16-79d2-4424-9865-125e3cbcdc1f" containerName="main" containerID="cri-o://ad7a89ae62db543149ae7111a9c2010bd351fdcd7deea821be803201b2ebd2b3" gracePeriod=45
Jul 06 19:58:25.713595 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.713528    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:58:25.850612 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.850571    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-dshm\") pod \"6be35f16-79d2-4424-9865-125e3cbcdc1f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") "
Jul 06 19:58:25.850612 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.850620    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-home\") pod \"6be35f16-79d2-4424-9865-125e3cbcdc1f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") "
Jul 06 19:58:25.850872 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.850647    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-model-cache\") pod \"6be35f16-79d2-4424-9865-125e3cbcdc1f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") "
Jul 06 19:58:25.850872 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.850668    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-tmp-dir\") pod \"6be35f16-79d2-4424-9865-125e3cbcdc1f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") "
Jul 06 19:58:25.850872 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.850692    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6be35f16-79d2-4424-9865-125e3cbcdc1f-tls-certs\") pod \"6be35f16-79d2-4424-9865-125e3cbcdc1f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") "
Jul 06 19:58:25.850872 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.850747    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shh92\" (UniqueName: \"kubernetes.io/projected/6be35f16-79d2-4424-9865-125e3cbcdc1f-kube-api-access-shh92\") pod \"6be35f16-79d2-4424-9865-125e3cbcdc1f\" (UID: \"6be35f16-79d2-4424-9865-125e3cbcdc1f\") "
Jul 06 19:58:25.851093 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.850946    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-home" (OuterVolumeSpecName: "home") pod "6be35f16-79d2-4424-9865-125e3cbcdc1f" (UID: "6be35f16-79d2-4424-9865-125e3cbcdc1f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:25.851093 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.850966    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-model-cache" (OuterVolumeSpecName: "model-cache") pod "6be35f16-79d2-4424-9865-125e3cbcdc1f" (UID: "6be35f16-79d2-4424-9865-125e3cbcdc1f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:25.851093 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.850984    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6be35f16-79d2-4424-9865-125e3cbcdc1f" (UID: "6be35f16-79d2-4424-9865-125e3cbcdc1f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:25.852850 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.852827    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6be35f16-79d2-4424-9865-125e3cbcdc1f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6be35f16-79d2-4424-9865-125e3cbcdc1f" (UID: "6be35f16-79d2-4424-9865-125e3cbcdc1f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:58:25.852951 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.852850    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-dshm" (OuterVolumeSpecName: "dshm") pod "6be35f16-79d2-4424-9865-125e3cbcdc1f" (UID: "6be35f16-79d2-4424-9865-125e3cbcdc1f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:58:25.853011 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.852953    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6be35f16-79d2-4424-9865-125e3cbcdc1f-kube-api-access-shh92" (OuterVolumeSpecName: "kube-api-access-shh92") pod "6be35f16-79d2-4424-9865-125e3cbcdc1f" (UID: "6be35f16-79d2-4424-9865-125e3cbcdc1f"). InnerVolumeSpecName "kube-api-access-shh92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:58:25.952670 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.952097    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shh92\" (UniqueName: \"kubernetes.io/projected/6be35f16-79d2-4424-9865-125e3cbcdc1f-kube-api-access-shh92\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:58:25.952670 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.952139    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:58:25.952670 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.952154    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:58:25.952670 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.952167    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:58:25.952670 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.952189    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6be35f16-79d2-4424-9865-125e3cbcdc1f-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:58:25.952670 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:25.952201    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6be35f16-79d2-4424-9865-125e3cbcdc1f-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 19:58:26.141403 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:26.141314    2576 generic.go:356] "Generic (PLEG): container finished" podID="6be35f16-79d2-4424-9865-125e3cbcdc1f" containerID="ad7a89ae62db543149ae7111a9c2010bd351fdcd7deea821be803201b2ebd2b3" exitCode=0
Jul 06 19:58:26.141403 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:26.141371    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"
Jul 06 19:58:26.141582 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:26.141401    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f" event={"ID":"6be35f16-79d2-4424-9865-125e3cbcdc1f","Type":"ContainerDied","Data":"ad7a89ae62db543149ae7111a9c2010bd351fdcd7deea821be803201b2ebd2b3"}
Jul 06 19:58:26.141582 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:26.141454    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f" event={"ID":"6be35f16-79d2-4424-9865-125e3cbcdc1f","Type":"ContainerDied","Data":"197cfa82a3a5999022fcda087a99fb535460002d75f4a974d6ba79b2faa18f2c"}
Jul 06 19:58:26.141582 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:26.141473    2576 scope.go:117] "RemoveContainer" containerID="ad7a89ae62db543149ae7111a9c2010bd351fdcd7deea821be803201b2ebd2b3"
Jul 06 19:58:26.150035 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:26.150018    2576 scope.go:117] "RemoveContainer" containerID="ad7a89ae62db543149ae7111a9c2010bd351fdcd7deea821be803201b2ebd2b3"
Jul 06 19:58:26.150324 ip-10-0-137-0 kubenswrapper[2576]: E0706 19:58:26.150304    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad7a89ae62db543149ae7111a9c2010bd351fdcd7deea821be803201b2ebd2b3\": container with ID starting with ad7a89ae62db543149ae7111a9c2010bd351fdcd7deea821be803201b2ebd2b3 not found: ID does not exist" containerID="ad7a89ae62db543149ae7111a9c2010bd351fdcd7deea821be803201b2ebd2b3"
Jul 06 19:58:26.150378 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:26.150334    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad7a89ae62db543149ae7111a9c2010bd351fdcd7deea821be803201b2ebd2b3"} err="failed to get container status \"ad7a89ae62db543149ae7111a9c2010bd351fdcd7deea821be803201b2ebd2b3\": rpc error: code = NotFound desc = could not find container \"ad7a89ae62db543149ae7111a9c2010bd351fdcd7deea821be803201b2ebd2b3\": container with ID starting with ad7a89ae62db543149ae7111a9c2010bd351fdcd7deea821be803201b2ebd2b3 not found: ID does not exist"
Jul 06 19:58:26.163504 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:26.163472    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"]
Jul 06 19:58:26.172052 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:26.172024    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-f938018c/e2e-lifecycle-model-f938018c-kserve-f77b96875-zgg6f"]
Jul 06 19:58:27.283789 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:27.283751    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6be35f16-79d2-4424-9865-125e3cbcdc1f" path="/var/lib/kubelet/pods/6be35f16-79d2-4424-9865-125e3cbcdc1f/volumes"
Jul 06 19:58:34.901856 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:58:34.901817    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:59:05.602712 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:59:05.602485    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:59:16.400426 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:59:16.400388    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 19:59:24.803517 ip-10-0-137-0 kubenswrapper[2576]: I0706 19:59:24.803478    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:00:12.710830 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:12.710749    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:00:21.225206 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:21.225162    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:00:29.985864 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:29.985826    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"]
Jul 06 20:00:29.986368 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:29.986336    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6be35f16-79d2-4424-9865-125e3cbcdc1f" containerName="main"
Jul 06 20:00:29.986368 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:29.986356    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6be35f16-79d2-4424-9865-125e3cbcdc1f" containerName="main"
Jul 06 20:00:29.986475 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:29.986438    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6be35f16-79d2-4424-9865-125e3cbcdc1f" containerName="main"
Jul 06 20:00:29.989454 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:29.989431    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:29.993148 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:29.993096    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-653e5c\"/\"openshift-service-ca.crt\""
Jul 06 20:00:29.993288 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:29.993184    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-653e5c\"/\"default-dockercfg-krbhq\""
Jul 06 20:00:29.994358 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:29.994338    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-653e5c\"/\"kube-root-ca.crt\""
Jul 06 20:00:29.994447 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:29.994436    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-653e5c\"/\"test-model-653e5c-kserve-self-signed-certs\""
Jul 06 20:00:30.001066 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.001041    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"]
Jul 06 20:00:30.095168 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.095121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-home\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.095345 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.095180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-dshm\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.095345 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.095228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-tls-certs\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.095345 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.095270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-model-cache\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.095345 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.095307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-tmp-dir\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.095475 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.095389    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p62qf\" (UniqueName: \"kubernetes.io/projected/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-kube-api-access-p62qf\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.196844 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.196785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-dshm\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.196844 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.196843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-tls-certs\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.197085 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.196983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-model-cache\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.197085 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.197044    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-tmp-dir\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.197195 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.197123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p62qf\" (UniqueName: \"kubernetes.io/projected/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-kube-api-access-p62qf\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.197195 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.197178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-home\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.197361 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.197338    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-model-cache\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.197425 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.197387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-tmp-dir\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.197526 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.197503    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-home\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.199165 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.199144    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-dshm\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.199335 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.199319    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-tls-certs\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.205634 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.205612    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p62qf\" (UniqueName: \"kubernetes.io/projected/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-kube-api-access-p62qf\") pod \"test-model-653e5c-kserve-57f4ccb675-swl6s\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") " pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.299688 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.299584    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:30.442398 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.442325    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"]
Jul 06 20:00:30.446340 ip-10-0-137-0 kubenswrapper[2576]: W0706 20:00:30.446307    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f50ad17_789d_4ac9_ae6a_bc17dc18ff6c.slice/crio-e64b93a6c670324129fe08b73563739f97f7b85626df27a177cddd651fb60004 WatchSource:0}: Error finding container e64b93a6c670324129fe08b73563739f97f7b85626df27a177cddd651fb60004: Status 404 returned error can't find the container with id e64b93a6c670324129fe08b73563739f97f7b85626df27a177cddd651fb60004
Jul 06 20:00:30.691493 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.691397    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s" event={"ID":"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c","Type":"ContainerStarted","Data":"3abe8bb1152f69a47eea9e02e35c504a47112a5179671b40a6c255875839b5fa"}
Jul 06 20:00:30.691493 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.691443    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s" event={"ID":"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c","Type":"ContainerStarted","Data":"e64b93a6c670324129fe08b73563739f97f7b85626df27a177cddd651fb60004"}
Jul 06 20:00:30.710524 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:30.710359    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s" podStartSLOduration=1.710341558 podStartE2EDuration="1.710341558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:30.710241753 +0000 UTC m=+1995.938234770" watchObservedRunningTime="2026-07-06 20:00:30.710341558 +0000 UTC m=+1995.938334561"
Jul 06 20:00:33.402876 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:33.402814    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:00:40.300602 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:40.300564    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:40.301051 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:40.300634    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:40.318944 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:40.318887    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:00:40.745549 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:00:40.745516    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:01:03.404561 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.404525    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"]
Jul 06 20:01:03.407832 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.407808    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.410833 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.410809    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-03ff21\"/\"kube-root-ca.crt\""
Jul 06 20:01:03.412084 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.412058    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-03ff21\"/\"default-dockercfg-2rrrq\""
Jul 06 20:01:03.412084 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.412067    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-03ff21\"/\"test-model-03ff21-kserve-self-signed-certs\""
Jul 06 20:01:03.412236 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.412167    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-03ff21\"/\"openshift-service-ca.crt\""
Jul 06 20:01:03.421203 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.421165    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"]
Jul 06 20:01:03.488215 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.488178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf6sd\" (UniqueName: \"kubernetes.io/projected/3110e432-d110-477e-9fd6-cf635291cc87-kube-api-access-sf6sd\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.488399 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.488247    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-model-cache\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.488399 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.488271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-home\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.488399 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.488290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-dshm\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.488399 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.488306    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-tmp-dir\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.488399 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.488387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3110e432-d110-477e-9fd6-cf635291cc87-tls-certs\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.589535 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.589490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3110e432-d110-477e-9fd6-cf635291cc87-tls-certs\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.589709 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.589632    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf6sd\" (UniqueName: \"kubernetes.io/projected/3110e432-d110-477e-9fd6-cf635291cc87-kube-api-access-sf6sd\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.589709 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.589672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-model-cache\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.589709 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.589689    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-home\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.589709 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.589709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-dshm\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.589901 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.589730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-tmp-dir\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.590145 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.590121    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-model-cache\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.590247 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.590147    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-home\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.590247 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.590173    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-tmp-dir\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.591892 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.591869    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-dshm\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.592088 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.592068    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3110e432-d110-477e-9fd6-cf635291cc87-tls-certs\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.599549 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.599522    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf6sd\" (UniqueName: \"kubernetes.io/projected/3110e432-d110-477e-9fd6-cf635291cc87-kube-api-access-sf6sd\") pod \"test-model-03ff21-kserve-86f6b75fd9-w2f6k\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") " pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.717654 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.717613    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:03.851344 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:03.851320    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"]
Jul 06 20:01:03.853655 ip-10-0-137-0 kubenswrapper[2576]: W0706 20:01:03.853628    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3110e432_d110_477e_9fd6_cf635291cc87.slice/crio-21acf51c2b02fea86c1d1b0c74a1321b366575a79335a7a55059d6a56f95a5ed WatchSource:0}: Error finding container 21acf51c2b02fea86c1d1b0c74a1321b366575a79335a7a55059d6a56f95a5ed: Status 404 returned error can't find the container with id 21acf51c2b02fea86c1d1b0c74a1321b366575a79335a7a55059d6a56f95a5ed
Jul 06 20:01:04.847254 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:04.847221    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k" event={"ID":"3110e432-d110-477e-9fd6-cf635291cc87","Type":"ContainerStarted","Data":"af93ad90896e4042b88c15cfe53518ad6569626926a4bd2cf78d50ca3fcc6302"}
Jul 06 20:01:04.847254 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:04.847260    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k" event={"ID":"3110e432-d110-477e-9fd6-cf635291cc87","Type":"ContainerStarted","Data":"21acf51c2b02fea86c1d1b0c74a1321b366575a79335a7a55059d6a56f95a5ed"}
Jul 06 20:01:04.867880 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:04.867821    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k" podStartSLOduration=1.867804548 podStartE2EDuration="1.867804548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:01:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:01:04.866540602 +0000 UTC m=+2030.094533606" watchObservedRunningTime="2026-07-06 20:01:04.867804548 +0000 UTC m=+2030.095797551"
Jul 06 20:01:07.418767 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:07.418729    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:01:13.718227 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:13.718175    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:13.718716 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:13.718240    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:13.731263 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:13.731235    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:13.912656 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:13.912622    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:19.925359 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:19.925326    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:01:24.323212 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:24.323179    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"]
Jul 06 20:01:25.284839 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:25.284803    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"]
Jul 06 20:01:31.802062 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:31.802026    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:01:39.343284 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.343179    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s" podUID="0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c" containerName="main" containerID="cri-o://3abe8bb1152f69a47eea9e02e35c504a47112a5179671b40a6c255875839b5fa" gracePeriod=45
Jul 06 20:01:39.595051 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.594988    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:01:39.708754 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.708715    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-tmp-dir\") pod \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") "
Jul 06 20:01:39.708754 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.708760    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-dshm\") pod \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") "
Jul 06 20:01:39.709033 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.708807    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-tls-certs\") pod \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") "
Jul 06 20:01:39.709033 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.708848    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-model-cache\") pod \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") "
Jul 06 20:01:39.709033 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.708880    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p62qf\" (UniqueName: \"kubernetes.io/projected/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-kube-api-access-p62qf\") pod \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") "
Jul 06 20:01:39.709033 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.708957    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-home\") pod \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\" (UID: \"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c\") "
Jul 06 20:01:39.709244 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.709088    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c" (UID: "0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:39.709244 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.709173    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-model-cache" (OuterVolumeSpecName: "model-cache") pod "0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c" (UID: "0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:39.709244 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.709203    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:01:39.709351 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.709255    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-home" (OuterVolumeSpecName: "home") pod "0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c" (UID: "0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:39.711163 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.711140    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-dshm" (OuterVolumeSpecName: "dshm") pod "0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c" (UID: "0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:39.711252 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.711230    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-kube-api-access-p62qf" (OuterVolumeSpecName: "kube-api-access-p62qf") pod "0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c" (UID: "0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c"). InnerVolumeSpecName "kube-api-access-p62qf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:01:39.711321 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.711263    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c" (UID: "0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:01:39.810225 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.810184    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:01:39.810225 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.810217    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:01:39.810225 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.810226    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:01:39.810453 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.810236    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p62qf\" (UniqueName: \"kubernetes.io/projected/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-kube-api-access-p62qf\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:01:39.810453 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:39.810246    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:01:40.023534 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.023491    2576 generic.go:356] "Generic (PLEG): container finished" podID="0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c" containerID="3abe8bb1152f69a47eea9e02e35c504a47112a5179671b40a6c255875839b5fa" exitCode=0
Jul 06 20:01:40.023534 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.023536    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"
Jul 06 20:01:40.023744 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.023570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s" event={"ID":"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c","Type":"ContainerDied","Data":"3abe8bb1152f69a47eea9e02e35c504a47112a5179671b40a6c255875839b5fa"}
Jul 06 20:01:40.023744 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.023610    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s" event={"ID":"0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c","Type":"ContainerDied","Data":"e64b93a6c670324129fe08b73563739f97f7b85626df27a177cddd651fb60004"}
Jul 06 20:01:40.023744 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.023630    2576 scope.go:117] "RemoveContainer" containerID="3abe8bb1152f69a47eea9e02e35c504a47112a5179671b40a6c255875839b5fa"
Jul 06 20:01:40.032509 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.032490    2576 scope.go:117] "RemoveContainer" containerID="3abe8bb1152f69a47eea9e02e35c504a47112a5179671b40a6c255875839b5fa"
Jul 06 20:01:40.032785 ip-10-0-137-0 kubenswrapper[2576]: E0706 20:01:40.032767    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3abe8bb1152f69a47eea9e02e35c504a47112a5179671b40a6c255875839b5fa\": container with ID starting with 3abe8bb1152f69a47eea9e02e35c504a47112a5179671b40a6c255875839b5fa not found: ID does not exist" containerID="3abe8bb1152f69a47eea9e02e35c504a47112a5179671b40a6c255875839b5fa"
Jul 06 20:01:40.032829 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.032796    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3abe8bb1152f69a47eea9e02e35c504a47112a5179671b40a6c255875839b5fa"} err="failed to get container status \"3abe8bb1152f69a47eea9e02e35c504a47112a5179671b40a6c255875839b5fa\": rpc error: code = NotFound desc = could not find container \"3abe8bb1152f69a47eea9e02e35c504a47112a5179671b40a6c255875839b5fa\": container with ID starting with 3abe8bb1152f69a47eea9e02e35c504a47112a5179671b40a6c255875839b5fa not found: ID does not exist"
Jul 06 20:01:40.046374 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.046335    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"]
Jul 06 20:01:40.055515 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.051594    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-653e5c/test-model-653e5c-kserve-57f4ccb675-swl6s"]
Jul 06 20:01:40.304582 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.304479    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k" podUID="3110e432-d110-477e-9fd6-cf635291cc87" containerName="main" containerID="cri-o://af93ad90896e4042b88c15cfe53518ad6569626926a4bd2cf78d50ca3fcc6302" gracePeriod=45
Jul 06 20:01:40.552707 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.552666    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:40.719157 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.719116    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf6sd\" (UniqueName: \"kubernetes.io/projected/3110e432-d110-477e-9fd6-cf635291cc87-kube-api-access-sf6sd\") pod \"3110e432-d110-477e-9fd6-cf635291cc87\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") "
Jul 06 20:01:40.719322 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.719185    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-home\") pod \"3110e432-d110-477e-9fd6-cf635291cc87\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") "
Jul 06 20:01:40.719322 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.719234    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3110e432-d110-477e-9fd6-cf635291cc87-tls-certs\") pod \"3110e432-d110-477e-9fd6-cf635291cc87\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") "
Jul 06 20:01:40.719322 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.719279    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-dshm\") pod \"3110e432-d110-477e-9fd6-cf635291cc87\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") "
Jul 06 20:01:40.719322 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.719305    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-tmp-dir\") pod \"3110e432-d110-477e-9fd6-cf635291cc87\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") "
Jul 06 20:01:40.719538 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.719362    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-model-cache\") pod \"3110e432-d110-477e-9fd6-cf635291cc87\" (UID: \"3110e432-d110-477e-9fd6-cf635291cc87\") "
Jul 06 20:01:40.719538 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.719492    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-home" (OuterVolumeSpecName: "home") pod "3110e432-d110-477e-9fd6-cf635291cc87" (UID: "3110e432-d110-477e-9fd6-cf635291cc87"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:40.719640 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.719610    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3110e432-d110-477e-9fd6-cf635291cc87" (UID: "3110e432-d110-477e-9fd6-cf635291cc87"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:40.719640 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.719625    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-model-cache" (OuterVolumeSpecName: "model-cache") pod "3110e432-d110-477e-9fd6-cf635291cc87" (UID: "3110e432-d110-477e-9fd6-cf635291cc87"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:40.719726 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.719643    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:01:40.721444 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.721409    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-dshm" (OuterVolumeSpecName: "dshm") pod "3110e432-d110-477e-9fd6-cf635291cc87" (UID: "3110e432-d110-477e-9fd6-cf635291cc87"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:01:40.721444 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.721420    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3110e432-d110-477e-9fd6-cf635291cc87-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3110e432-d110-477e-9fd6-cf635291cc87" (UID: "3110e432-d110-477e-9fd6-cf635291cc87"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:01:40.721592 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.721517    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3110e432-d110-477e-9fd6-cf635291cc87-kube-api-access-sf6sd" (OuterVolumeSpecName: "kube-api-access-sf6sd") pod "3110e432-d110-477e-9fd6-cf635291cc87" (UID: "3110e432-d110-477e-9fd6-cf635291cc87"). InnerVolumeSpecName "kube-api-access-sf6sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:01:40.820450 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.820412    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3110e432-d110-477e-9fd6-cf635291cc87-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:01:40.820450 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.820443    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:01:40.820450 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.820451    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:01:40.820450 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.820460    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3110e432-d110-477e-9fd6-cf635291cc87-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:01:40.820735 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:40.820470    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf6sd\" (UniqueName: \"kubernetes.io/projected/3110e432-d110-477e-9fd6-cf635291cc87-kube-api-access-sf6sd\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:01:41.029624 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:41.029535    2576 generic.go:356] "Generic (PLEG): container finished" podID="3110e432-d110-477e-9fd6-cf635291cc87" containerID="af93ad90896e4042b88c15cfe53518ad6569626926a4bd2cf78d50ca3fcc6302" exitCode=0
Jul 06 20:01:41.029624 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:41.029574    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"
Jul 06 20:01:41.029829 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:41.029627    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k" event={"ID":"3110e432-d110-477e-9fd6-cf635291cc87","Type":"ContainerDied","Data":"af93ad90896e4042b88c15cfe53518ad6569626926a4bd2cf78d50ca3fcc6302"}
Jul 06 20:01:41.029829 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:41.029666    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k" event={"ID":"3110e432-d110-477e-9fd6-cf635291cc87","Type":"ContainerDied","Data":"21acf51c2b02fea86c1d1b0c74a1321b366575a79335a7a55059d6a56f95a5ed"}
Jul 06 20:01:41.029829 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:41.029691    2576 scope.go:117] "RemoveContainer" containerID="af93ad90896e4042b88c15cfe53518ad6569626926a4bd2cf78d50ca3fcc6302"
Jul 06 20:01:41.038532 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:41.038515    2576 scope.go:117] "RemoveContainer" containerID="af93ad90896e4042b88c15cfe53518ad6569626926a4bd2cf78d50ca3fcc6302"
Jul 06 20:01:41.038771 ip-10-0-137-0 kubenswrapper[2576]: E0706 20:01:41.038756    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af93ad90896e4042b88c15cfe53518ad6569626926a4bd2cf78d50ca3fcc6302\": container with ID starting with af93ad90896e4042b88c15cfe53518ad6569626926a4bd2cf78d50ca3fcc6302 not found: ID does not exist" containerID="af93ad90896e4042b88c15cfe53518ad6569626926a4bd2cf78d50ca3fcc6302"
Jul 06 20:01:41.038814 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:41.038778    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af93ad90896e4042b88c15cfe53518ad6569626926a4bd2cf78d50ca3fcc6302"} err="failed to get container status \"af93ad90896e4042b88c15cfe53518ad6569626926a4bd2cf78d50ca3fcc6302\": rpc error: code = NotFound desc = could not find container \"af93ad90896e4042b88c15cfe53518ad6569626926a4bd2cf78d50ca3fcc6302\": container with ID starting with af93ad90896e4042b88c15cfe53518ad6569626926a4bd2cf78d50ca3fcc6302 not found: ID does not exist"
Jul 06 20:01:41.051752 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:41.051724    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"]
Jul 06 20:01:41.056186 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:41.056164    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-03ff21/test-model-03ff21-kserve-86f6b75fd9-w2f6k"]
Jul 06 20:01:41.285727 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:41.285651    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c" path="/var/lib/kubelet/pods/0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c/volumes"
Jul 06 20:01:41.286078 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:01:41.286064    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3110e432-d110-477e-9fd6-cf635291cc87" path="/var/lib/kubelet/pods/3110e432-d110-477e-9fd6-cf635291cc87/volumes"
Jul 06 20:02:12.009104 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:02:12.009064    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:02:15.337747 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:02:15.337716    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 20:02:15.340476 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:02:15.340451    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 20:02:26.107615 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:02:26.107573    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:02:40.199574 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:02:40.199535    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:02:49.008028 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:02:49.007983    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:02:58.323188 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:02:58.323153    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:03:07.014483 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:07.014442    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:03:15.598547 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:15.598459    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:03:18.105298 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.105252    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"]
Jul 06 20:03:18.105738 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.105722    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c" containerName="main"
Jul 06 20:03:18.105786 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.105741    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c" containerName="main"
Jul 06 20:03:18.105786 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.105752    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3110e432-d110-477e-9fd6-cf635291cc87" containerName="main"
Jul 06 20:03:18.105786 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.105761    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3110e432-d110-477e-9fd6-cf635291cc87" containerName="main"
Jul 06 20:03:18.105874 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.105849    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3110e432-d110-477e-9fd6-cf635291cc87" containerName="main"
Jul 06 20:03:18.105874 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.105861    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f50ad17-789d-4ac9-ae6a-bc17dc18ff6c" containerName="main"
Jul 06 20:03:18.109403 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.109375    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.112388 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.112368    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4430fb\"/\"openshift-service-ca.crt\""
Jul 06 20:03:18.113465 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.113443    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4430fb\"/\"auth-test-model-4430fb-kserve-self-signed-certs\""
Jul 06 20:03:18.113589 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.113450    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4430fb\"/\"kube-root-ca.crt\""
Jul 06 20:03:18.113589 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.113520    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4430fb\"/\"default-dockercfg-z5mbn\""
Jul 06 20:03:18.119099 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.119076    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"]
Jul 06 20:03:18.232756 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.232719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-tmp-dir\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.232967 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.232764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-model-cache\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.232967 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.232784    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-255rb\" (UniqueName: \"kubernetes.io/projected/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-kube-api-access-255rb\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.232967 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.232804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-dshm\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.232967 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.232873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-tls-certs\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.233108 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.233005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-home\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.333688 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.333642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-tmp-dir\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.333688 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.333694    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-model-cache\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.333972 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.333743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-255rb\" (UniqueName: \"kubernetes.io/projected/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-kube-api-access-255rb\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.333972 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.333775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-dshm\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.333972 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.333805    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-tls-certs\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.333972 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.333885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-home\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.334197 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.334153    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-model-cache\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.334292 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.334269    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-home\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.334415 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.334395    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-tmp-dir\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.336200 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.336177    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-dshm\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.336385 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.336369    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-tls-certs\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.343389 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.343370    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-255rb\" (UniqueName: \"kubernetes.io/projected/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-kube-api-access-255rb\") pod \"auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") " pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.419567 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.419475    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:18.555151 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:18.555117    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"]
Jul 06 20:03:18.557343 ip-10-0-137-0 kubenswrapper[2576]: W0706 20:03:18.557295    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b860c7e_bf9c_4e74_8a9b_268b764e10c9.slice/crio-9cd875be8abb75d71352b2c6a1863774d11598ee2e9fdb4dba79a15d8a687619 WatchSource:0}: Error finding container 9cd875be8abb75d71352b2c6a1863774d11598ee2e9fdb4dba79a15d8a687619: Status 404 returned error can't find the container with id 9cd875be8abb75d71352b2c6a1863774d11598ee2e9fdb4dba79a15d8a687619
Jul 06 20:03:19.468386 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:19.468339    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb" event={"ID":"1b860c7e-bf9c-4e74-8a9b-268b764e10c9","Type":"ContainerStarted","Data":"95cfa92cb9f84f1c8a38b7462f5244e7a145da7877f934ad91f7e771a02face4"}
Jul 06 20:03:19.468386 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:19.468387    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb" event={"ID":"1b860c7e-bf9c-4e74-8a9b-268b764e10c9","Type":"ContainerStarted","Data":"9cd875be8abb75d71352b2c6a1863774d11598ee2e9fdb4dba79a15d8a687619"}
Jul 06 20:03:19.489583 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:19.489531    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb" podStartSLOduration=1.489516402 podStartE2EDuration="1.489516402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:03:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:03:19.487623502 +0000 UTC m=+2164.715616524" watchObservedRunningTime="2026-07-06 20:03:19.489516402 +0000 UTC m=+2164.717509383"
Jul 06 20:03:28.340396 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:28.340355    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:03:28.419962 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:28.419912    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:28.420141 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:28.419988    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:28.432653 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:28.432623    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:28.519765 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:28.519731    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:03:52.111092 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.111055    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"]
Jul 06 20:03:52.114020 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.114005    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.116868 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.116846    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-33ae61\"/\"openshift-service-ca.crt\""
Jul 06 20:03:52.117101 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.117086    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-33ae61\"/\"default-dockercfg-2d6kt\""
Jul 06 20:03:52.118211 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.118186    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-33ae61\"/\"kube-root-ca.crt\""
Jul 06 20:03:52.118303 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.118236    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-33ae61\"/\"auth-test-model-33ae61-kserve-self-signed-certs\""
Jul 06 20:03:52.121918 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.121896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5w56\" (UniqueName: \"kubernetes.io/projected/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-kube-api-access-t5w56\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.122026 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.121963    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-dshm\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.122026 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.122019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-home\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.122119 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.122061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-tmp-dir\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.122119 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.122102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-tls-certs\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.122214 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.122153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-model-cache\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.123717 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.123696    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"]
Jul 06 20:03:52.222642 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.222596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-home\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.222642 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.222635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-tmp-dir\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.222889 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.222659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-tls-certs\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.222889 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.222770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-model-cache\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.223091 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.223063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5w56\" (UniqueName: \"kubernetes.io/projected/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-kube-api-access-t5w56\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.223174 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.223095    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-tmp-dir\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.223174 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.223136    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-dshm\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.223174 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.223164    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-model-cache\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.223301 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.223135    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-home\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.225157 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.225139    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-dshm\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.225327 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.225309    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-tls-certs\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.232555 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.232522    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5w56\" (UniqueName: \"kubernetes.io/projected/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-kube-api-access-t5w56\") pod \"auth-test-model-33ae61-kserve-c8694f7ff-ckshg\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") " pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.424222 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.424107    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:03:52.561708 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.561669    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"]
Jul 06 20:03:52.565669 ip-10-0-137-0 kubenswrapper[2576]: W0706 20:03:52.565640    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7842d92a_1f9c_4ac8_b2ac_d006037b22bc.slice/crio-504be387bbc62204402776171030b9f67d5998f14e1c2623651b452ae6b171f4 WatchSource:0}: Error finding container 504be387bbc62204402776171030b9f67d5998f14e1c2623651b452ae6b171f4: Status 404 returned error can't find the container with id 504be387bbc62204402776171030b9f67d5998f14e1c2623651b452ae6b171f4
Jul 06 20:03:52.613128 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:52.613097    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg" event={"ID":"7842d92a-1f9c-4ac8-b2ac-d006037b22bc","Type":"ContainerStarted","Data":"504be387bbc62204402776171030b9f67d5998f14e1c2623651b452ae6b171f4"}
Jul 06 20:03:53.619131 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:53.619091    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg" event={"ID":"7842d92a-1f9c-4ac8-b2ac-d006037b22bc","Type":"ContainerStarted","Data":"47249eef920531da8aafe06fa31fa30bb343117abf274eb34c0d731923e3eb49"}
Jul 06 20:03:53.637163 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:53.637111    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg" podStartSLOduration=1.637097023 podStartE2EDuration="1.637097023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:03:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:03:53.636306529 +0000 UTC m=+2198.864299553" watchObservedRunningTime="2026-07-06 20:03:53.637097023 +0000 UTC m=+2198.865090026"
Jul 06 20:03:55.305269 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:03:55.305231    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:04:02.424239 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:04:02.424199    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:04:02.424792 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:04:02.424258    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:04:02.437037 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:04:02.437011    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:04:02.669033 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:04:02.669003    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:04:31.792761 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:04:31.792722    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:04:47.408692 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:04:47.408591    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:05:03.503419 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:05:03.503382    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:05:18.701626 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:05:18.701582    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:05:35.912848 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:05:35.912810    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:05:52.297599 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:05:52.297557    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:06:08.399683 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:08.399587    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:06:12.360364 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:12.360327    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"]
Jul 06 20:06:13.290812 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:13.290782    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"]
Jul 06 20:06:25.197555 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:25.197518    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:06:27.380141 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.380098    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb" podUID="1b860c7e-bf9c-4e74-8a9b-268b764e10c9" containerName="main" containerID="cri-o://95cfa92cb9f84f1c8a38b7462f5244e7a145da7877f934ad91f7e771a02face4" gracePeriod=45
Jul 06 20:06:27.629938 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.629894    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:06:27.778201 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.778165    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-255rb\" (UniqueName: \"kubernetes.io/projected/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-kube-api-access-255rb\") pod \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") "
Jul 06 20:06:27.778387 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.778227    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-tmp-dir\") pod \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") "
Jul 06 20:06:27.778387 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.778266    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-home\") pod \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") "
Jul 06 20:06:27.778387 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.778314    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-tls-certs\") pod \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") "
Jul 06 20:06:27.778387 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.778347    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-model-cache\") pod \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") "
Jul 06 20:06:27.778387 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.778374    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-dshm\") pod \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\" (UID: \"1b860c7e-bf9c-4e74-8a9b-268b764e10c9\") "
Jul 06 20:06:27.778670 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.778531    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1b860c7e-bf9c-4e74-8a9b-268b764e10c9" (UID: "1b860c7e-bf9c-4e74-8a9b-268b764e10c9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:27.778670 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.778602    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-home" (OuterVolumeSpecName: "home") pod "1b860c7e-bf9c-4e74-8a9b-268b764e10c9" (UID: "1b860c7e-bf9c-4e74-8a9b-268b764e10c9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:27.778670 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.778630    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-model-cache" (OuterVolumeSpecName: "model-cache") pod "1b860c7e-bf9c-4e74-8a9b-268b764e10c9" (UID: "1b860c7e-bf9c-4e74-8a9b-268b764e10c9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:27.778798 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.778693    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:06:27.780516 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.780490    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-dshm" (OuterVolumeSpecName: "dshm") pod "1b860c7e-bf9c-4e74-8a9b-268b764e10c9" (UID: "1b860c7e-bf9c-4e74-8a9b-268b764e10c9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:27.780619 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.780521    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-kube-api-access-255rb" (OuterVolumeSpecName: "kube-api-access-255rb") pod "1b860c7e-bf9c-4e74-8a9b-268b764e10c9" (UID: "1b860c7e-bf9c-4e74-8a9b-268b764e10c9"). InnerVolumeSpecName "kube-api-access-255rb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:06:27.780619 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.780583    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1b860c7e-bf9c-4e74-8a9b-268b764e10c9" (UID: "1b860c7e-bf9c-4e74-8a9b-268b764e10c9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:06:27.879325 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.879289    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:06:27.879325 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.879319    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:06:27.879325 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.879329    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-255rb\" (UniqueName: \"kubernetes.io/projected/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-kube-api-access-255rb\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:06:27.879559 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.879338    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:06:27.879559 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:27.879348    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b860c7e-bf9c-4e74-8a9b-268b764e10c9-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:06:28.297514 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.297484    2576 generic.go:356] "Generic (PLEG): container finished" podID="1b860c7e-bf9c-4e74-8a9b-268b764e10c9" containerID="95cfa92cb9f84f1c8a38b7462f5244e7a145da7877f934ad91f7e771a02face4" exitCode=0
Jul 06 20:06:28.297691 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.297531    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"
Jul 06 20:06:28.297691 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.297547    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb" event={"ID":"1b860c7e-bf9c-4e74-8a9b-268b764e10c9","Type":"ContainerDied","Data":"95cfa92cb9f84f1c8a38b7462f5244e7a145da7877f934ad91f7e771a02face4"}
Jul 06 20:06:28.297691 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.297581    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb" event={"ID":"1b860c7e-bf9c-4e74-8a9b-268b764e10c9","Type":"ContainerDied","Data":"9cd875be8abb75d71352b2c6a1863774d11598ee2e9fdb4dba79a15d8a687619"}
Jul 06 20:06:28.297691 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.297598    2576 scope.go:117] "RemoveContainer" containerID="95cfa92cb9f84f1c8a38b7462f5244e7a145da7877f934ad91f7e771a02face4"
Jul 06 20:06:28.306800 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.306775    2576 scope.go:117] "RemoveContainer" containerID="95cfa92cb9f84f1c8a38b7462f5244e7a145da7877f934ad91f7e771a02face4"
Jul 06 20:06:28.307107 ip-10-0-137-0 kubenswrapper[2576]: E0706 20:06:28.307078    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95cfa92cb9f84f1c8a38b7462f5244e7a145da7877f934ad91f7e771a02face4\": container with ID starting with 95cfa92cb9f84f1c8a38b7462f5244e7a145da7877f934ad91f7e771a02face4 not found: ID does not exist" containerID="95cfa92cb9f84f1c8a38b7462f5244e7a145da7877f934ad91f7e771a02face4"
Jul 06 20:06:28.307200 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.307120    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95cfa92cb9f84f1c8a38b7462f5244e7a145da7877f934ad91f7e771a02face4"} err="failed to get container status \"95cfa92cb9f84f1c8a38b7462f5244e7a145da7877f934ad91f7e771a02face4\": rpc error: code = NotFound desc = could not find container \"95cfa92cb9f84f1c8a38b7462f5244e7a145da7877f934ad91f7e771a02face4\": container with ID starting with 95cfa92cb9f84f1c8a38b7462f5244e7a145da7877f934ad91f7e771a02face4 not found: ID does not exist"
Jul 06 20:06:28.313365 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.313336    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg" podUID="7842d92a-1f9c-4ac8-b2ac-d006037b22bc" containerName="main" containerID="cri-o://47249eef920531da8aafe06fa31fa30bb343117abf274eb34c0d731923e3eb49" gracePeriod=45
Jul 06 20:06:28.321378 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.321348    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"]
Jul 06 20:06:28.325303 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.325279    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/auth-test-model-4430fb-kserve-67f6bdbbf9-f98xb"]
Jul 06 20:06:28.555904 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.555844    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:06:28.685166 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.685129    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-tls-certs\") pod \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") "
Jul 06 20:06:28.685333 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.685175    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-tmp-dir\") pod \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") "
Jul 06 20:06:28.685333 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.685223    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5w56\" (UniqueName: \"kubernetes.io/projected/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-kube-api-access-t5w56\") pod \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") "
Jul 06 20:06:28.685333 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.685323    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-dshm\") pod \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") "
Jul 06 20:06:28.685442 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.685352    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-model-cache\") pod \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") "
Jul 06 20:06:28.685442 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.685424    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7842d92a-1f9c-4ac8-b2ac-d006037b22bc" (UID: "7842d92a-1f9c-4ac8-b2ac-d006037b22bc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:28.685546 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.685432    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-home\") pod \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\" (UID: \"7842d92a-1f9c-4ac8-b2ac-d006037b22bc\") "
Jul 06 20:06:28.685641 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.685615    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-home" (OuterVolumeSpecName: "home") pod "7842d92a-1f9c-4ac8-b2ac-d006037b22bc" (UID: "7842d92a-1f9c-4ac8-b2ac-d006037b22bc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:28.685754 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.685633    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-model-cache" (OuterVolumeSpecName: "model-cache") pod "7842d92a-1f9c-4ac8-b2ac-d006037b22bc" (UID: "7842d92a-1f9c-4ac8-b2ac-d006037b22bc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:28.685794 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.685767    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:06:28.685794 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.685786    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:06:28.685870 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.685800    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:06:28.687440 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.687417    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7842d92a-1f9c-4ac8-b2ac-d006037b22bc" (UID: "7842d92a-1f9c-4ac8-b2ac-d006037b22bc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:06:28.687535 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.687481    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-kube-api-access-t5w56" (OuterVolumeSpecName: "kube-api-access-t5w56") pod "7842d92a-1f9c-4ac8-b2ac-d006037b22bc" (UID: "7842d92a-1f9c-4ac8-b2ac-d006037b22bc"). InnerVolumeSpecName "kube-api-access-t5w56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:06:28.687535 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.687491    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-dshm" (OuterVolumeSpecName: "dshm") pod "7842d92a-1f9c-4ac8-b2ac-d006037b22bc" (UID: "7842d92a-1f9c-4ac8-b2ac-d006037b22bc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:06:28.787164 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.787124    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:06:28.787164 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.787156    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5w56\" (UniqueName: \"kubernetes.io/projected/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-kube-api-access-t5w56\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:06:28.787164 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.787170    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7842d92a-1f9c-4ac8-b2ac-d006037b22bc-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:06:28.839471 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.839385    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"]
Jul 06 20:06:28.839742 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.839721    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b860c7e-bf9c-4e74-8a9b-268b764e10c9" containerName="main"
Jul 06 20:06:28.839742 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.839734    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b860c7e-bf9c-4e74-8a9b-268b764e10c9" containerName="main"
Jul 06 20:06:28.839820 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.839745    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7842d92a-1f9c-4ac8-b2ac-d006037b22bc" containerName="main"
Jul 06 20:06:28.839820 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.839750    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7842d92a-1f9c-4ac8-b2ac-d006037b22bc" containerName="main"
Jul 06 20:06:28.839820 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.839802    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7842d92a-1f9c-4ac8-b2ac-d006037b22bc" containerName="main"
Jul 06 20:06:28.839820 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.839812    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b860c7e-bf9c-4e74-8a9b-268b764e10c9" containerName="main"
Jul 06 20:06:28.842769 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.842752    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:28.845638 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.845615    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4430fb\"/\"kube-root-ca.crt\""
Jul 06 20:06:28.846964 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.846945    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4430fb\"/\"sub-test-model-4430fb-kserve-self-signed-certs\""
Jul 06 20:06:28.847074 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.846981    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4430fb\"/\"default-dockercfg-z5mbn\""
Jul 06 20:06:28.847074 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.846985    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4430fb\"/\"openshift-service-ca.crt\""
Jul 06 20:06:28.854337 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.854310    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"]
Jul 06 20:06:28.989046 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.989006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-tmp-dir\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:28.989219 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.989054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-tls-certs\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:28.989219 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.989085    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-dshm\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:28.989219 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.989148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-home\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:28.989219 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.989195    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-model-cache\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:28.989353 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:28.989251    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prxpd\" (UniqueName: \"kubernetes.io/projected/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-kube-api-access-prxpd\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.090505 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.090411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-model-cache\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.090505 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.090465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prxpd\" (UniqueName: \"kubernetes.io/projected/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-kube-api-access-prxpd\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.090693 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.090519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-tmp-dir\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.090693 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.090557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-tls-certs\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.090693 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.090589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-dshm\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.090693 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.090614    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-home\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.090947 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.090907    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-model-cache\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.090993 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.090950    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-tmp-dir\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.090993 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.090984    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-home\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.093130 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.093104    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-dshm\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.093240 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.093136    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-tls-certs\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.099900 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.099872    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prxpd\" (UniqueName: \"kubernetes.io/projected/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-kube-api-access-prxpd\") pod \"sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") " pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.151763 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.151726    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:29.284688 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.284646    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b860c7e-bf9c-4e74-8a9b-268b764e10c9" path="/var/lib/kubelet/pods/1b860c7e-bf9c-4e74-8a9b-268b764e10c9/volumes"
Jul 06 20:06:29.287784 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.287752    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"]
Jul 06 20:06:29.291237 ip-10-0-137-0 kubenswrapper[2576]: W0706 20:06:29.291207    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e10f86a_a2ac_4d77_9cf0_ac178fb82e28.slice/crio-1a19073dadee497364104f6e6fe6b147ff70e83e6bbd3291cb679bf2c058ac45 WatchSource:0}: Error finding container 1a19073dadee497364104f6e6fe6b147ff70e83e6bbd3291cb679bf2c058ac45: Status 404 returned error can't find the container with id 1a19073dadee497364104f6e6fe6b147ff70e83e6bbd3291cb679bf2c058ac45
Jul 06 20:06:29.303813 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.303781    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc" event={"ID":"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28","Type":"ContainerStarted","Data":"1a19073dadee497364104f6e6fe6b147ff70e83e6bbd3291cb679bf2c058ac45"}
Jul 06 20:06:29.304906 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.304884    2576 generic.go:356] "Generic (PLEG): container finished" podID="7842d92a-1f9c-4ac8-b2ac-d006037b22bc" containerID="47249eef920531da8aafe06fa31fa30bb343117abf274eb34c0d731923e3eb49" exitCode=0
Jul 06 20:06:29.305003 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.304951    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg" event={"ID":"7842d92a-1f9c-4ac8-b2ac-d006037b22bc","Type":"ContainerDied","Data":"47249eef920531da8aafe06fa31fa30bb343117abf274eb34c0d731923e3eb49"}
Jul 06 20:06:29.305003 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.304966    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"
Jul 06 20:06:29.305003 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.304988    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg" event={"ID":"7842d92a-1f9c-4ac8-b2ac-d006037b22bc","Type":"ContainerDied","Data":"504be387bbc62204402776171030b9f67d5998f14e1c2623651b452ae6b171f4"}
Jul 06 20:06:29.305117 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.305010    2576 scope.go:117] "RemoveContainer" containerID="47249eef920531da8aafe06fa31fa30bb343117abf274eb34c0d731923e3eb49"
Jul 06 20:06:29.313692 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.313677    2576 scope.go:117] "RemoveContainer" containerID="47249eef920531da8aafe06fa31fa30bb343117abf274eb34c0d731923e3eb49"
Jul 06 20:06:29.313965 ip-10-0-137-0 kubenswrapper[2576]: E0706 20:06:29.313941    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47249eef920531da8aafe06fa31fa30bb343117abf274eb34c0d731923e3eb49\": container with ID starting with 47249eef920531da8aafe06fa31fa30bb343117abf274eb34c0d731923e3eb49 not found: ID does not exist" containerID="47249eef920531da8aafe06fa31fa30bb343117abf274eb34c0d731923e3eb49"
Jul 06 20:06:29.314026 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.313972    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47249eef920531da8aafe06fa31fa30bb343117abf274eb34c0d731923e3eb49"} err="failed to get container status \"47249eef920531da8aafe06fa31fa30bb343117abf274eb34c0d731923e3eb49\": rpc error: code = NotFound desc = could not find container \"47249eef920531da8aafe06fa31fa30bb343117abf274eb34c0d731923e3eb49\": container with ID starting with 47249eef920531da8aafe06fa31fa30bb343117abf274eb34c0d731923e3eb49 not found: ID does not exist"
Jul 06 20:06:29.324649 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.324621    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"]
Jul 06 20:06:29.329143 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:29.329121    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/auth-test-model-33ae61-kserve-c8694f7ff-ckshg"]
Jul 06 20:06:30.312728 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:30.312686    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc" event={"ID":"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28","Type":"ContainerStarted","Data":"ddbf4cc651246f688bb25e3a2332dc4cc46f63730963cfc7e9f29f4f2bfef062"}
Jul 06 20:06:30.332336 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:30.332283    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc" podStartSLOduration=2.332268865 podStartE2EDuration="2.332268865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:30.33085187 +0000 UTC m=+2355.558844883" watchObservedRunningTime="2026-07-06 20:06:30.332268865 +0000 UTC m=+2355.560261867"
Jul 06 20:06:31.284786 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:31.284750    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7842d92a-1f9c-4ac8-b2ac-d006037b22bc" path="/var/lib/kubelet/pods/7842d92a-1f9c-4ac8-b2ac-d006037b22bc/volumes"
Jul 06 20:06:32.997636 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:32.997599    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:06:39.151946 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:39.151894    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:39.152492 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:39.152002    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:39.164600 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:39.164570    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:39.370004 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:39.369976    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:06:49.428576 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.428541    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"]
Jul 06 20:06:49.431970 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.431951    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.432431 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.432403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mgrj\" (UniqueName: \"kubernetes.io/projected/63cef295-b60d-49f0-a1ca-8eef970c04a1-kube-api-access-7mgrj\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.432535 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.432449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-model-cache\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.432535 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.432503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-tmp-dir\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.432535 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.432522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-dshm\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.432663 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.432538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63cef295-b60d-49f0-a1ca-8eef970c04a1-tls-certs\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.432663 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.432604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-home\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.436529 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.436509    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-33ae61\"/\"openshift-service-ca.crt\""
Jul 06 20:06:49.436734 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.436720    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-33ae61\"/\"default-dockercfg-2d6kt\""
Jul 06 20:06:49.436824 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.436771    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-33ae61\"/\"kube-root-ca.crt\""
Jul 06 20:06:49.436883 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.436830    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-33ae61\"/\"sub-test-model-33ae61-kserve-self-signed-certs\""
Jul 06 20:06:49.449367 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.449333    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"]
Jul 06 20:06:49.533339 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.533308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-home\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.533534 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.533348    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mgrj\" (UniqueName: \"kubernetes.io/projected/63cef295-b60d-49f0-a1ca-8eef970c04a1-kube-api-access-7mgrj\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.533534 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.533385    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-model-cache\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.533534 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.533417    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-tmp-dir\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.533534 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.533441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-dshm\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.533534 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.533464    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63cef295-b60d-49f0-a1ca-8eef970c04a1-tls-certs\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.533806 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.533776    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-home\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.533849 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.533812    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-model-cache\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.533849 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.533827    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-tmp-dir\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.535647 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.535628    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-dshm\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.535903 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.535886    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63cef295-b60d-49f0-a1ca-8eef970c04a1-tls-certs\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.545430 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.545408    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mgrj\" (UniqueName: \"kubernetes.io/projected/63cef295-b60d-49f0-a1ca-8eef970c04a1-kube-api-access-7mgrj\") pod \"sub-test-model-33ae61-kserve-65fc6d464f-qm6pr\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") " pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.741512 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.741482    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:49.883824 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:49.883798    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"]
Jul 06 20:06:49.886404 ip-10-0-137-0 kubenswrapper[2576]: W0706 20:06:49.886370    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63cef295_b60d_49f0_a1ca_8eef970c04a1.slice/crio-7ac87bbce1e3d055f852e2c1af56a7eb5488a0f7cb282e441a03751a5e36dc1d WatchSource:0}: Error finding container 7ac87bbce1e3d055f852e2c1af56a7eb5488a0f7cb282e441a03751a5e36dc1d: Status 404 returned error can't find the container with id 7ac87bbce1e3d055f852e2c1af56a7eb5488a0f7cb282e441a03751a5e36dc1d
Jul 06 20:06:50.413780 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:50.413738    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr" event={"ID":"63cef295-b60d-49f0-a1ca-8eef970c04a1","Type":"ContainerStarted","Data":"ddbb07732d231a4ab3c8294ae33bc9470268d6e2f94b203f87c6cdf4b7aefdaf"}
Jul 06 20:06:50.414008 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:50.413786    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr" event={"ID":"63cef295-b60d-49f0-a1ca-8eef970c04a1","Type":"ContainerStarted","Data":"7ac87bbce1e3d055f852e2c1af56a7eb5488a0f7cb282e441a03751a5e36dc1d"}
Jul 06 20:06:50.435452 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:50.435403    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr" podStartSLOduration=1.435386541 podStartE2EDuration="1.435386541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:50.435208896 +0000 UTC m=+2375.663201900" watchObservedRunningTime="2026-07-06 20:06:50.435386541 +0000 UTC m=+2375.663379521"
Jul 06 20:06:53.428882 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:53.428841    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:06:59.741719 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:59.741676    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:59.741719 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:59.741724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:06:59.754226 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:06:59.754197    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:07:00.470415 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:00.470387    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:07:07.098845 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:07.098803    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:07:15.362159 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:15.362128    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 20:07:15.365759 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:15.365734    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 20:07:24.636937 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:24.636888    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"]
Jul 06 20:07:25.607486 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:25.607452    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"]
Jul 06 20:07:27.399488 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.399448    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"]
Jul 06 20:07:27.402563 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.402544    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.405318 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.405296    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4430fb\"/\"rate-test-model-4430fb-kserve-self-signed-certs\""
Jul 06 20:07:27.412086 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.412061    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"]
Jul 06 20:07:27.564549 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.564516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pdl5\" (UniqueName: \"kubernetes.io/projected/8506cf19-180b-40c3-8837-7aac187058f8-kube-api-access-6pdl5\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.564730 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.564558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-home\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.564730 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.564579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-dshm\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.564730 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.564658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-model-cache\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.564730 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.564694    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-tmp-dir\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.564730 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.564728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8506cf19-180b-40c3-8837-7aac187058f8-tls-certs\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.665413 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.665319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-model-cache\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.665413 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.665363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-tmp-dir\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.665413 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.665390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8506cf19-180b-40c3-8837-7aac187058f8-tls-certs\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.665681 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.665447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pdl5\" (UniqueName: \"kubernetes.io/projected/8506cf19-180b-40c3-8837-7aac187058f8-kube-api-access-6pdl5\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.665681 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.665477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-home\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.665681 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.665620    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-dshm\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.665823 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.665754    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-model-cache\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.665823 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.665797    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-tmp-dir\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.665904 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.665850    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-home\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.667770 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.667741    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-dshm\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.668075 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.668057    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8506cf19-180b-40c3-8837-7aac187058f8-tls-certs\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.675813 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.675791    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pdl5\" (UniqueName: \"kubernetes.io/projected/8506cf19-180b-40c3-8837-7aac187058f8-kube-api-access-6pdl5\") pod \"rate-test-model-4430fb-kserve-8558b6b487-4g24x\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") " pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.712747 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.712712    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:27.845843 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:27.845811    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"]
Jul 06 20:07:27.848455 ip-10-0-137-0 kubenswrapper[2576]: W0706 20:07:27.848425    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8506cf19_180b_40c3_8837_7aac187058f8.slice/crio-2e18b5cef3cefa133da7ace8a6b0f673ce05014719c9c146de87201f91d721df WatchSource:0}: Error finding container 2e18b5cef3cefa133da7ace8a6b0f673ce05014719c9c146de87201f91d721df: Status 404 returned error can't find the container with id 2e18b5cef3cefa133da7ace8a6b0f673ce05014719c9c146de87201f91d721df
Jul 06 20:07:28.304487 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:28.304450    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:07:28.590194 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:28.590104    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x" event={"ID":"8506cf19-180b-40c3-8837-7aac187058f8","Type":"ContainerStarted","Data":"a445ea479f69abb3579659652e4c1766c4836dc8a2cef34a3e474b3fc056922e"}
Jul 06 20:07:28.590194 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:28.590153    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x" event={"ID":"8506cf19-180b-40c3-8837-7aac187058f8","Type":"ContainerStarted","Data":"2e18b5cef3cefa133da7ace8a6b0f673ce05014719c9c146de87201f91d721df"}
Jul 06 20:07:28.608467 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:28.608412    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x" podStartSLOduration=1.608396785 podStartE2EDuration="1.608396785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:28.60788342 +0000 UTC m=+2413.835876423" watchObservedRunningTime="2026-07-06 20:07:28.608396785 +0000 UTC m=+2413.836389787"
Jul 06 20:07:37.713125 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:37.713031    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:37.713125 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:37.713103    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:37.725986 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:37.725961    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:38.646335 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:38.646301    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:07:39.658782 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:39.658740    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc" podUID="5e10f86a-a2ac-4d77-9cf0-ac178fb82e28" containerName="main" containerID="cri-o://ddbf4cc651246f688bb25e3a2332dc4cc46f63730963cfc7e9f29f4f2bfef062" gracePeriod=45
Jul 06 20:07:39.917862 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:39.917804    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:07:40.075701 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.075665    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-home\") pod \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") "
Jul 06 20:07:40.075873 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.075712    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-tmp-dir\") pod \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") "
Jul 06 20:07:40.075873 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.075755    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prxpd\" (UniqueName: \"kubernetes.io/projected/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-kube-api-access-prxpd\") pod \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") "
Jul 06 20:07:40.075873 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.075776    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-dshm\") pod \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") "
Jul 06 20:07:40.075873 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.075803    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-tls-certs\") pod \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") "
Jul 06 20:07:40.076117 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.075970    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-model-cache\") pod \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\" (UID: \"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28\") "
Jul 06 20:07:40.076117 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.076025    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-home" (OuterVolumeSpecName: "home") pod "5e10f86a-a2ac-4d77-9cf0-ac178fb82e28" (UID: "5e10f86a-a2ac-4d77-9cf0-ac178fb82e28"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:07:40.076210 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.076137    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5e10f86a-a2ac-4d77-9cf0-ac178fb82e28" (UID: "5e10f86a-a2ac-4d77-9cf0-ac178fb82e28"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:07:40.076270 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.076204    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-model-cache" (OuterVolumeSpecName: "model-cache") pod "5e10f86a-a2ac-4d77-9cf0-ac178fb82e28" (UID: "5e10f86a-a2ac-4d77-9cf0-ac178fb82e28"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:07:40.076334 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.076317    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:07:40.076377 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.076338    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:07:40.076377 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.076351    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:07:40.078068 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.078039    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5e10f86a-a2ac-4d77-9cf0-ac178fb82e28" (UID: "5e10f86a-a2ac-4d77-9cf0-ac178fb82e28"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:07:40.078185 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.078087    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-dshm" (OuterVolumeSpecName: "dshm") pod "5e10f86a-a2ac-4d77-9cf0-ac178fb82e28" (UID: "5e10f86a-a2ac-4d77-9cf0-ac178fb82e28"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:07:40.078185 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.078095    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-kube-api-access-prxpd" (OuterVolumeSpecName: "kube-api-access-prxpd") pod "5e10f86a-a2ac-4d77-9cf0-ac178fb82e28" (UID: "5e10f86a-a2ac-4d77-9cf0-ac178fb82e28"). InnerVolumeSpecName "kube-api-access-prxpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:07:40.177069 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.176983    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prxpd\" (UniqueName: \"kubernetes.io/projected/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-kube-api-access-prxpd\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:07:40.177069 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.177015    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:07:40.177069 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.177024    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:07:40.627684 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.627635    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr" podUID="63cef295-b60d-49f0-a1ca-8eef970c04a1" containerName="main" containerID="cri-o://ddbb07732d231a4ab3c8294ae33bc9470268d6e2f94b203f87c6cdf4b7aefdaf" gracePeriod=45
Jul 06 20:07:40.644018 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.643990    2576 generic.go:356] "Generic (PLEG): container finished" podID="5e10f86a-a2ac-4d77-9cf0-ac178fb82e28" containerID="ddbf4cc651246f688bb25e3a2332dc4cc46f63730963cfc7e9f29f4f2bfef062" exitCode=0
Jul 06 20:07:40.644155 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.644029    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"
Jul 06 20:07:40.644155 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.644074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc" event={"ID":"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28","Type":"ContainerDied","Data":"ddbf4cc651246f688bb25e3a2332dc4cc46f63730963cfc7e9f29f4f2bfef062"}
Jul 06 20:07:40.644155 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.644124    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc" event={"ID":"5e10f86a-a2ac-4d77-9cf0-ac178fb82e28","Type":"ContainerDied","Data":"1a19073dadee497364104f6e6fe6b147ff70e83e6bbd3291cb679bf2c058ac45"}
Jul 06 20:07:40.644155 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.644146    2576 scope.go:117] "RemoveContainer" containerID="ddbf4cc651246f688bb25e3a2332dc4cc46f63730963cfc7e9f29f4f2bfef062"
Jul 06 20:07:40.695233 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.695203    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"]
Jul 06 20:07:40.701804 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.701778    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/sub-test-model-4430fb-kserve-69bcbd7cdf-2j6mc"]
Jul 06 20:07:40.737668 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.737540    2576 scope.go:117] "RemoveContainer" containerID="ddbf4cc651246f688bb25e3a2332dc4cc46f63730963cfc7e9f29f4f2bfef062"
Jul 06 20:07:40.737943 ip-10-0-137-0 kubenswrapper[2576]: E0706 20:07:40.737906    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddbf4cc651246f688bb25e3a2332dc4cc46f63730963cfc7e9f29f4f2bfef062\": container with ID starting with ddbf4cc651246f688bb25e3a2332dc4cc46f63730963cfc7e9f29f4f2bfef062 not found: ID does not exist" containerID="ddbf4cc651246f688bb25e3a2332dc4cc46f63730963cfc7e9f29f4f2bfef062"
Jul 06 20:07:40.738006 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.737952    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddbf4cc651246f688bb25e3a2332dc4cc46f63730963cfc7e9f29f4f2bfef062"} err="failed to get container status \"ddbf4cc651246f688bb25e3a2332dc4cc46f63730963cfc7e9f29f4f2bfef062\": rpc error: code = NotFound desc = could not find container \"ddbf4cc651246f688bb25e3a2332dc4cc46f63730963cfc7e9f29f4f2bfef062\": container with ID starting with ddbf4cc651246f688bb25e3a2332dc4cc46f63730963cfc7e9f29f4f2bfef062 not found: ID does not exist"
Jul 06 20:07:40.889632 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.889567    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:07:40.982648 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.982609    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63cef295-b60d-49f0-a1ca-8eef970c04a1-tls-certs\") pod \"63cef295-b60d-49f0-a1ca-8eef970c04a1\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") "
Jul 06 20:07:40.982843 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.982658    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-tmp-dir\") pod \"63cef295-b60d-49f0-a1ca-8eef970c04a1\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") "
Jul 06 20:07:40.982843 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.982694    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-model-cache\") pod \"63cef295-b60d-49f0-a1ca-8eef970c04a1\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") "
Jul 06 20:07:40.982843 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.982716    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-dshm\") pod \"63cef295-b60d-49f0-a1ca-8eef970c04a1\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") "
Jul 06 20:07:40.982843 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.982742    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-home\") pod \"63cef295-b60d-49f0-a1ca-8eef970c04a1\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") "
Jul 06 20:07:40.982843 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.982785    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mgrj\" (UniqueName: \"kubernetes.io/projected/63cef295-b60d-49f0-a1ca-8eef970c04a1-kube-api-access-7mgrj\") pod \"63cef295-b60d-49f0-a1ca-8eef970c04a1\" (UID: \"63cef295-b60d-49f0-a1ca-8eef970c04a1\") "
Jul 06 20:07:40.983129 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.983054    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "63cef295-b60d-49f0-a1ca-8eef970c04a1" (UID: "63cef295-b60d-49f0-a1ca-8eef970c04a1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:07:40.983129 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.983070    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-model-cache" (OuterVolumeSpecName: "model-cache") pod "63cef295-b60d-49f0-a1ca-8eef970c04a1" (UID: "63cef295-b60d-49f0-a1ca-8eef970c04a1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:07:40.983129 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.983062    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-home" (OuterVolumeSpecName: "home") pod "63cef295-b60d-49f0-a1ca-8eef970c04a1" (UID: "63cef295-b60d-49f0-a1ca-8eef970c04a1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:07:40.984917 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.984896    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63cef295-b60d-49f0-a1ca-8eef970c04a1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "63cef295-b60d-49f0-a1ca-8eef970c04a1" (UID: "63cef295-b60d-49f0-a1ca-8eef970c04a1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:07:40.985020 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.984959    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63cef295-b60d-49f0-a1ca-8eef970c04a1-kube-api-access-7mgrj" (OuterVolumeSpecName: "kube-api-access-7mgrj") pod "63cef295-b60d-49f0-a1ca-8eef970c04a1" (UID: "63cef295-b60d-49f0-a1ca-8eef970c04a1"). InnerVolumeSpecName "kube-api-access-7mgrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:07:40.985020 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:40.985010    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-dshm" (OuterVolumeSpecName: "dshm") pod "63cef295-b60d-49f0-a1ca-8eef970c04a1" (UID: "63cef295-b60d-49f0-a1ca-8eef970c04a1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:07:41.083871 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.083834    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63cef295-b60d-49f0-a1ca-8eef970c04a1-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:07:41.083871 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.083864    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:07:41.083871 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.083873    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:07:41.083871 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.083881    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:07:41.084145 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.083890    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63cef295-b60d-49f0-a1ca-8eef970c04a1-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:07:41.084145 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.083897    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mgrj\" (UniqueName: \"kubernetes.io/projected/63cef295-b60d-49f0-a1ca-8eef970c04a1-kube-api-access-7mgrj\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:07:41.284643 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.284607    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e10f86a-a2ac-4d77-9cf0-ac178fb82e28" path="/var/lib/kubelet/pods/5e10f86a-a2ac-4d77-9cf0-ac178fb82e28/volumes"
Jul 06 20:07:41.649914 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.649817    2576 generic.go:356] "Generic (PLEG): container finished" podID="63cef295-b60d-49f0-a1ca-8eef970c04a1" containerID="ddbb07732d231a4ab3c8294ae33bc9470268d6e2f94b203f87c6cdf4b7aefdaf" exitCode=0
Jul 06 20:07:41.649914 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.649867    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"
Jul 06 20:07:41.649914 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.649910    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr" event={"ID":"63cef295-b60d-49f0-a1ca-8eef970c04a1","Type":"ContainerDied","Data":"ddbb07732d231a4ab3c8294ae33bc9470268d6e2f94b203f87c6cdf4b7aefdaf"}
Jul 06 20:07:41.650183 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.649967    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr" event={"ID":"63cef295-b60d-49f0-a1ca-8eef970c04a1","Type":"ContainerDied","Data":"7ac87bbce1e3d055f852e2c1af56a7eb5488a0f7cb282e441a03751a5e36dc1d"}
Jul 06 20:07:41.650183 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.649988    2576 scope.go:117] "RemoveContainer" containerID="ddbb07732d231a4ab3c8294ae33bc9470268d6e2f94b203f87c6cdf4b7aefdaf"
Jul 06 20:07:41.658230 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.658200    2576 scope.go:117] "RemoveContainer" containerID="ddbb07732d231a4ab3c8294ae33bc9470268d6e2f94b203f87c6cdf4b7aefdaf"
Jul 06 20:07:41.658485 ip-10-0-137-0 kubenswrapper[2576]: E0706 20:07:41.658464    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddbb07732d231a4ab3c8294ae33bc9470268d6e2f94b203f87c6cdf4b7aefdaf\": container with ID starting with ddbb07732d231a4ab3c8294ae33bc9470268d6e2f94b203f87c6cdf4b7aefdaf not found: ID does not exist" containerID="ddbb07732d231a4ab3c8294ae33bc9470268d6e2f94b203f87c6cdf4b7aefdaf"
Jul 06 20:07:41.658531 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.658495    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddbb07732d231a4ab3c8294ae33bc9470268d6e2f94b203f87c6cdf4b7aefdaf"} err="failed to get container status \"ddbb07732d231a4ab3c8294ae33bc9470268d6e2f94b203f87c6cdf4b7aefdaf\": rpc error: code = NotFound desc = could not find container \"ddbb07732d231a4ab3c8294ae33bc9470268d6e2f94b203f87c6cdf4b7aefdaf\": container with ID starting with ddbb07732d231a4ab3c8294ae33bc9470268d6e2f94b203f87c6cdf4b7aefdaf not found: ID does not exist"
Jul 06 20:07:41.667542 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.667515    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"]
Jul 06 20:07:41.671522 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:41.671497    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/sub-test-model-33ae61-kserve-65fc6d464f-qm6pr"]
Jul 06 20:07:43.283837 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:43.283798    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63cef295-b60d-49f0-a1ca-8eef970c04a1" path="/var/lib/kubelet/pods/63cef295-b60d-49f0-a1ca-8eef970c04a1/volumes"
Jul 06 20:07:44.135222 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:44.135183    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:07:51.506896 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.506857    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"]
Jul 06 20:07:51.507507 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.507323    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e10f86a-a2ac-4d77-9cf0-ac178fb82e28" containerName="main"
Jul 06 20:07:51.507507 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.507343    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e10f86a-a2ac-4d77-9cf0-ac178fb82e28" containerName="main"
Jul 06 20:07:51.507507 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.507379    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63cef295-b60d-49f0-a1ca-8eef970c04a1" containerName="main"
Jul 06 20:07:51.507507 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.507388    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="63cef295-b60d-49f0-a1ca-8eef970c04a1" containerName="main"
Jul 06 20:07:51.507507 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.507469    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="63cef295-b60d-49f0-a1ca-8eef970c04a1" containerName="main"
Jul 06 20:07:51.507507 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.507486    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e10f86a-a2ac-4d77-9cf0-ac178fb82e28" containerName="main"
Jul 06 20:07:51.512284 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.512262    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.515385 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.515366    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-33ae61\"/\"kube-root-ca.crt\""
Jul 06 20:07:51.516665 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.516638    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-33ae61\"/\"default-dockercfg-2d6kt\""
Jul 06 20:07:51.516829 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.516809    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-33ae61\"/\"rate-test-model-33ae61-kserve-self-signed-certs\""
Jul 06 20:07:51.516916 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.516811    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-33ae61\"/\"openshift-service-ca.crt\""
Jul 06 20:07:51.523376 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.523351    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"]
Jul 06 20:07:51.569511 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.569469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-home\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.569711 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.569522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-dshm\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.569711 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.569550    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-tls-certs\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.569711 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.569601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-model-cache\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.569711 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.569619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-tmp-dir\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.569711 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.569681    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zndcj\" (UniqueName: \"kubernetes.io/projected/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-kube-api-access-zndcj\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.670881 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.670839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-tls-certs\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.671099 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.670891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-model-cache\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.671099 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.670910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-tmp-dir\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.671099 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.670970    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zndcj\" (UniqueName: \"kubernetes.io/projected/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-kube-api-access-zndcj\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.671099 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.671005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-home\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.671099 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.671037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-dshm\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.671375 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.671350    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-model-cache\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.671415 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.671379    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-home\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.671415 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.671397    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-tmp-dir\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.673236 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.673211    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-dshm\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.673386 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.673367    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-tls-certs\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.679115 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.679089    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zndcj\" (UniqueName: \"kubernetes.io/projected/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-kube-api-access-zndcj\") pod \"rate-test-model-33ae61-kserve-76844495f-fmb7f\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") " pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.824951 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.824823    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:07:51.959563 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:51.959395    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"]
Jul 06 20:07:51.962280 ip-10-0-137-0 kubenswrapper[2576]: W0706 20:07:51.962253    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5cd5444_5835_4247_89a5_1ea4c5a2b6cb.slice/crio-355c08a079283cbb56ecd262700ab77f93162e45e2c790c5599eff296047d851 WatchSource:0}: Error finding container 355c08a079283cbb56ecd262700ab77f93162e45e2c790c5599eff296047d851: Status 404 returned error can't find the container with id 355c08a079283cbb56ecd262700ab77f93162e45e2c790c5599eff296047d851
Jul 06 20:07:52.701347 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:52.701311    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f" event={"ID":"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb","Type":"ContainerStarted","Data":"e099d6114bc1a461cf08ea37822ad85cc812f74326b2a4d298c40d455aeee676"}
Jul 06 20:07:52.701347 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:52.701351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f" event={"ID":"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb","Type":"ContainerStarted","Data":"355c08a079283cbb56ecd262700ab77f93162e45e2c790c5599eff296047d851"}
Jul 06 20:07:52.721199 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:52.721086    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f" podStartSLOduration=1.721065973 podStartE2EDuration="1.721065973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:52.720876371 +0000 UTC m=+2437.948869377" watchObservedRunningTime="2026-07-06 20:07:52.721065973 +0000 UTC m=+2437.949058976"
Jul 06 20:07:56.001852 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:07:56.001813    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:08:01.825207 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:01.825166    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:08:01.825697 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:01.825225    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:08:01.837850 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:01.837822    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:08:02.755396 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:02.755362    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:08:09.533476 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:09.533436    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:08:23.696703 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:23.696665    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:08:30.621234 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:30.621196    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"]
Jul 06 20:08:31.485408 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:31.485370    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"]
Jul 06 20:08:37.414444 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:37.414408    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:08:45.640748 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.640693    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x" podUID="8506cf19-180b-40c3-8837-7aac187058f8" containerName="main" containerID="cri-o://a445ea479f69abb3579659652e4c1766c4836dc8a2cef34a3e474b3fc056922e" gracePeriod=45
Jul 06 20:08:45.895475 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.895402    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:08:45.939992 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.939958    2576 generic.go:356] "Generic (PLEG): container finished" podID="8506cf19-180b-40c3-8837-7aac187058f8" containerID="a445ea479f69abb3579659652e4c1766c4836dc8a2cef34a3e474b3fc056922e" exitCode=0
Jul 06 20:08:45.940166 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.939999    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"
Jul 06 20:08:45.940166 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.940040    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x" event={"ID":"8506cf19-180b-40c3-8837-7aac187058f8","Type":"ContainerDied","Data":"a445ea479f69abb3579659652e4c1766c4836dc8a2cef34a3e474b3fc056922e"}
Jul 06 20:08:45.940166 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.940083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x" event={"ID":"8506cf19-180b-40c3-8837-7aac187058f8","Type":"ContainerDied","Data":"2e18b5cef3cefa133da7ace8a6b0f673ce05014719c9c146de87201f91d721df"}
Jul 06 20:08:45.940166 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.940100    2576 scope.go:117] "RemoveContainer" containerID="a445ea479f69abb3579659652e4c1766c4836dc8a2cef34a3e474b3fc056922e"
Jul 06 20:08:45.950360 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.950341    2576 scope.go:117] "RemoveContainer" containerID="a445ea479f69abb3579659652e4c1766c4836dc8a2cef34a3e474b3fc056922e"
Jul 06 20:08:45.950642 ip-10-0-137-0 kubenswrapper[2576]: E0706 20:08:45.950623    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a445ea479f69abb3579659652e4c1766c4836dc8a2cef34a3e474b3fc056922e\": container with ID starting with a445ea479f69abb3579659652e4c1766c4836dc8a2cef34a3e474b3fc056922e not found: ID does not exist" containerID="a445ea479f69abb3579659652e4c1766c4836dc8a2cef34a3e474b3fc056922e"
Jul 06 20:08:45.950688 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.950655    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a445ea479f69abb3579659652e4c1766c4836dc8a2cef34a3e474b3fc056922e"} err="failed to get container status \"a445ea479f69abb3579659652e4c1766c4836dc8a2cef34a3e474b3fc056922e\": rpc error: code = NotFound desc = could not find container \"a445ea479f69abb3579659652e4c1766c4836dc8a2cef34a3e474b3fc056922e\": container with ID starting with a445ea479f69abb3579659652e4c1766c4836dc8a2cef34a3e474b3fc056922e not found: ID does not exist"
Jul 06 20:08:45.958113 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.958087    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-dshm\") pod \"8506cf19-180b-40c3-8837-7aac187058f8\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") "
Jul 06 20:08:45.958239 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.958130    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pdl5\" (UniqueName: \"kubernetes.io/projected/8506cf19-180b-40c3-8837-7aac187058f8-kube-api-access-6pdl5\") pod \"8506cf19-180b-40c3-8837-7aac187058f8\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") "
Jul 06 20:08:45.958239 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.958154    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-model-cache\") pod \"8506cf19-180b-40c3-8837-7aac187058f8\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") "
Jul 06 20:08:45.958239 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.958177    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-tmp-dir\") pod \"8506cf19-180b-40c3-8837-7aac187058f8\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") "
Jul 06 20:08:45.958239 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.958216    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8506cf19-180b-40c3-8837-7aac187058f8-tls-certs\") pod \"8506cf19-180b-40c3-8837-7aac187058f8\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") "
Jul 06 20:08:45.958507 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.958243    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-home\") pod \"8506cf19-180b-40c3-8837-7aac187058f8\" (UID: \"8506cf19-180b-40c3-8837-7aac187058f8\") "
Jul 06 20:08:45.958507 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.958410    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-model-cache" (OuterVolumeSpecName: "model-cache") pod "8506cf19-180b-40c3-8837-7aac187058f8" (UID: "8506cf19-180b-40c3-8837-7aac187058f8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:45.958507 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.958439    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8506cf19-180b-40c3-8837-7aac187058f8" (UID: "8506cf19-180b-40c3-8837-7aac187058f8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:45.958673 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.958587    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-home" (OuterVolumeSpecName: "home") pod "8506cf19-180b-40c3-8837-7aac187058f8" (UID: "8506cf19-180b-40c3-8837-7aac187058f8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:45.960289 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.960268    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-dshm" (OuterVolumeSpecName: "dshm") pod "8506cf19-180b-40c3-8837-7aac187058f8" (UID: "8506cf19-180b-40c3-8837-7aac187058f8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:45.960386 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.960284    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8506cf19-180b-40c3-8837-7aac187058f8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8506cf19-180b-40c3-8837-7aac187058f8" (UID: "8506cf19-180b-40c3-8837-7aac187058f8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:08:45.960386 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:45.960366    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8506cf19-180b-40c3-8837-7aac187058f8-kube-api-access-6pdl5" (OuterVolumeSpecName: "kube-api-access-6pdl5") pod "8506cf19-180b-40c3-8837-7aac187058f8" (UID: "8506cf19-180b-40c3-8837-7aac187058f8"). InnerVolumeSpecName "kube-api-access-6pdl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:08:46.059014 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.058978    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8506cf19-180b-40c3-8837-7aac187058f8-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:08:46.059014 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.059006    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:08:46.059014 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.059014    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:08:46.059237 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.059025    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pdl5\" (UniqueName: \"kubernetes.io/projected/8506cf19-180b-40c3-8837-7aac187058f8-kube-api-access-6pdl5\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:08:46.059237 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.059036    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:08:46.059237 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.059045    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8506cf19-180b-40c3-8837-7aac187058f8-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:08:46.265302 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.265267    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"]
Jul 06 20:08:46.270167 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.270143    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4430fb/rate-test-model-4430fb-kserve-8558b6b487-4g24x"]
Jul 06 20:08:46.505239 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.505138    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f" podUID="e5cd5444-5835-4247-89a5-1ea4c5a2b6cb" containerName="main" containerID="cri-o://e099d6114bc1a461cf08ea37822ad85cc812f74326b2a4d298c40d455aeee676" gracePeriod=45
Jul 06 20:08:46.754152 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.754125    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:08:46.765079 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.765016    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-tmp-dir\") pod \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") "
Jul 06 20:08:46.765079 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.765062    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zndcj\" (UniqueName: \"kubernetes.io/projected/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-kube-api-access-zndcj\") pod \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") "
Jul 06 20:08:46.765298 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.765096    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-model-cache\") pod \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") "
Jul 06 20:08:46.765298 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.765136    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-tls-certs\") pod \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") "
Jul 06 20:08:46.765404 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.765292    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e5cd5444-5835-4247-89a5-1ea4c5a2b6cb" (UID: "e5cd5444-5835-4247-89a5-1ea4c5a2b6cb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:46.765404 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.765319    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-dshm\") pod \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") "
Jul 06 20:08:46.765404 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.765378    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-model-cache" (OuterVolumeSpecName: "model-cache") pod "e5cd5444-5835-4247-89a5-1ea4c5a2b6cb" (UID: "e5cd5444-5835-4247-89a5-1ea4c5a2b6cb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:46.765404 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.765385    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-home\") pod \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\" (UID: \"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb\") "
Jul 06 20:08:46.765614 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.765583    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-home" (OuterVolumeSpecName: "home") pod "e5cd5444-5835-4247-89a5-1ea4c5a2b6cb" (UID: "e5cd5444-5835-4247-89a5-1ea4c5a2b6cb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:46.765735 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.765719    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:08:46.765813 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.765740    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:08:46.765813 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.765754    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:08:46.767238 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.767213    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-dshm" (OuterVolumeSpecName: "dshm") pod "e5cd5444-5835-4247-89a5-1ea4c5a2b6cb" (UID: "e5cd5444-5835-4247-89a5-1ea4c5a2b6cb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:08:46.767705 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.767684    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e5cd5444-5835-4247-89a5-1ea4c5a2b6cb" (UID: "e5cd5444-5835-4247-89a5-1ea4c5a2b6cb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 20:08:46.767771 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.767698    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-kube-api-access-zndcj" (OuterVolumeSpecName: "kube-api-access-zndcj") pod "e5cd5444-5835-4247-89a5-1ea4c5a2b6cb" (UID: "e5cd5444-5835-4247-89a5-1ea4c5a2b6cb"). InnerVolumeSpecName "kube-api-access-zndcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:08:46.867029 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.866996    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zndcj\" (UniqueName: \"kubernetes.io/projected/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-kube-api-access-zndcj\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:08:46.867029 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.867024    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:08:46.867029 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.867034    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 06 20:08:46.946056 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.946024    2576 generic.go:356] "Generic (PLEG): container finished" podID="e5cd5444-5835-4247-89a5-1ea4c5a2b6cb" containerID="e099d6114bc1a461cf08ea37822ad85cc812f74326b2a4d298c40d455aeee676" exitCode=0
Jul 06 20:08:46.946222 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.946069    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"
Jul 06 20:08:46.946222 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.946085    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f" event={"ID":"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb","Type":"ContainerDied","Data":"e099d6114bc1a461cf08ea37822ad85cc812f74326b2a4d298c40d455aeee676"}
Jul 06 20:08:46.946222 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.946113    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f" event={"ID":"e5cd5444-5835-4247-89a5-1ea4c5a2b6cb","Type":"ContainerDied","Data":"355c08a079283cbb56ecd262700ab77f93162e45e2c790c5599eff296047d851"}
Jul 06 20:08:46.946222 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.946132    2576 scope.go:117] "RemoveContainer" containerID="e099d6114bc1a461cf08ea37822ad85cc812f74326b2a4d298c40d455aeee676"
Jul 06 20:08:46.955414 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.955398    2576 scope.go:117] "RemoveContainer" containerID="e099d6114bc1a461cf08ea37822ad85cc812f74326b2a4d298c40d455aeee676"
Jul 06 20:08:46.955678 ip-10-0-137-0 kubenswrapper[2576]: E0706 20:08:46.955656    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e099d6114bc1a461cf08ea37822ad85cc812f74326b2a4d298c40d455aeee676\": container with ID starting with e099d6114bc1a461cf08ea37822ad85cc812f74326b2a4d298c40d455aeee676 not found: ID does not exist" containerID="e099d6114bc1a461cf08ea37822ad85cc812f74326b2a4d298c40d455aeee676"
Jul 06 20:08:46.955725 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.955687    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e099d6114bc1a461cf08ea37822ad85cc812f74326b2a4d298c40d455aeee676"} err="failed to get container status \"e099d6114bc1a461cf08ea37822ad85cc812f74326b2a4d298c40d455aeee676\": rpc error: code = NotFound desc = could not find container \"e099d6114bc1a461cf08ea37822ad85cc812f74326b2a4d298c40d455aeee676\": container with ID starting with e099d6114bc1a461cf08ea37822ad85cc812f74326b2a4d298c40d455aeee676 not found: ID does not exist"
Jul 06 20:08:46.968150 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.968122    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"]
Jul 06 20:08:46.970649 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:46.970627    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-33ae61/rate-test-model-33ae61-kserve-76844495f-fmb7f"]
Jul 06 20:08:47.285057 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:47.285026    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8506cf19-180b-40c3-8837-7aac187058f8" path="/var/lib/kubelet/pods/8506cf19-180b-40c3-8837-7aac187058f8/volumes"
Jul 06 20:08:47.285421 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:08:47.285409    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5cd5444-5835-4247-89a5-1ea4c5a2b6cb" path="/var/lib/kubelet/pods/e5cd5444-5835-4247-89a5-1ea4c5a2b6cb/volumes"
Jul 06 20:09:19.496987 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:19.496941    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-vjgqc"]
Jul 06 20:09:23.671774 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:23.671734    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-655ffcd44c-bl5w6_16daf124-eb84-4c77-bbec-723ba98090dc/authorino/0.log"
Jul 06 20:09:29.337356 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:29.337325    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rkrkw_2364ecbe-fc16-4561-8614-9038f214d43f/server/0.log"
Jul 06 20:09:29.459626 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:29.459598    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-slqqq_617844bf-63eb-4b8b-851f-e847e2db57da/manager/0.log"
Jul 06 20:09:29.581339 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:29.581310    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57b585888c-26kfq_4c5e0086-8275-4d1d-afd5-c24f825f52ba/copy-manifests/0.log"
Jul 06 20:09:29.589432 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:29.589360    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57b585888c-26kfq_4c5e0086-8275-4d1d-afd5-c24f825f52ba/manager/0.log"
Jul 06 20:09:31.360984 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:31.360955    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-655ffcd44c-bl5w6_16daf124-eb84-4c77-bbec-723ba98090dc/authorino/0.log"
Jul 06 20:09:32.165086 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:32.165057    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vjgqc_c2a9cc63-c58d-4592-93a8-e21da42bb242/limitador/0.log"
Jul 06 20:09:33.057469 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:33.057440    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f6467984-dt9rt_6b4c52d3-7d23-46d6-bca2-98dbbf17da09/kube-auth-proxy/0.log"
Jul 06 20:09:33.564885 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:33.564857    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f94c4c7c-nxhtn_8f1d07bb-becf-4294-ad8d-cfe48d58a638/router/0.log"
Jul 06 20:09:34.543770 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:34.543737    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-wsqkg_be1358c0-4b2d-47ba-8ccd-d5f2dc8c54aa/main/0.log"
Jul 06 20:09:38.966797 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:38.966761    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f6s5f/must-gather-6qqjr"]
Jul 06 20:09:38.967225 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:38.967094    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5cd5444-5835-4247-89a5-1ea4c5a2b6cb" containerName="main"
Jul 06 20:09:38.967225 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:38.967105    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5cd5444-5835-4247-89a5-1ea4c5a2b6cb" containerName="main"
Jul 06 20:09:38.967225 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:38.967115    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8506cf19-180b-40c3-8837-7aac187058f8" containerName="main"
Jul 06 20:09:38.967225 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:38.967121    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8506cf19-180b-40c3-8837-7aac187058f8" containerName="main"
Jul 06 20:09:38.967225 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:38.967167    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8506cf19-180b-40c3-8837-7aac187058f8" containerName="main"
Jul 06 20:09:38.967225 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:38.967177    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5cd5444-5835-4247-89a5-1ea4c5a2b6cb" containerName="main"
Jul 06 20:09:38.970300 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:38.970281    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f6s5f/must-gather-6qqjr"
Jul 06 20:09:38.973168 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:38.973101    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f6s5f\"/\"openshift-service-ca.crt\""
Jul 06 20:09:38.973168 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:38.973143    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f6s5f\"/\"kube-root-ca.crt\""
Jul 06 20:09:38.974468 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:38.974452    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f6s5f\"/\"default-dockercfg-p6z85\""
Jul 06 20:09:38.981711 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:38.981684    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f6s5f/must-gather-6qqjr"]
Jul 06 20:09:39.005022 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:39.004989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgbrz\" (UniqueName: \"kubernetes.io/projected/3dbe9403-0c7e-47bf-8978-0ab4483b01f1-kube-api-access-jgbrz\") pod \"must-gather-6qqjr\" (UID: \"3dbe9403-0c7e-47bf-8978-0ab4483b01f1\") " pod="openshift-must-gather-f6s5f/must-gather-6qqjr"
Jul 06 20:09:39.005155 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:39.005034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3dbe9403-0c7e-47bf-8978-0ab4483b01f1-must-gather-output\") pod \"must-gather-6qqjr\" (UID: \"3dbe9403-0c7e-47bf-8978-0ab4483b01f1\") " pod="openshift-must-gather-f6s5f/must-gather-6qqjr"
Jul 06 20:09:39.106006 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:39.105969    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgbrz\" (UniqueName: \"kubernetes.io/projected/3dbe9403-0c7e-47bf-8978-0ab4483b01f1-kube-api-access-jgbrz\") pod \"must-gather-6qqjr\" (UID: \"3dbe9403-0c7e-47bf-8978-0ab4483b01f1\") " pod="openshift-must-gather-f6s5f/must-gather-6qqjr"
Jul 06 20:09:39.106170 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:39.106024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3dbe9403-0c7e-47bf-8978-0ab4483b01f1-must-gather-output\") pod \"must-gather-6qqjr\" (UID: \"3dbe9403-0c7e-47bf-8978-0ab4483b01f1\") " pod="openshift-must-gather-f6s5f/must-gather-6qqjr"
Jul 06 20:09:39.106324 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:39.106310    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3dbe9403-0c7e-47bf-8978-0ab4483b01f1-must-gather-output\") pod \"must-gather-6qqjr\" (UID: \"3dbe9403-0c7e-47bf-8978-0ab4483b01f1\") " pod="openshift-must-gather-f6s5f/must-gather-6qqjr"
Jul 06 20:09:39.117139 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:39.117107    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgbrz\" (UniqueName: \"kubernetes.io/projected/3dbe9403-0c7e-47bf-8978-0ab4483b01f1-kube-api-access-jgbrz\") pod \"must-gather-6qqjr\" (UID: \"3dbe9403-0c7e-47bf-8978-0ab4483b01f1\") " pod="openshift-must-gather-f6s5f/must-gather-6qqjr"
Jul 06 20:09:39.279036 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:39.278905    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f6s5f/must-gather-6qqjr"
Jul 06 20:09:39.412489 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:39.412464    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f6s5f/must-gather-6qqjr"]
Jul 06 20:09:39.414506 ip-10-0-137-0 kubenswrapper[2576]: W0706 20:09:39.414472    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dbe9403_0c7e_47bf_8978_0ab4483b01f1.slice/crio-f1567cd34776c8503ebf305a4138662d3fc8e22c81d751aa5e9e056337862321 WatchSource:0}: Error finding container f1567cd34776c8503ebf305a4138662d3fc8e22c81d751aa5e9e056337862321: Status 404 returned error can't find the container with id f1567cd34776c8503ebf305a4138662d3fc8e22c81d751aa5e9e056337862321
Jul 06 20:09:39.416768 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:39.416749    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 20:09:40.180976 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:40.180949    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f6s5f/must-gather-6qqjr" event={"ID":"3dbe9403-0c7e-47bf-8978-0ab4483b01f1","Type":"ContainerStarted","Data":"f1567cd34776c8503ebf305a4138662d3fc8e22c81d751aa5e9e056337862321"}
Jul 06 20:09:41.189244 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:41.189169    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f6s5f/must-gather-6qqjr" event={"ID":"3dbe9403-0c7e-47bf-8978-0ab4483b01f1","Type":"ContainerStarted","Data":"b548d1bdf5b428851517bfd61a3d59b5a4243393f6c2acc9416094745eca9f27"}
Jul 06 20:09:41.189673 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:41.189250    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f6s5f/must-gather-6qqjr" event={"ID":"3dbe9403-0c7e-47bf-8978-0ab4483b01f1","Type":"ContainerStarted","Data":"a1b236f75f2008ae52e3c1007408306832f6a15d2000430a900bb16fb6770040"}
Jul 06 20:09:41.799934 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:41.799880    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hfsmd_89bafc65-ad4d-4ba9-8dbb-e3271b0f3cd4/global-pull-secret-syncer/0.log"
Jul 06 20:09:41.948572 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:41.948532    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pckcb_b5e24cbe-0ac2-41f0-9417-e4d3aca0283b/konnectivity-agent/0.log"
Jul 06 20:09:41.998730 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:41.998698    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-0.ec2.internal_d342b56abfb66b655ff620fd56373386/haproxy/0.log"
Jul 06 20:09:47.112563 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:47.112470    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-655ffcd44c-bl5w6_16daf124-eb84-4c77-bbec-723ba98090dc/authorino/0.log"
Jul 06 20:09:47.478708 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:47.478674    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-vjgqc_c2a9cc63-c58d-4592-93a8-e21da42bb242/limitador/0.log"
Jul 06 20:09:49.531513 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:49.531474    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-vsrv2_670e9b5a-7d3d-494a-948e-a2de70b5a967/cluster-monitoring-operator/0.log"
Jul 06 20:09:49.892189 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:49.892094    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6478_1f7ff87e-b0af-49f2-a3e6-a94c9a64344e/node-exporter/0.log"
Jul 06 20:09:49.914518 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:49.914489    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6478_1f7ff87e-b0af-49f2-a3e6-a94c9a64344e/kube-rbac-proxy/0.log"
Jul 06 20:09:49.942138 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:49.942114    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6478_1f7ff87e-b0af-49f2-a3e6-a94c9a64344e/init-textfile/0.log"
Jul 06 20:09:51.776358 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.776285    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f6s5f/must-gather-6qqjr" podStartSLOduration=13.082380103 podStartE2EDuration="13.776263757s" totalImagesPullingTime="693.883654ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:09:41.207087702 +0000 UTC m=+2546.435080704" watchObservedRunningTime="2026-07-06 20:09:51.776263757 +0000 UTC m=+2557.004256761"
Jul 06 20:09:51.778161 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.778127    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"]
Jul 06 20:09:51.786216 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.786193    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.791113 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.791078    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"]
Jul 06 20:09:51.828625 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.828348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-lib-modules\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.828625 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.828418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-sys\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.828625 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.828484    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-podres\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.828625 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.828508    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xwhf\" (UniqueName: \"kubernetes.io/projected/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-kube-api-access-5xwhf\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.828625 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.828544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-proc\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.929161 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.929124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-podres\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.929368 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.929189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xwhf\" (UniqueName: \"kubernetes.io/projected/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-kube-api-access-5xwhf\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.929368 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.929225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-proc\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.929368 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.929291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-lib-modules\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.929368 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.929346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-sys\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.929656 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.929449    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-sys\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.929656 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.929553    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-podres\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.929813 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.929778    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-proc\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.929919 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.929893    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-lib-modules\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:51.938167 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:51.938136    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xwhf\" (UniqueName: \"kubernetes.io/projected/2bda1ec0-4c4a-4536-bed2-fbdf38a76de8-kube-api-access-5xwhf\") pod \"perf-node-gather-daemonset-l59lp\" (UID: \"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8\") " pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:52.103061 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:52.102967    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:52.296856 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:52.296821    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"]
Jul 06 20:09:52.432304 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:52.432269    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/1.log"
Jul 06 20:09:52.438947 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:52.438894    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nfqb8_4ed2f491-2bc3-489a-9df8-bf57ac730b1f/console-operator/2.log"
Jul 06 20:09:53.277906 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:53.277865    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp" event={"ID":"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8","Type":"ContainerStarted","Data":"472d523131bf929a2b8edcc1503e8a9be9951daf7d51dd5b40ee4e2f5a8329bd"}
Jul 06 20:09:53.278390 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:53.277942    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp" event={"ID":"2bda1ec0-4c4a-4536-bed2-fbdf38a76de8","Type":"ContainerStarted","Data":"158c3a3bcd2e507637cd712033b977b07a075f4e32f3b2d8a581b56a1a4693cf"}
Jul 06 20:09:53.278390 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:53.277976    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:09:53.295988 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:53.295893    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp" podStartSLOduration=2.295871911 podStartE2EDuration="2.295871911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:09:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:09:53.293619454 +0000 UTC m=+2558.521612461" watchObservedRunningTime="2026-07-06 20:09:53.295871911 +0000 UTC m=+2558.523864917"
Jul 06 20:09:53.568850 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:53.568777    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-xnpm4_20d07fcc-a2c4-4f44-944b-3778ea6af854/volume-data-source-validator/0.log"
Jul 06 20:09:54.834154 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:54.834120    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qz89z_8d5301c7-fc16-4431-904d-a329e3d6c343/dns/0.log"
Jul 06 20:09:54.859135 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:54.859106    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qz89z_8d5301c7-fc16-4431-904d-a329e3d6c343/kube-rbac-proxy/0.log"
Jul 06 20:09:54.895023 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:54.894999    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cbtfq_b3fbace5-3965-4e94-8b3e-a92366cbb38f/dns-node-resolver/0.log"
Jul 06 20:09:55.566945 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:55.566897    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6blqc_b781508a-c55b-4154-9a5b-4d745c745c60/node-ca/0.log"
Jul 06 20:09:56.720554 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:56.720525    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f6467984-dt9rt_6b4c52d3-7d23-46d6-bca2-98dbbf17da09/kube-auth-proxy/0.log"
Jul 06 20:09:56.913392 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:56.913364    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f94c4c7c-nxhtn_8f1d07bb-becf-4294-ad8d-cfe48d58a638/router/0.log"
Jul 06 20:09:57.676693 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:57.676664    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kkz26_35adfd2e-17ac-4125-806e-f08293363c35/serve-healthcheck-canary/0.log"
Jul 06 20:09:58.152450 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:58.152409    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-pwrxd_bae2d09b-44d8-4ac6-bccf-e5b54a130b9d/insights-operator/0.log"
Jul 06 20:09:58.153143 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:58.153119    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-pwrxd_bae2d09b-44d8-4ac6-bccf-e5b54a130b9d/insights-operator/1.log"
Jul 06 20:09:58.182948 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:58.182897    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7cpgf_2767ceef-f6ed-4abd-8364-8036967f5e76/kube-rbac-proxy/0.log"
Jul 06 20:09:58.207650 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:58.207618    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7cpgf_2767ceef-f6ed-4abd-8364-8036967f5e76/exporter/0.log"
Jul 06 20:09:58.231119 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:58.231091    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7cpgf_2767ceef-f6ed-4abd-8364-8036967f5e76/extractor/0.log"
Jul 06 20:09:59.293459 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:09:59.293425    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f6s5f/perf-node-gather-daemonset-l59lp"
Jul 06 20:10:01.180377 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:10:01.180353    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rkrkw_2364ecbe-fc16-4561-8614-9038f214d43f/server/0.log"
Jul 06 20:10:01.275812 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:10:01.275777    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-slqqq_617844bf-63eb-4b8b-851f-e847e2db57da/manager/0.log"
Jul 06 20:10:01.304619 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:10:01.304581    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57b585888c-26kfq_4c5e0086-8275-4d1d-afd5-c24f825f52ba/manager/0.log"
Jul 06 20:10:01.338060 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:10:01.338025    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57b585888c-26kfq_4c5e0086-8275-4d1d-afd5-c24f825f52ba/copy-manifests/0.log"
Jul 06 20:10:02.620263 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:10:02.620233    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f6467984-dt9rt_6b4c52d3-7d23-46d6-bca2-98dbbf17da09/kube-auth-proxy/0.log"
Jul 06 20:10:02.775383 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:10:02.775347    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f94c4c7c-nxhtn_8f1d07bb-becf-4294-ad8d-cfe48d58a638/router/0.log"
Jul 06 20:10:03.033439 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:10:03.033412    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b7d6b4d5f-q7ftm_727fec8c-1d46-4709-90ab-0559476fab3c/manager/0.log"
Jul 06 20:10:04.160030 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:10:04.160001    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58f6467984-dt9rt_6b4c52d3-7d23-46d6-bca2-98dbbf17da09/kube-auth-proxy/0.log"
Jul 06 20:10:04.333876 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:10:04.333838    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5f94c4c7c-nxhtn_8f1d07bb-becf-4294-ad8d-cfe48d58a638/router/0.log"
Jul 06 20:10:08.469597 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:10:08.469568    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-gz9d4_445c63a3-5129-4382-ac75-a61c3dc3b4cc/kube-storage-version-migrator-operator/1.log"
Jul 06 20:10:08.470499 ip-10-0-137-0 kubenswrapper[2576]: I0706 20:10:08.470452    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-gz9d4_445c63a3-5129-4382-ac75-a61c3dc3b4cc/kube-storage-version-migrator-operator/0.log"