Jul 07 14:04:58.920435 ip-10-0-133-139 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 14:04:58.920447 ip-10-0-133-139 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 14:04:58.920456 ip-10-0-133-139 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 14:04:58.920779 ip-10-0-133-139 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 14:05:10.427217 ip-10-0-133-139 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 14:05:10.427236 ip-10-0-133-139 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b7c54cb6c3b541868a6f5c32c54737cf --
Jul 07 14:06:50.509553 ip-10-0-133-139 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.920651    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925422    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925436    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925440    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925444    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925447    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925450    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925453    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:06:51.039935 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925456    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:06:50.988674 ip-10-0-133-139 systemd[1]: Started Kubernetes Kubelet.
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925459    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925462    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925468    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925473    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925477    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925479    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925482    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925485    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925488    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925490    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925493    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925497    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925499    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925502    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925505    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925508    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925510    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925513    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925516    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:06:51.056765 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925518    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925521    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925523    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925527    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925530    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925532    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925535    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925538    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925541    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925544    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925546    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925549    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925551    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925554    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925556    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925558    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925563    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925566    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925569    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925572    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:06:51.058520 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925574    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925577    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925580    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925583    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925586    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925588    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925591    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925593    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925598    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925600    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925603    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925606    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925609    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925611    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925614    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925616    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925619    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925622    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925624    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925627    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:06:51.206949 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925630    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925632    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925634    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925637    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925640    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925643    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925645    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925648    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925650    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925653    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925655    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925658    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925661    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925664    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925667    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925670    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925673    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925675    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925677    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:06:51.207653 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925681    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925685    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925693    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925696    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925699    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925701    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925704    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925707    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925709    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925712    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925714    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925718    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.925721    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928712    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928724    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928727    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928731    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928736    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928739    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:06:51.208659 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928742    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928744    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928747    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928750    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928753    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928755    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928758    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928761    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928764    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928767    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928771    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928773    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928776    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928780    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928784    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928786    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928789    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928792    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928796    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928800    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:06:51.209425 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928803    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928806    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928809    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928812    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928815    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928818    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928821    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928824    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928826    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928829    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928832    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928835    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928837    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928840    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928843    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928845    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928848    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928851    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928854    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928856    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:06:51.210167 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928859    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928861    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928865    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928867    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928870    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928872    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928875    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928877    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928880    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928882    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928885    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928887    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928890    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928892    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928895    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928897    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928900    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928903    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928905    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:06:51.210825 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928910    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928913    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928915    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928918    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928920    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928923    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928926    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928929    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928932    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928934    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928937    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928940    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928945    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928948    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928950    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928953    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928955    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928958    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928961    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928964    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:06:51.211427 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928966    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928969    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928971    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928974    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928976    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928979    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928981    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928984    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928987    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928990    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928992    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.928994    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929001    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929005    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929411    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929417    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929420    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929423    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929425    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:06:51.212007 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929428    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929431    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929434    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929436    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929439    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929443    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929446    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929448    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929451    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929454    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929457    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929460    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929462    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929465    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929468    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929470    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929474    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929478    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929480    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929483    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:06:51.212614 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929485    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929488    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929490    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929493    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929495    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929499    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929502    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929504    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929507    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929509    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929512    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929514    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929517    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929519    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929524    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929527    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929530    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929534    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929537    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:06:51.213218 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929539    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929542    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929545    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929548    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929550    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929554    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929556    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929559    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929562    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929564    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929567    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929569    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929572    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929576    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929579    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929581    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929584    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929587    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929591    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929594    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:06:51.213923 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929596    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929599    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929601    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929604    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929606    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929609    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929611    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929614    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929616    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929619    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929623    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929625    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929628    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929631    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929634    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929636    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929639    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929641    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929645    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929648    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:06:51.215509 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929650    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929653    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929655    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929659    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929662    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929664    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929667    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929669    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929671    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929674    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929678    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929680    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929683    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929686    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.929688    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929766    2557 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929776    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929785    2557 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929791    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929798    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929802    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 14:06:51.217001 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929807    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929813    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929816    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929819    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929822    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929826    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929829    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929832    2557 flags.go:64] FLAG: --cgroup-root=""
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929834    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929837    2557 flags.go:64] FLAG: --client-ca-file=""
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929841    2557 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929844    2557 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929849    2557 flags.go:64] FLAG: --cluster-domain=""
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929851    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929855    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929858    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929861    2557 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929865    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929868    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929871    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929874    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929878    2557 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929881    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929884    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 14:06:51.219496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929887    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929890    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929894    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929897    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929900    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929902    2557 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929905    2557 flags.go:64] FLAG: --enable-server="true"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929908    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929912    2557 flags.go:64] FLAG: --event-burst="100"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929917    2557 flags.go:64] FLAG: --event-qps="50"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929919    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929922    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929925    2557 flags.go:64] FLAG: --eviction-hard=""
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929928    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929931    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929934    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929937    2557 flags.go:64] FLAG: --eviction-soft=""
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929940    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929943    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929946    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929949    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929952    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929955    2557 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929958    2557 flags.go:64] FLAG: --feature-gates=""
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929961    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 14:06:51.221604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929964    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929967    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929970    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929973    2557 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929978    2557 flags.go:64] FLAG: --help="false"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929980    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929983    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929987    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929989    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929993    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929996    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.929999    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930002    2557 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930005    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930007    2557 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930010    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930014    2557 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930017    2557 flags.go:64] FLAG: --kube-reserved=""
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930020    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930023    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930026    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930028    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930031    2557 flags.go:64] FLAG: --lock-file=""
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930034    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 14:06:51.226646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930037    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930039    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930045    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930048    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930051    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930054    2557 flags.go:64] FLAG: --logging-format="text"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930057    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930060    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930063    2557 flags.go:64] FLAG: --manifest-url=""
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930066    2557 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930070    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930073    2557 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930078    2557 flags.go:64] FLAG: --max-pods="110"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930081    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930083    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930086    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930089    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930092    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930095    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930098    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930105    2557 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930108    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930111    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 14:06:51.228773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930114    2557 flags.go:64] FLAG: --pod-cidr=""
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930118    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930123    2557 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930126    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930130    2557 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930132    2557 flags.go:64] FLAG: --port="10250"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930135    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930138    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0644df62c1e2226e4"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930141    2557 flags.go:64] FLAG: --qos-reserved=""
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930145    2557 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930147    2557 flags.go:64] FLAG: --register-node="true"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930150    2557 flags.go:64] FLAG: --register-with-taints=""
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930154    2557 flags.go:64] FLAG: --registry-burst="10"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930157    2557 flags.go:64] FLAG: --registry-qps="5"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930160    2557 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930163    2557 flags.go:64] FLAG: --reserved-memory=""
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930167    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930170    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930172    2557 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930175    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930178    2557 flags.go:64] FLAG: --runonce="false"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930182    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930185    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930188    2557 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930191    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 14:06:51.231037 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930194    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930197    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930199    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930202    2557 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930205    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930208    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930210    2557 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930213    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930216    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930220    2557 flags.go:64] FLAG: --system-cgroups=""
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930223    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930244    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930247    2557 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930250    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930255    2557 flags.go:64] FLAG: --tls-min-version=""
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930258    2557 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930261    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930264    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930267    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930269    2557 flags.go:64] FLAG: --v="2"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930274    2557 flags.go:64] FLAG: --version="false"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930279    2557 flags.go:64] FLAG: --vmodule=""
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930283    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.930286    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930399    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:06:51.231737 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930402    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930405    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930408    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930412    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930414    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930417    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930420    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930423    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930425    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930428    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930430    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930433    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930435    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930438    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930441    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930443    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930447    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930449    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930453    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930457    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:06:51.472829 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930460    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930463    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930465    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930468    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930470    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930473    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930475    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930478    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930481    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930484    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930487    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930489    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930492    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930494    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930496    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930501    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930503    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930505    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930508    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:06:51.473540 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930510    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930513    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930515    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930520    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930523    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930526    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930529    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930532    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930535    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930539    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930542    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930545    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930547    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930550    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930553    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930555    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930558    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930560    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930562    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:06:51.474063 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930565    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930568    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930570    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930574    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930577    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930579    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930582    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930584    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930587    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930591    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930593    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930596    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930598    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930601    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930603    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930606    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930609    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930611    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930614    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930616    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:06:51.474661 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930619    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930621    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930626    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930628    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930631    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930633    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930636    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930638    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930641    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930644    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930646    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930649    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930652    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930655    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930657    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930660    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930662    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930666    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930670    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:06:51.475211 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.930673    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.931518    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.938255    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.938273    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.939257    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.939268    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939326    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939331    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939335    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939338    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939342    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939345    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939347    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939352    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:06:51.475753 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939356    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939359    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939362    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939366    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939370    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939374    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939376    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939379    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939382    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939384    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939387    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939390    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939392    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939395    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939397    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939400    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939403    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939406    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939409    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:06:51.476149 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939412    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939417    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939421    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939424    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939426    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939429    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939432    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939434    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939437    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939440    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939442    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939445    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939447    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939450    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939452    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939455    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939458    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939460    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939462    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939465    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:06:51.476711 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939468    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939470    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939475    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939477    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939480    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939482    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939485    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939487    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939491    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939493    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939496    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939498    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939501    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939505    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939508    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939517    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939521    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939524    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939526    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939529    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:06:51.477224 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939532    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939535    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939537    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939539    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939542    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939545    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939547    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939550    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939553    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939557    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939561    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939563    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939567    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939570    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939574    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939577    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939579    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939582    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939585    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:06:51.477792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939587    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939590    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939592    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939595    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939598    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939600    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939604    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939607    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939610    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939613    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939616    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939618    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939621    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.939626    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939739    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:06:51.478310 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939744    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939747    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939750    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939753    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939756    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939758    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939761    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939763    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939766    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939768    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939771    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939774    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939777    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939780    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939782    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939785    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939787    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939790    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939792    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939795    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:06:51.478758 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939798    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939801    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939803    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939806    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939809    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939812    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939814    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939819    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939823    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939826    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939829    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939832    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939835    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939838    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939841    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939843    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939846    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939849    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939851    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:06:51.479289 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939855    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939859    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939862    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939865    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939867    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939872    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939875    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939877    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939880    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939883    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939885    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939888    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939890    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939893    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939896    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939898    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939901    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939904    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939907    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939909    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:06:51.479807 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939912    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939915    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939918    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939920    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939923    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939926    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939928    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939931    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939933    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939936    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939938    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939941    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939943    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939946    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939948    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939951    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939953    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939957    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939959    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939961    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:06:51.480392 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939964    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939966    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939969    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939971    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939974    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939976    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939979    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939981    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939984    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939988    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939990    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939993    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939995    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.939998    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.940001    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.940003    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.940006    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.940009    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:06:51.480944 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:50.940011    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:06:51.481424 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.940016    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 14:06:51.481424 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.940127    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 14:06:51.481424 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.942138    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 14:06:51.481424 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.943367    2557 server.go:1019] "Starting client certificate rotation"
Jul 07 14:06:51.481424 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.943469    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 14:06:51.481424 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.943518    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 14:06:51.481424 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.945718    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 14:06:51.481424 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.947606    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 14:06:51.481424 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.956054    2557 log.go:25] "Validated CRI v1 runtime API"
Jul 07 14:06:51.481424 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.959133    2557 log.go:25] "Validated CRI v1 image API"
Jul 07 14:06:51.481424 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.959916    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 14:06:51.481424 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.962369    2557 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7b28c62f-d212-4615-87fa-1a9de5075a65:/dev/nvme0n1p4 e39af05b-d68a-45ab-8347-08208f54cde7:/dev/nvme0n1p3]
Jul 07 14:06:51.481793 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.962391    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 14:06:51.481861 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.968379    2557 manager.go:216] Machine: {Timestamp:2026-07-07 14:06:50.967014839 +0000 UTC m=+0.329337997 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100919 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21951ba94d6aae7adc9d62bf4daa51 SystemUUID:ec21951b-a94d-6aae-7adc-9d62bf4daa51 BootID:b7c54cb6-c3b5-4186-8a6f-5c32c54737cf Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c5:5c:b8:cb:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c5:5c:b8:cb:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:53:41:89:44:2c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 14:06:51.481861 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.968494    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 14:06:51.481861 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.968574    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 14:06:51.481861 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.972340    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 14:06:51.481861 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.972371    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 14:06:51.481861 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.973008    2557 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 14:06:51.481861 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.973018    2557 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 14:06:51.481861 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.973026    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.973635    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.974811    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.976114    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.977708    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.977821    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.977849    2557 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.977859    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.977869    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.977877    2557 kubelet.go:398] "Adding apiserver pod source"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.977886    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.978220    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.978250    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.980585    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.982495    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.982522    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.983515    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.983528    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.983533    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.983539    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.983548    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.983553    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.983561    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.983566    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.983572    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.983578    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.983586    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.983593    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.984830    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.984837    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.987769    2557 server.go:1268] "Started kubelet"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.987838    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.987886    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.987945    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.991956    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.994723    2557 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:50.996506    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:50.996511    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.996577    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 14:06:51.482172 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:50.996934    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.999798    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:50.999804    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:50.999970    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.000640    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.000643    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.000672    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.000721    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.000734    2557 factory.go:55] Registering systemd factory
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.000743    2557 factory.go:223] Registration of the systemd container factory successfully
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.000760    2557 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.000770    2557 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.000951    2557 factory.go:153] Registering CRI-O factory
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.000962    2557 factory.go:223] Registration of the crio container factory successfully
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.000980    2557 factory.go:103] Registering Raw factory
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.000989    2557 manager.go:1196] Started watching for new ooms in manager
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.001374    2557 manager.go:349] Starting recovery of all containers
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.007549    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.007849    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.007495    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-139.ec2.internal.18c0070e6d8f0afc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-139.ec2.internal,UID:ip-10-0-133-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-139.ec2.internal,},FirstTimestamp:2026-07-07 14:06:50.987743996 +0000 UTC m=+0.350067154,LastTimestamp:2026-07-07 14:06:50.987743996 +0000 UTC m=+0.350067154,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-139.ec2.internal,}"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.011698    2557 manager.go:354] Recovery completed
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.016212    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.017809    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.017836    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.017846    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.018264    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.018276    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.018280    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.018290    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.018898    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.018918    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:06:51.485714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.018927    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.019642    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-139.ec2.internal.18c0070e6f59ff41  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-139.ec2.internal,UID:ip-10-0-133-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-139.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-139.ec2.internal,},FirstTimestamp:2026-07-07 14:06:51.017822017 +0000 UTC m=+0.380145178,LastTimestamp:2026-07-07 14:06:51.017822017 +0000 UTC m=+0.380145178,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-139.ec2.internal,}"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.019999    2557 policy_none.go:49] "None policy: Start"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.020015    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.020030    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.021291    2557 policy_none.go:47] "Start"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.026463    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r9ns4"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.031423    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-139.ec2.internal.18c0070e6f5a4742  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-139.ec2.internal,UID:ip-10-0-133-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-139.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-139.ec2.internal,},FirstTimestamp:2026-07-07 14:06:51.01784045 +0000 UTC m=+0.380163607,LastTimestamp:2026-07-07 14:06:51.01784045 +0000 UTC m=+0.380163607,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-139.ec2.internal,}"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.031959    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r9ns4"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.081790    2557 manager.go:337] "Starting Device Plugin manager"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.081978    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.081992    2557 server.go:87] "Starting device plugin registration server"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.082192    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.082203    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.082304    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.082390    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.082400    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.085337    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.085402    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.109766    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.110944    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.110986    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.111009    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.111049    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.113023    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.182683    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.183547    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:06:51.487057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.183579    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.183593    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.183620    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.192324    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.192341    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-139.ec2.internal\": node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.211955    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"]
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.212009    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.213266    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.213287    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.213297    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.214632    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.214760    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.214785    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.215334    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.215346    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.215357    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.215369    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.215369    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.215435    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.216571    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.217034    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.217068    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.217788    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.217805    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.217818    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.238768    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-139.ec2.internal\" not found" node="ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.242730    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-139.ec2.internal\" not found" node="ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.302679    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9babfa7336fea69e033ea2de5a041c6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal\" (UID: \"9babfa7336fea69e033ea2de5a041c6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.702111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.302746    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9babfa7336fea69e033ea2de5a041c6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal\" (UID: \"9babfa7336fea69e033ea2de5a041c6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.703631 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.303139    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/098c8f1e1bab8bfb614b320b9ae089b4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-139.ec2.internal\" (UID: \"098c8f1e1bab8bfb614b320b9ae089b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.703631 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.316767    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 07 14:06:51.703631 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.404126    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/098c8f1e1bab8bfb614b320b9ae089b4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-139.ec2.internal\" (UID: \"098c8f1e1bab8bfb614b320b9ae089b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.703631 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.404163    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9babfa7336fea69e033ea2de5a041c6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal\" (UID: \"9babfa7336fea69e033ea2de5a041c6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.703631 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.404184    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9babfa7336fea69e033ea2de5a041c6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal\" (UID: \"9babfa7336fea69e033ea2de5a041c6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.703631 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.404268    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9babfa7336fea69e033ea2de5a041c6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal\" (UID: \"9babfa7336fea69e033ea2de5a041c6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.703631 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.404268    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9babfa7336fea69e033ea2de5a041c6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal\" (UID: \"9babfa7336fea69e033ea2de5a041c6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.703631 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.404268    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/098c8f1e1bab8bfb614b320b9ae089b4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-139.ec2.internal\" (UID: \"098c8f1e1bab8bfb614b320b9ae089b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.703631 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.417244    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 07 14:06:51.703631 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.517977    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 07 14:06:51.703631 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.543113    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.703631 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.546590    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:51.703631 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.618966    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 07 14:06:51.939723 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.719607    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 07 14:06:51.939723 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.820333    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 07 14:06:51.939723 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:51.920532    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 07 14:06:52.230160 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.942983    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 14:06:52.230160 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:51.943124    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 14:06:52.230160 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:52.021171    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 07 14:06:52.230160 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.034516    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:01:51 +0000 UTC" deadline="2028-03-27 21:29:44.780895798 +0000 UTC"
Jul 07 14:06:52.230160 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.034540    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15103h22m52.746359126s"
Jul 07 14:06:52.230160 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:52.122063    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 07 14:06:52.230160 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.129023    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:06:52.230160 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.200896    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:52.230160 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.211881    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 14:06:52.230160 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.214212    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 07 14:06:52.230160 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.229269    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 14:06:52.231532 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.231304    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:06:52.531231 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.472441    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:06:52.814706 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:52.673303    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9babfa7336fea69e033ea2de5a041c6e.slice/crio-a89496ffc9e31d231d046702711fab2652cf5d008b14dc57b664cf6b129db8d0 WatchSource:0}: Error finding container a89496ffc9e31d231d046702711fab2652cf5d008b14dc57b664cf6b129db8d0: Status 404 returned error can't find the container with id a89496ffc9e31d231d046702711fab2652cf5d008b14dc57b664cf6b129db8d0
Jul 07 14:06:52.814706 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.680168    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:52.947530    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098c8f1e1bab8bfb614b320b9ae089b4.slice/crio-1178842a4f295ae9ea35fa588ab449386919b97ffdffeb9bbd9226405b3bab71 WatchSource:0}: Error finding container 1178842a4f295ae9ea35fa588ab449386919b97ffdffeb9bbd9226405b3bab71: Status 404 returned error can't find the container with id 1178842a4f295ae9ea35fa588ab449386919b97ffdffeb9bbd9226405b3bab71
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.980206    2557 apiserver.go:52] "Watching apiserver"
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.988626    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.991720    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal","openshift-multus/multus-additional-cni-plugins-2jst6","openshift-network-operator/iptables-alerter-kkv66","kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5","openshift-multus/multus-z7qgr","openshift-multus/network-metrics-daemon-85vzp","openshift-network-diagnostics/network-check-target-zhlsz","openshift-ovn-kubernetes/ovnkube-node-sjcnj","kube-system/global-pull-secret-syncer-wrlhh","kube-system/konnectivity-agent-k2zhl","openshift-cluster-node-tuning-operator/tuned-c4g2w","openshift-dns/node-resolver-dnfwh","openshift-image-registry/node-ca-lj45b"]
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.993890    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:52.993960    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.995335    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dnfwh"
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.996400    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kkv66"
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.997585    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sw88v\""
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.997657    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.997719    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.998435    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lj45b"
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.998527    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.998723    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.998901    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-76jk8\""
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.998970    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:52.999916    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.000408    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.000521    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.001040    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.001148    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.001193    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7jlfm\""
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.001626    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.002587    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 14:06:53.051641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.002774    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.002926    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.003145    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lvxfx\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.003987    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.004434    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.004503    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.004788    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.004848    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fvc6h\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.005597    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.007288    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.007342    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.007795    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.008163    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.008171    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.008310    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.009172    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.010504    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.010590    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.010875    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2474k\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.011625    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-d95kk\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.011898    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.012022    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.012028    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.012188    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.012952    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0565009f-db88-49d2-84e8-de0653188d27-hosts-file\") pod \"node-resolver-dnfwh\" (UID: \"0565009f-db88-49d2-84e8-de0653188d27\") " pod="openshift-dns/node-resolver-dnfwh"
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.012983    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.053149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013002    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013030    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-device-dir\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013061    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-etc-selinux\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013089    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcnqj\" (UniqueName: \"kubernetes.io/projected/19dbaf29-022f-4811-b6e0-a276f0551522-kube-api-access-qcnqj\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013115    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d25dc2c0-12a6-4c21-b56e-6a681deaba83-host\") pod \"node-ca-lj45b\" (UID: \"d25dc2c0-12a6-4c21-b56e-6a681deaba83\") " pod="openshift-image-registry/node-ca-lj45b"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013139    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-registration-dir\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013177    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-hostroot\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013213    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-run-multus-certs\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013236    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-etc-kubernetes\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013259    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0565009f-db88-49d2-84e8-de0653188d27-tmp-dir\") pod \"node-resolver-dnfwh\" (UID: \"0565009f-db88-49d2-84e8-de0653188d27\") " pod="openshift-dns/node-resolver-dnfwh"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013287    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rbf6\" (UniqueName: \"kubernetes.io/projected/0565009f-db88-49d2-84e8-de0653188d27-kube-api-access-4rbf6\") pod \"node-resolver-dnfwh\" (UID: \"0565009f-db88-49d2-84e8-de0653188d27\") " pod="openshift-dns/node-resolver-dnfwh"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013329    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-var-lib-kubelet\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013346    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c661b77e-fb49-41fc-97ae-243728ee2c39-dbus\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013361    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7hhl\" (UniqueName: \"kubernetes.io/projected/2dd2efa1-7033-4090-bbd0-3441833898a7-kube-api-access-r7hhl\") pod \"iptables-alerter-kkv66\" (UID: \"2dd2efa1-7033-4090-bbd0-3441833898a7\") " pod="openshift-network-operator/iptables-alerter-kkv66"
Jul 07 14:06:53.054827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013378    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-socket-dir\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013401    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-sys-fs\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013424    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-multus-cni-dir\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013446    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-cnibin\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013462    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2dd2efa1-7033-4090-bbd0-3441833898a7-iptables-alerter-script\") pod \"iptables-alerter-kkv66\" (UID: \"2dd2efa1-7033-4090-bbd0-3441833898a7\") " pod="openshift-network-operator/iptables-alerter-kkv66"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013477    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-var-lib-cni-multus\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013493    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-multus-daemon-config\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013517    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dd2efa1-7033-4090-bbd0-3441833898a7-host-slash\") pod \"iptables-alerter-kkv66\" (UID: \"2dd2efa1-7033-4090-bbd0-3441833898a7\") " pod="openshift-network-operator/iptables-alerter-kkv66"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013541    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-system-cni-dir\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013555    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-os-release\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013570    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-run-k8s-cni-cncf-io\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013591    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-run-netns\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013633    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-var-lib-cni-bin\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013670    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-multus-conf-dir\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.055790 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013696    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d25dc2c0-12a6-4c21-b56e-6a681deaba83-serviceca\") pod \"node-ca-lj45b\" (UID: \"d25dc2c0-12a6-4c21-b56e-6a681deaba83\") " pod="openshift-image-registry/node-ca-lj45b"
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013718    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zktzr\" (UniqueName: \"kubernetes.io/projected/d25dc2c0-12a6-4c21-b56e-6a681deaba83-kube-api-access-zktzr\") pod \"node-ca-lj45b\" (UID: \"d25dc2c0-12a6-4c21-b56e-6a681deaba83\") " pod="openshift-image-registry/node-ca-lj45b"
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013739    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-multus-socket-dir-parent\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013772    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4tgz\" (UniqueName: \"kubernetes.io/projected/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-kube-api-access-l4tgz\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013807    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-cni-binary-copy\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013829    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c661b77e-fb49-41fc-97ae-243728ee2c39-kubelet-config\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.013856    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.014734    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k2zhl"
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.016586    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.017319    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.017425    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.017736    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lk78f\""
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.018873    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.023583    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.023628    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hp492\""
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.039258    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ggpdw"
Jul 07 14:06:53.056733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.048706    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ggpdw"
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.100528    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.101463    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-run\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114084    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114116    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114153    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-etc-selinux\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114251    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcnqj\" (UniqueName: \"kubernetes.io/projected/19dbaf29-022f-4811-b6e0-a276f0551522-kube-api-access-qcnqj\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.114295    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114345    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6552b16-7e6c-4380-85bb-2a30850f511f-system-cni-dir\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114351    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-etc-selinux\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114495    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b22953df-fa9e-4760-9814-d772396a7e8e-etc-tuned\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114531    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-run-openvswitch\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.114565    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret podName:c661b77e-fb49-41fc-97ae-243728ee2c39 nodeName:}" failed. No retries permitted until 2026-07-07 14:06:53.614541325 +0000 UTC m=+2.976864472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret") pod "global-pull-secret-syncer-wrlhh" (UID: "c661b77e-fb49-41fc-97ae-243728ee2c39") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114626    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8bedc9c2-3422-47ca-bc0c-fd952491a31b-ovnkube-script-lib\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.375250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114665    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d25dc2c0-12a6-4c21-b56e-6a681deaba83-host\") pod \"node-ca-lj45b\" (UID: \"d25dc2c0-12a6-4c21-b56e-6a681deaba83\") " pod="openshift-image-registry/node-ca-lj45b"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114709    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d25dc2c0-12a6-4c21-b56e-6a681deaba83-host\") pod \"node-ca-lj45b\" (UID: \"d25dc2c0-12a6-4c21-b56e-6a681deaba83\") " pod="openshift-image-registry/node-ca-lj45b"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114720    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-hostroot\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114745    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6552b16-7e6c-4380-85bb-2a30850f511f-os-release\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114767    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e6552b16-7e6c-4380-85bb-2a30850f511f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114788    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-sysctl-d\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114811    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b22953df-fa9e-4760-9814-d772396a7e8e-tmp\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114840    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-hostroot\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114860    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-run-systemd\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114918    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rbf6\" (UniqueName: \"kubernetes.io/projected/0565009f-db88-49d2-84e8-de0653188d27-kube-api-access-4rbf6\") pod \"node-resolver-dnfwh\" (UID: \"0565009f-db88-49d2-84e8-de0653188d27\") " pod="openshift-dns/node-resolver-dnfwh"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.114960    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-var-lib-kubelet\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115047    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-sysconfig\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115073    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-var-lib-kubelet\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115059    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-var-lib-kubelet\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.377110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115121    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-kubelet\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115161    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-cni-netd\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115190    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8bedc9c2-3422-47ca-bc0c-fd952491a31b-env-overrides\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115589    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5clm2\" (UniqueName: \"kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2\") pod \"network-check-target-zhlsz\" (UID: \"4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4\") " pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115645    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-kubernetes\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115684    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-cni-bin\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115726    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bedc9c2-3422-47ca-bc0c-fd952491a31b-ovn-node-metrics-cert\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115782    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/90a5edcc-b022-470d-9537-5a969feb1153-konnectivity-ca\") pod \"konnectivity-agent-k2zhl\" (UID: \"90a5edcc-b022-470d-9537-5a969feb1153\") " pod="kube-system/konnectivity-agent-k2zhl"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115841    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-host\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115915    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dd2efa1-7033-4090-bbd0-3441833898a7-host-slash\") pod \"iptables-alerter-kkv66\" (UID: \"2dd2efa1-7033-4090-bbd0-3441833898a7\") " pod="openshift-network-operator/iptables-alerter-kkv66"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115956    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-run-netns\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.115989    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-var-lib-cni-bin\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116021    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-multus-conf-dir\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116055    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-node-log\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.379137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116086    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116120    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-lib-modules\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-multus-socket-dir-parent\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116185    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4tgz\" (UniqueName: \"kubernetes.io/projected/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-kube-api-access-l4tgz\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116217    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-cni-binary-copy\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-run-ovn\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvmjr\" (UniqueName: \"kubernetes.io/projected/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-kube-api-access-dvmjr\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116328    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c661b77e-fb49-41fc-97ae-243728ee2c39-kubelet-config\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116360    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0565009f-db88-49d2-84e8-de0653188d27-hosts-file\") pod \"node-resolver-dnfwh\" (UID: \"0565009f-db88-49d2-84e8-de0653188d27\") " pod="openshift-dns/node-resolver-dnfwh"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116396    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116427    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-device-dir\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116450    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-sys\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-registration-dir\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116510    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-run-multus-certs\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.379958 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116540    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-etc-kubernetes\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116567    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-modprobe-d\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-systemd-units\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116626    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-var-lib-openvswitch\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116657    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8bedc9c2-3422-47ca-bc0c-fd952491a31b-ovnkube-config\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116689    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfnvz\" (UniqueName: \"kubernetes.io/projected/8bedc9c2-3422-47ca-bc0c-fd952491a31b-kube-api-access-dfnvz\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116716    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0565009f-db88-49d2-84e8-de0653188d27-tmp-dir\") pod \"node-resolver-dnfwh\" (UID: \"0565009f-db88-49d2-84e8-de0653188d27\") " pod="openshift-dns/node-resolver-dnfwh"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-etc-openvswitch\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116778    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c661b77e-fb49-41fc-97ae-243728ee2c39-dbus\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116810    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7hhl\" (UniqueName: \"kubernetes.io/projected/2dd2efa1-7033-4090-bbd0-3441833898a7-kube-api-access-r7hhl\") pod \"iptables-alerter-kkv66\" (UID: \"2dd2efa1-7033-4090-bbd0-3441833898a7\") " pod="openshift-network-operator/iptables-alerter-kkv66"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116842    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-socket-dir\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116868    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-sys-fs\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116908    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-multus-cni-dir\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116932    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-cnibin\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.380623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.116968    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6552b16-7e6c-4380-85bb-2a30850f511f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117001    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmtbj\" (UniqueName: \"kubernetes.io/projected/e6552b16-7e6c-4380-85bb-2a30850f511f-kube-api-access-lmtbj\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117035    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2dd2efa1-7033-4090-bbd0-3441833898a7-iptables-alerter-script\") pod \"iptables-alerter-kkv66\" (UID: \"2dd2efa1-7033-4090-bbd0-3441833898a7\") " pod="openshift-network-operator/iptables-alerter-kkv66"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117061    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-var-lib-cni-multus\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117091    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-multus-daemon-config\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117121    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-systemd\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117158    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtxm9\" (UniqueName: \"kubernetes.io/projected/b22953df-fa9e-4760-9814-d772396a7e8e-kube-api-access-wtxm9\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117187    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-slash\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117213    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117251    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-system-cni-dir\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117281    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-os-release\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117329    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-run-k8s-cni-cncf-io\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117365    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e6552b16-7e6c-4380-85bb-2a30850f511f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/90a5edcc-b022-470d-9537-5a969feb1153-agent-certs\") pod \"konnectivity-agent-k2zhl\" (UID: \"90a5edcc-b022-470d-9537-5a969feb1153\") " pod="kube-system/konnectivity-agent-k2zhl"
Jul 07 14:06:53.381785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117424    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d25dc2c0-12a6-4c21-b56e-6a681deaba83-serviceca\") pod \"node-ca-lj45b\" (UID: \"d25dc2c0-12a6-4c21-b56e-6a681deaba83\") " pod="openshift-image-registry/node-ca-lj45b"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117455    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zktzr\" (UniqueName: \"kubernetes.io/projected/d25dc2c0-12a6-4c21-b56e-6a681deaba83-kube-api-access-zktzr\") pod \"node-ca-lj45b\" (UID: \"d25dc2c0-12a6-4c21-b56e-6a681deaba83\") " pod="openshift-image-registry/node-ca-lj45b"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117487    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6552b16-7e6c-4380-85bb-2a30850f511f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-sysctl-conf\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117541    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-run-netns\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117573    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-log-socket\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117607    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6552b16-7e6c-4380-85bb-2a30850f511f-cnibin\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117740    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dd2efa1-7033-4090-bbd0-3441833898a7-host-slash\") pod \"iptables-alerter-kkv66\" (UID: \"2dd2efa1-7033-4090-bbd0-3441833898a7\") " pod="openshift-network-operator/iptables-alerter-kkv66"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117789    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-run-netns\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117833    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-var-lib-cni-bin\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.117883    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-multus-conf-dir\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.118031    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-run-multus-certs\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.118198    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-multus-cni-dir\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.118228    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-sys-fs\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.118250    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-multus-socket-dir-parent\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.382385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.118376    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-os-release\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.118442    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c661b77e-fb49-41fc-97ae-243728ee2c39-dbus\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.118643    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.118642    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-cnibin\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119027    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-system-cni-dir\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119033    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-var-lib-cni-multus\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119085    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-device-dir\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119074    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-etc-kubernetes\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119096    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-socket-dir\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119465    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal" event={"ID":"098c8f1e1bab8bfb614b320b9ae089b4","Type":"ContainerStarted","Data":"1178842a4f295ae9ea35fa588ab449386919b97ffdffeb9bbd9226405b3bab71"}
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119527    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0565009f-db88-49d2-84e8-de0653188d27-tmp-dir\") pod \"node-resolver-dnfwh\" (UID: \"0565009f-db88-49d2-84e8-de0653188d27\") " pod="openshift-dns/node-resolver-dnfwh"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119607    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/19dbaf29-022f-4811-b6e0-a276f0551522-registration-dir\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119611    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-host-run-k8s-cni-cncf-io\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119654    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c661b77e-fb49-41fc-97ae-243728ee2c39-kubelet-config\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119662    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-cni-binary-copy\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.382966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119676    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0565009f-db88-49d2-84e8-de0653188d27-hosts-file\") pod \"node-resolver-dnfwh\" (UID: \"0565009f-db88-49d2-84e8-de0653188d27\") " pod="openshift-dns/node-resolver-dnfwh"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119653    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-multus-daemon-config\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.119848    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d25dc2c0-12a6-4c21-b56e-6a681deaba83-serviceca\") pod \"node-ca-lj45b\" (UID: \"d25dc2c0-12a6-4c21-b56e-6a681deaba83\") " pod="openshift-image-registry/node-ca-lj45b"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.120087    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2dd2efa1-7033-4090-bbd0-3441833898a7-iptables-alerter-script\") pod \"iptables-alerter-kkv66\" (UID: \"2dd2efa1-7033-4090-bbd0-3441833898a7\") " pod="openshift-network-operator/iptables-alerter-kkv66"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.120722    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal" event={"ID":"9babfa7336fea69e033ea2de5a041c6e","Type":"ContainerStarted","Data":"a89496ffc9e31d231d046702711fab2652cf5d008b14dc57b664cf6b129db8d0"}
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.124331    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.128445    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zktzr\" (UniqueName: \"kubernetes.io/projected/d25dc2c0-12a6-4c21-b56e-6a681deaba83-kube-api-access-zktzr\") pod \"node-ca-lj45b\" (UID: \"d25dc2c0-12a6-4c21-b56e-6a681deaba83\") " pod="openshift-image-registry/node-ca-lj45b"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.128519    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcnqj\" (UniqueName: \"kubernetes.io/projected/19dbaf29-022f-4811-b6e0-a276f0551522-kube-api-access-qcnqj\") pod \"aws-ebs-csi-driver-node-gztc5\" (UID: \"19dbaf29-022f-4811-b6e0-a276f0551522\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.128571    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4tgz\" (UniqueName: \"kubernetes.io/projected/7d4112bf-a5ba-493d-bcab-1e1b7b1c913b-kube-api-access-l4tgz\") pod \"multus-z7qgr\" (UID: \"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b\") " pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.128579    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rbf6\" (UniqueName: \"kubernetes.io/projected/0565009f-db88-49d2-84e8-de0653188d27-kube-api-access-4rbf6\") pod \"node-resolver-dnfwh\" (UID: \"0565009f-db88-49d2-84e8-de0653188d27\") " pod="openshift-dns/node-resolver-dnfwh"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.128725    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7hhl\" (UniqueName: \"kubernetes.io/projected/2dd2efa1-7033-4090-bbd0-3441833898a7-kube-api-access-r7hhl\") pod \"iptables-alerter-kkv66\" (UID: \"2dd2efa1-7033-4090-bbd0-3441833898a7\") " pod="openshift-network-operator/iptables-alerter-kkv66"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218283    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-sysconfig\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218316    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-var-lib-kubelet\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218333    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-kubelet\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218359    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-cni-netd\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.383622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218382    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8bedc9c2-3422-47ca-bc0c-fd952491a31b-env-overrides\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218418    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-sysconfig\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218429    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-cni-netd\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218421    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-var-lib-kubelet\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218422    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-kubelet\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218478    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5clm2\" (UniqueName: \"kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2\") pod \"network-check-target-zhlsz\" (UID: \"4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4\") " pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218499    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-kubernetes\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-cni-bin\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218529    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bedc9c2-3422-47ca-bc0c-fd952491a31b-ovn-node-metrics-cert\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218545    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/90a5edcc-b022-470d-9537-5a969feb1153-konnectivity-ca\") pod \"konnectivity-agent-k2zhl\" (UID: \"90a5edcc-b022-470d-9537-5a969feb1153\") " pod="kube-system/konnectivity-agent-k2zhl"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218561    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-host\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218580    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-node-log\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218582    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-cni-bin\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218598    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218622    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-lib-modules\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.384374 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218641    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-kubernetes\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218660    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-run-ovn\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218669    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-host\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218686    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvmjr\" (UniqueName: \"kubernetes.io/projected/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-kube-api-access-dvmjr\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218689    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-node-log\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.218724    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218740    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-sys\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218745    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-run-ovn\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218766    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-modprobe-d\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.218785    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs podName:7c4fc6fc-66a0-47c4-ac0f-413df650c65e nodeName:}" failed. No retries permitted until 2026-07-07 14:06:53.71876533 +0000 UTC m=+3.081088487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs") pod "network-metrics-daemon-85vzp" (UID: "7c4fc6fc-66a0-47c4-ac0f-413df650c65e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218811    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-lib-modules\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218814    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-sys\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-systemd-units\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218858    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-modprobe-d\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218890    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-systemd-units\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.384941 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218909    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-var-lib-openvswitch\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218927    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8bedc9c2-3422-47ca-bc0c-fd952491a31b-env-overrides\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218950    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-var-lib-openvswitch\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.218932    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8bedc9c2-3422-47ca-bc0c-fd952491a31b-ovnkube-config\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219001    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfnvz\" (UniqueName: \"kubernetes.io/projected/8bedc9c2-3422-47ca-bc0c-fd952491a31b-kube-api-access-dfnvz\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219028    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-etc-openvswitch\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219064    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-etc-openvswitch\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219163    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6552b16-7e6c-4380-85bb-2a30850f511f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219199    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/90a5edcc-b022-470d-9537-5a969feb1153-konnectivity-ca\") pod \"konnectivity-agent-k2zhl\" (UID: \"90a5edcc-b022-470d-9537-5a969feb1153\") " pod="kube-system/konnectivity-agent-k2zhl"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219204    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmtbj\" (UniqueName: \"kubernetes.io/projected/e6552b16-7e6c-4380-85bb-2a30850f511f-kube-api-access-lmtbj\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219268    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-systemd\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219311    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtxm9\" (UniqueName: \"kubernetes.io/projected/b22953df-fa9e-4760-9814-d772396a7e8e-kube-api-access-wtxm9\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-slash\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219398    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-systemd\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.385666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219415    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219440    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-slash\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219401    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8bedc9c2-3422-47ca-bc0c-fd952491a31b-ovnkube-config\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219453    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219450    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e6552b16-7e6c-4380-85bb-2a30850f511f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219493    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/90a5edcc-b022-470d-9537-5a969feb1153-agent-certs\") pod \"konnectivity-agent-k2zhl\" (UID: \"90a5edcc-b022-470d-9537-5a969feb1153\") " pod="kube-system/konnectivity-agent-k2zhl"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219513    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6552b16-7e6c-4380-85bb-2a30850f511f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219540    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-sysctl-conf\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219560    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-run-netns\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219591    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-log-socket\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219607    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6552b16-7e6c-4380-85bb-2a30850f511f-cnibin\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219630    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-run\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219649    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219676    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6552b16-7e6c-4380-85bb-2a30850f511f-system-cni-dir\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.386155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219678    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-sysctl-conf\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219691    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b22953df-fa9e-4760-9814-d772396a7e8e-etc-tuned\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219703    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6552b16-7e6c-4380-85bb-2a30850f511f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219724    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-run-openvswitch\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219751    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6552b16-7e6c-4380-85bb-2a30850f511f-cnibin\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219754    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8bedc9c2-3422-47ca-bc0c-fd952491a31b-ovnkube-script-lib\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219811    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6552b16-7e6c-4380-85bb-2a30850f511f-cni-binary-copy\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219818    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6552b16-7e6c-4380-85bb-2a30850f511f-os-release\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219881    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e6552b16-7e6c-4380-85bb-2a30850f511f-os-release\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219890    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-run-netns\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219890    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e6552b16-7e6c-4380-85bb-2a30850f511f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219928    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-log-socket\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219954    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-sysctl-d\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219977    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-host-run-ovn-kubernetes\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.386804 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.219983    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b22953df-fa9e-4760-9814-d772396a7e8e-tmp\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.220009    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-run-systemd\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.220034    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e6552b16-7e6c-4380-85bb-2a30850f511f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.220032    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-run\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.220113    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6552b16-7e6c-4380-85bb-2a30850f511f-system-cni-dir\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.220164    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-run-openvswitch\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.220177    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b22953df-fa9e-4760-9814-d772396a7e8e-etc-sysctl-d\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.220245    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8bedc9c2-3422-47ca-bc0c-fd952491a31b-run-systemd\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.220448    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e6552b16-7e6c-4380-85bb-2a30850f511f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.220516    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8bedc9c2-3422-47ca-bc0c-fd952491a31b-ovnkube-script-lib\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.221492    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bedc9c2-3422-47ca-bc0c-fd952491a31b-ovn-node-metrics-cert\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.221836    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b22953df-fa9e-4760-9814-d772396a7e8e-etc-tuned\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.221863    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/90a5edcc-b022-470d-9537-5a969feb1153-agent-certs\") pod \"konnectivity-agent-k2zhl\" (UID: \"90a5edcc-b022-470d-9537-5a969feb1153\") " pod="kube-system/konnectivity-agent-k2zhl"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.222052    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b22953df-fa9e-4760-9814-d772396a7e8e-tmp\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.230005    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:06:53.641787 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.230021    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.230032    2557 projected.go:196] Error preparing data for projected volume kube-api-access-5clm2 for pod openshift-network-diagnostics/network-check-target-zhlsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.230080    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2 podName:4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4 nodeName:}" failed. No retries permitted until 2026-07-07 14:06:53.730068009 +0000 UTC m=+3.092391157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5clm2" (UniqueName: "kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2") pod "network-check-target-zhlsz" (UID: "4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.233174    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvmjr\" (UniqueName: \"kubernetes.io/projected/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-kube-api-access-dvmjr\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.233185    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmtbj\" (UniqueName: \"kubernetes.io/projected/e6552b16-7e6c-4380-85bb-2a30850f511f-kube-api-access-lmtbj\") pod \"multus-additional-cni-plugins-2jst6\" (UID: \"e6552b16-7e6c-4380-85bb-2a30850f511f\") " pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.233411    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtxm9\" (UniqueName: \"kubernetes.io/projected/b22953df-fa9e-4760-9814-d772396a7e8e-kube-api-access-wtxm9\") pod \"tuned-c4g2w\" (UID: \"b22953df-fa9e-4760-9814-d772396a7e8e\") " pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.233416    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfnvz\" (UniqueName: \"kubernetes.io/projected/8bedc9c2-3422-47ca-bc0c-fd952491a31b-kube-api-access-dfnvz\") pod \"ovnkube-node-sjcnj\" (UID: \"8bedc9c2-3422-47ca-bc0c-fd952491a31b\") " pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.307642    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dnfwh"
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.317346    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kkv66"
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:53.325248    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd2efa1_7033_4090_bbd0_3441833898a7.slice/crio-f8f2867610b375897294d072948c4f87cc7afd0f4c76631f3f580bcfe2b052cc WatchSource:0}: Error finding container f8f2867610b375897294d072948c4f87cc7afd0f4c76631f3f580bcfe2b052cc: Status 404 returned error can't find the container with id f8f2867610b375897294d072948c4f87cc7afd0f4c76631f3f580bcfe2b052cc
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.327979    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lj45b"
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.332711    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5"
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.338427    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z7qgr"
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:53.341012    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25dc2c0_12a6_4c21_b56e_6a681deaba83.slice/crio-af097f54970f9e0cd47f710a15b2a2fd733cac6a4e152168ae0a296fe8a5cb0b WatchSource:0}: Error finding container af097f54970f9e0cd47f710a15b2a2fd733cac6a4e152168ae0a296fe8a5cb0b: Status 404 returned error can't find the container with id af097f54970f9e0cd47f710a15b2a2fd733cac6a4e152168ae0a296fe8a5cb0b
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:53.345346    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19dbaf29_022f_4811_b6e0_a276f0551522.slice/crio-39fecbe8d4283c73b8dc25b506ae9b3db09b1893244c33233890174aef24624d WatchSource:0}: Error finding container 39fecbe8d4283c73b8dc25b506ae9b3db09b1893244c33233890174aef24624d: Status 404 returned error can't find the container with id 39fecbe8d4283c73b8dc25b506ae9b3db09b1893244c33233890174aef24624d
Jul 07 14:06:53.642546 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.346902    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:06:53.643533 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:53.349296    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4112bf_a5ba_493d_bcab_1e1b7b1c913b.slice/crio-1521ea8065eec75318991bddb3674bf130104470cbb05a7ec1edc55256a7d443 WatchSource:0}: Error finding container 1521ea8065eec75318991bddb3674bf130104470cbb05a7ec1edc55256a7d443: Status 404 returned error can't find the container with id 1521ea8065eec75318991bddb3674bf130104470cbb05a7ec1edc55256a7d443
Jul 07 14:06:53.643533 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.355293    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2jst6"
Jul 07 14:06:53.643533 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:53.356690    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bedc9c2_3422_47ca_bc0c_fd952491a31b.slice/crio-7450c4cbf6957539e3cdc26c3693fb412ef25f4b6f9f6e98fd3d13721cbad21d WatchSource:0}: Error finding container 7450c4cbf6957539e3cdc26c3693fb412ef25f4b6f9f6e98fd3d13721cbad21d: Status 404 returned error can't find the container with id 7450c4cbf6957539e3cdc26c3693fb412ef25f4b6f9f6e98fd3d13721cbad21d
Jul 07 14:06:53.643533 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.360742    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k2zhl"
Jul 07 14:06:53.643533 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:53.364857    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6552b16_7e6c_4380_85bb_2a30850f511f.slice/crio-7fb54426042c95255454436c6a7dc67e6718e9cdade7a0a23170fda0ab94c1ec WatchSource:0}: Error finding container 7fb54426042c95255454436c6a7dc67e6718e9cdade7a0a23170fda0ab94c1ec: Status 404 returned error can't find the container with id 7fb54426042c95255454436c6a7dc67e6718e9cdade7a0a23170fda0ab94c1ec
Jul 07 14:06:53.643533 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.365627    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c4g2w"
Jul 07 14:06:53.643533 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:53.374166    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a5edcc_b022_470d_9537_5a969feb1153.slice/crio-e4d1b1678b98bf90d72a16d590cc99577b209c4dc80230de790b6938dc355713 WatchSource:0}: Error finding container e4d1b1678b98bf90d72a16d590cc99577b209c4dc80230de790b6938dc355713: Status 404 returned error can't find the container with id e4d1b1678b98bf90d72a16d590cc99577b209c4dc80230de790b6938dc355713
Jul 07 14:06:53.643533 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:06:53.380822    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22953df_fa9e_4760_9814_d772396a7e8e.slice/crio-df5aaee4b92ce05af702acd5785c20ecdc6976139ea4b0e0499ffdb07c5cec47 WatchSource:0}: Error finding container df5aaee4b92ce05af702acd5785c20ecdc6976139ea4b0e0499ffdb07c5cec47: Status 404 returned error can't find the container with id df5aaee4b92ce05af702acd5785c20ecdc6976139ea4b0e0499ffdb07c5cec47
Jul 07 14:06:53.643533 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.623558    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:53.643533 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.623737    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:06:53.643533 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.623817    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret podName:c661b77e-fb49-41fc-97ae-243728ee2c39 nodeName:}" failed. No retries permitted until 2026-07-07 14:06:54.623795551 +0000 UTC m=+3.986118711 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret") pod "global-pull-secret-syncer-wrlhh" (UID: "c661b77e-fb49-41fc-97ae-243728ee2c39") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:06:53.898213 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.724402    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:06:53.898213 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.724518    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:06:53.898213 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.724571    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs podName:7c4fc6fc-66a0-47c4-ac0f-413df650c65e nodeName:}" failed. No retries permitted until 2026-07-07 14:06:54.724558343 +0000 UTC m=+4.086881490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs") pod "network-metrics-daemon-85vzp" (UID: "7c4fc6fc-66a0-47c4-ac0f-413df650c65e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:06:53.898213 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:53.824910    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5clm2\" (UniqueName: \"kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2\") pod \"network-check-target-zhlsz\" (UID: \"4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4\") " pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:06:53.898213 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.825116    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:06:53.898213 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.825138    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:06:53.898213 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.825148    2557 projected.go:196] Error preparing data for projected volume kube-api-access-5clm2 for pod openshift-network-diagnostics/network-check-target-zhlsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:06:53.898213 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:53.825201    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2 podName:4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4 nodeName:}" failed. No retries permitted until 2026-07-07 14:06:54.825186592 +0000 UTC m=+4.187509742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5clm2" (UniqueName: "kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2") pod "network-check-target-zhlsz" (UID: "4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:06:54.071831 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.051749    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:01:53 +0000 UTC" deadline="2028-04-20 10:19:02.289788442 +0000 UTC"
Jul 07 14:06:54.071831 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.051800    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15668h12m8.23799172s"
Jul 07 14:06:54.150035 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.132009    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c4g2w" event={"ID":"b22953df-fa9e-4760-9814-d772396a7e8e","Type":"ContainerStarted","Data":"df5aaee4b92ce05af702acd5785c20ecdc6976139ea4b0e0499ffdb07c5cec47"}
Jul 07 14:06:54.150035 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.134671    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2jst6" event={"ID":"e6552b16-7e6c-4380-85bb-2a30850f511f","Type":"ContainerStarted","Data":"7fb54426042c95255454436c6a7dc67e6718e9cdade7a0a23170fda0ab94c1ec"}
Jul 07 14:06:54.150035 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.136652    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z7qgr" event={"ID":"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b","Type":"ContainerStarted","Data":"1521ea8065eec75318991bddb3674bf130104470cbb05a7ec1edc55256a7d443"}
Jul 07 14:06:54.150035 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.140944    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5" event={"ID":"19dbaf29-022f-4811-b6e0-a276f0551522","Type":"ContainerStarted","Data":"39fecbe8d4283c73b8dc25b506ae9b3db09b1893244c33233890174aef24624d"}
Jul 07 14:06:54.150035 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.143128    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k2zhl" event={"ID":"90a5edcc-b022-470d-9537-5a969feb1153","Type":"ContainerStarted","Data":"e4d1b1678b98bf90d72a16d590cc99577b209c4dc80230de790b6938dc355713"}
Jul 07 14:06:54.150035 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.145861    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj" event={"ID":"8bedc9c2-3422-47ca-bc0c-fd952491a31b","Type":"ContainerStarted","Data":"7450c4cbf6957539e3cdc26c3693fb412ef25f4b6f9f6e98fd3d13721cbad21d"}
Jul 07 14:06:54.157017 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.156146    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lj45b" event={"ID":"d25dc2c0-12a6-4c21-b56e-6a681deaba83","Type":"ContainerStarted","Data":"af097f54970f9e0cd47f710a15b2a2fd733cac6a4e152168ae0a296fe8a5cb0b"}
Jul 07 14:06:54.160246 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.159320    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kkv66" event={"ID":"2dd2efa1-7033-4090-bbd0-3441833898a7","Type":"ContainerStarted","Data":"f8f2867610b375897294d072948c4f87cc7afd0f4c76631f3f580bcfe2b052cc"}
Jul 07 14:06:54.168349 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.162998    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dnfwh" event={"ID":"0565009f-db88-49d2-84e8-de0653188d27","Type":"ContainerStarted","Data":"8c0ad8dd24b16326844daad6b6e030b4ca6045d1ebe08d3b9743204beb976515"}
Jul 07 14:06:54.656242 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.656128    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:54.656709 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:54.656327    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:06:54.656709 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:54.656399    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret podName:c661b77e-fb49-41fc-97ae-243728ee2c39 nodeName:}" failed. No retries permitted until 2026-07-07 14:06:56.656380484 +0000 UTC m=+6.018703633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret") pod "global-pull-secret-syncer-wrlhh" (UID: "c661b77e-fb49-41fc-97ae-243728ee2c39") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:06:54.756922 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.756885    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:06:54.757152 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:54.757073    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:06:54.757152 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:54.757150    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs podName:7c4fc6fc-66a0-47c4-ac0f-413df650c65e nodeName:}" failed. No retries permitted until 2026-07-07 14:06:56.757130216 +0000 UTC m=+6.119453385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs") pod "network-metrics-daemon-85vzp" (UID: "7c4fc6fc-66a0-47c4-ac0f-413df650c65e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:06:54.857705 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:54.857667    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5clm2\" (UniqueName: \"kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2\") pod \"network-check-target-zhlsz\" (UID: \"4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4\") " pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:06:54.857900 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:54.857866    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:06:54.857900 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:54.857888    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:06:54.858020 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:54.857902    2557 projected.go:196] Error preparing data for projected volume kube-api-access-5clm2 for pod openshift-network-diagnostics/network-check-target-zhlsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:06:54.858020 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:54.857968    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2 podName:4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4 nodeName:}" failed. No retries permitted until 2026-07-07 14:06:56.857949788 +0000 UTC m=+6.220272956 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5clm2" (UniqueName: "kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2") pod "network-check-target-zhlsz" (UID: "4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:06:55.052575 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:55.052448    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:01:53 +0000 UTC" deadline="2027-12-03 07:28:53.756453604 +0000 UTC"
Jul 07 14:06:55.052575 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:55.052488    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12329h21m58.703971115s"
Jul 07 14:06:55.114864 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:55.113872    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:06:55.114864 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:55.113994    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:06:55.114864 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:55.114418    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:55.114864 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:55.114516    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:06:55.114864 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:55.114583    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:06:55.114864 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:55.114742    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:06:56.675186 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:56.674496    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:56.675186 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:56.674646    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:06:56.675186 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:56.674716    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret podName:c661b77e-fb49-41fc-97ae-243728ee2c39 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:00.674695089 +0000 UTC m=+10.037018480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret") pod "global-pull-secret-syncer-wrlhh" (UID: "c661b77e-fb49-41fc-97ae-243728ee2c39") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:06:56.774921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:56.774882    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:06:56.775122 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:56.775057    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:06:56.775122 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:56.775121    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs podName:7c4fc6fc-66a0-47c4-ac0f-413df650c65e nodeName:}" failed. No retries permitted until 2026-07-07 14:07:00.775100861 +0000 UTC m=+10.137424024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs") pod "network-metrics-daemon-85vzp" (UID: "7c4fc6fc-66a0-47c4-ac0f-413df650c65e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:06:56.876459 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:56.876417    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5clm2\" (UniqueName: \"kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2\") pod \"network-check-target-zhlsz\" (UID: \"4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4\") " pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:06:56.876648 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:56.876585    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:06:56.876648 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:56.876607    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:06:56.876648 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:56.876620    2557 projected.go:196] Error preparing data for projected volume kube-api-access-5clm2 for pod openshift-network-diagnostics/network-check-target-zhlsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:06:56.876817 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:56.876683    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2 podName:4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:00.876665572 +0000 UTC m=+10.238988745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5clm2" (UniqueName: "kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2") pod "network-check-target-zhlsz" (UID: "4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:06:57.115503 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:57.114607    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:06:57.115503 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:57.114748    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:06:57.115503 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:57.115127    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:06:57.115503 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:57.115226    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:06:57.115503 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:57.115277    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:57.115503 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:57.115382    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:06:59.112157 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:59.112116    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:06:59.112662 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:59.112125    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:06:59.112662 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:59.112239    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:06:59.112662 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:59.112374    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:06:59.112662 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:06:59.112130    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:06:59.112662 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:06:59.112493    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:00.705467 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:00.705403    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:00.705883 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:00.705572    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:00.705883 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:00.705656    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret podName:c661b77e-fb49-41fc-97ae-243728ee2c39 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:08.705635821 +0000 UTC m=+18.067958980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret") pod "global-pull-secret-syncer-wrlhh" (UID: "c661b77e-fb49-41fc-97ae-243728ee2c39") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:00.805913 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:00.805873    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:00.806097 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:00.806054    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:00.806168 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:00.806138    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs podName:7c4fc6fc-66a0-47c4-ac0f-413df650c65e nodeName:}" failed. No retries permitted until 2026-07-07 14:07:08.806116418 +0000 UTC m=+18.168439569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs") pod "network-metrics-daemon-85vzp" (UID: "7c4fc6fc-66a0-47c4-ac0f-413df650c65e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:00.906719 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:00.906682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5clm2\" (UniqueName: \"kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2\") pod \"network-check-target-zhlsz\" (UID: \"4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4\") " pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:00.906920 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:00.906878    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:07:00.906920 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:00.906898    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:07:00.906920 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:00.906908    2557 projected.go:196] Error preparing data for projected volume kube-api-access-5clm2 for pod openshift-network-diagnostics/network-check-target-zhlsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:00.907081 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:00.906970    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2 podName:4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:08.906948458 +0000 UTC m=+18.269271606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5clm2" (UniqueName: "kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2") pod "network-check-target-zhlsz" (UID: "4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:01.113213 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:01.113136    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:01.113390 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:01.113246    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:01.113390 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:01.113303    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:01.113502 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:01.113405    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:01.113605 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:01.113581    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:01.113699 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:01.113677    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:03.112032 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:03.111913    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:03.112032 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:03.111926    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:03.112753 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:03.112075    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:03.112753 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:03.112462    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:03.112753 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:03.112566    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:03.112753 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:03.112655    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:05.112186 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:05.111686    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:05.112186 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:05.111686    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:05.112186 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:05.111823    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:05.112186 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:05.111938    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:05.112186 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:05.111686    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:05.112186 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:05.112025    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:06.200003 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:06.199168    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal" event={"ID":"098c8f1e1bab8bfb614b320b9ae089b4","Type":"ContainerStarted","Data":"44edc007c7dc11003c588c72b4a580e17cfcaba055b9f755ce45b8ff44d2f2ba"}
Jul 07 14:07:06.202210 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:06.202185    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c4g2w" event={"ID":"b22953df-fa9e-4760-9814-d772396a7e8e","Type":"ContainerStarted","Data":"852517773c92a91828523310b0fb82af97a005bbc88d413299320aec89294a69"}
Jul 07 14:07:06.215087 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:06.215037    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal" podStartSLOduration=13.215021916 podStartE2EDuration="13.215021916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:06:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:06.214612509 +0000 UTC m=+15.576935676" watchObservedRunningTime="2026-07-07 14:07:06.215021916 +0000 UTC m=+15.577345083"
Jul 07 14:07:06.231610 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:06.231553    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c4g2w" podStartSLOduration=2.053680369 podStartE2EDuration="14.231530786s" totalImagesPullingTime="12.177850417s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:06.231071627 +0000 UTC m=+15.593394794" watchObservedRunningTime="2026-07-07 14:07:06.231530786 +0000 UTC m=+15.593853954"
Jul 07 14:07:07.112126 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.111918    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:07.112376 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.111918    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:07.112376 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:07.112275    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:07.112376 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:07.112345    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:07.112376 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.111934    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:07.112579 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:07.112442    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:07.209325 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.209177    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal" event={"ID":"9babfa7336fea69e033ea2de5a041c6e","Type":"ContainerStarted","Data":"c00fc5dd7673222961d8972fe12b74e618fc9c8a778e5e7f4738f0834a0a2bc6"}
Jul 07 14:07:07.211123 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.211085    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k2zhl" event={"ID":"90a5edcc-b022-470d-9537-5a969feb1153","Type":"ContainerStarted","Data":"2ed77b3b4c81fc916c004af0d455dd4a2296cebf3fb44b7264e379e79be79b43"}
Jul 07 14:07:07.212841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.212809    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lj45b" event={"ID":"d25dc2c0-12a6-4c21-b56e-6a681deaba83","Type":"ContainerStarted","Data":"e0b493d16f9b16af25fd21b4aa749476dd974c464ba550908685f6d51e2d2d83"}
Jul 07 14:07:07.214953 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.214929    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kkv66" event={"ID":"2dd2efa1-7033-4090-bbd0-3441833898a7","Type":"ContainerStarted","Data":"273cefa87deb88f75911276e5f54b47151aa818d289502d1a9073ecb2e255dd0"}
Jul 07 14:07:07.216710 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.216685    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dnfwh" event={"ID":"0565009f-db88-49d2-84e8-de0653188d27","Type":"ContainerStarted","Data":"7ef1db8c973bea6f7690762805d274326582b40f3a3c254ece2a256e30b1318f"}
Jul 07 14:07:07.218916 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.218891    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2jst6" event={"ID":"e6552b16-7e6c-4380-85bb-2a30850f511f","Type":"ContainerStarted","Data":"98cd0980b39f55bc445769c2de88053139512080f05d7631879d31932383c5e1"}
Jul 07 14:07:07.220914 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.220881    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5" event={"ID":"19dbaf29-022f-4811-b6e0-a276f0551522","Type":"ContainerStarted","Data":"806e7c6d57a6acbff082e17c0104332154428e883e7d2f21a5de8e84ffbc6176"}
Jul 07 14:07:07.238076 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.238016    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kkv66" podStartSLOduration=3.048564062 podStartE2EDuration="15.237994312s" totalImagesPullingTime="12.18943025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:07.237363259 +0000 UTC m=+16.599686454" watchObservedRunningTime="2026-07-07 14:07:07.237994312 +0000 UTC m=+16.600317516"
Jul 07 14:07:07.276852 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.276786    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k2zhl" podStartSLOduration=3.138085465 podStartE2EDuration="15.276764545s" totalImagesPullingTime="12.13867908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:07.276482231 +0000 UTC m=+16.638805399" watchObservedRunningTime="2026-07-07 14:07:07.276764545 +0000 UTC m=+16.639087716"
Jul 07 14:07:07.292396 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.292339    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lj45b" podStartSLOduration=3.119241495 podStartE2EDuration="15.292315639s" totalImagesPullingTime="12.173074144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:07.292270092 +0000 UTC m=+16.654593261" watchObservedRunningTime="2026-07-07 14:07:07.292315639 +0000 UTC m=+16.654638806"
Jul 07 14:07:07.306736 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:07.306684    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dnfwh" podStartSLOduration=3.070808484 podStartE2EDuration="15.306667524s" totalImagesPullingTime="12.23585904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:07.306586756 +0000 UTC m=+16.668909924" watchObservedRunningTime="2026-07-07 14:07:07.306667524 +0000 UTC m=+16.668990692"
Jul 07 14:07:08.661750 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:08.661708    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k2zhl"
Jul 07 14:07:08.662332 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:08.662314    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k2zhl"
Jul 07 14:07:08.766560 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:08.766526    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:08.766729 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:08.766674    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:08.766802 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:08.766753    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret podName:c661b77e-fb49-41fc-97ae-243728ee2c39 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:24.766734201 +0000 UTC m=+34.129057351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret") pod "global-pull-secret-syncer-wrlhh" (UID: "c661b77e-fb49-41fc-97ae-243728ee2c39") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:08.867678 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:08.867628    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:08.867884 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:08.867809    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:08.867952 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:08.867886    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs podName:7c4fc6fc-66a0-47c4-ac0f-413df650c65e nodeName:}" failed. No retries permitted until 2026-07-07 14:07:24.867865875 +0000 UTC m=+34.230189044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs") pod "network-metrics-daemon-85vzp" (UID: "7c4fc6fc-66a0-47c4-ac0f-413df650c65e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:08.968264 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:08.968164    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5clm2\" (UniqueName: \"kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2\") pod \"network-check-target-zhlsz\" (UID: \"4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4\") " pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:08.968427 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:08.968355    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:07:08.968427 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:08.968380    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:07:08.968427 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:08.968391    2557 projected.go:196] Error preparing data for projected volume kube-api-access-5clm2 for pod openshift-network-diagnostics/network-check-target-zhlsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:08.968556 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:08.968449    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2 podName:4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:24.968431561 +0000 UTC m=+34.330754707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5clm2" (UniqueName: "kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2") pod "network-check-target-zhlsz" (UID: "4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:09.111733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:09.111685    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:09.111918 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:09.111823    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:09.111918 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:09.111685    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:09.111918 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:09.111871    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:09.112067 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:09.111926    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:09.112067 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:09.111977    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:09.225957 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:09.225872    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k2zhl"
Jul 07 14:07:09.226484 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:09.226465    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k2zhl"
Jul 07 14:07:11.112158 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:11.112132    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:11.112976 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:11.112248    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:11.112976 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:11.112292    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:11.112976 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:11.112252    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:11.112976 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:11.112393    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:11.112976 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:11.112462    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:11.231381 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:11.231343    2557 generic.go:356] "Generic (PLEG): container finished" podID="e6552b16-7e6c-4380-85bb-2a30850f511f" containerID="98cd0980b39f55bc445769c2de88053139512080f05d7631879d31932383c5e1" exitCode=0
Jul 07 14:07:11.231568 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:11.231419    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2jst6" event={"ID":"e6552b16-7e6c-4380-85bb-2a30850f511f","Type":"ContainerDied","Data":"98cd0980b39f55bc445769c2de88053139512080f05d7631879d31932383c5e1"}
Jul 07 14:07:11.233343 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:11.233280    2557 generic.go:356] "Generic (PLEG): container finished" podID="9babfa7336fea69e033ea2de5a041c6e" containerID="c00fc5dd7673222961d8972fe12b74e618fc9c8a778e5e7f4738f0834a0a2bc6" exitCode=0
Jul 07 14:07:11.233411 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:11.233347    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal" event={"ID":"9babfa7336fea69e033ea2de5a041c6e","Type":"ContainerDied","Data":"c00fc5dd7673222961d8972fe12b74e618fc9c8a778e5e7f4738f0834a0a2bc6"}
Jul 07 14:07:13.112267 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:13.112217    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:13.112738 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:13.112358    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:13.112738 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:13.112218    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:13.112738 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:13.112446    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:13.112738 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:13.112218    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:13.112738 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:13.112533    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:15.040913 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.040589    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 14:07:15.095907 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.095824    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:07:15.040908979Z","UUID":"0d6f1d13-7498-42d0-a1ca-622c852c2f8f","Handler":null,"Name":"","Endpoint":""}
Jul 07 14:07:15.097337 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.097318    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 14:07:15.097418 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.097354    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 14:07:15.111631 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.111560    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:15.111743 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.111565    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:15.111743 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:15.111676    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:15.111743 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.111707    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:15.111913 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:15.111776    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:15.111913 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:15.111870    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:15.242960 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.242928    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z7qgr" event={"ID":"7d4112bf-a5ba-493d-bcab-1e1b7b1c913b","Type":"ContainerStarted","Data":"487c29ea0ee847786711fb589010649b2f60defa90d2bbf259564f901c82c74c"}
Jul 07 14:07:15.245032 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.245008    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5" event={"ID":"19dbaf29-022f-4811-b6e0-a276f0551522","Type":"ContainerStarted","Data":"e2eb7c0c289e82cd52f9605fac16d174606074e639984978f8546386b9456282"}
Jul 07 14:07:15.247331 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.247308    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal" event={"ID":"9babfa7336fea69e033ea2de5a041c6e","Type":"ContainerStarted","Data":"cd6067e48f09c550d6821ee67218c4fe74b31440dd68b75542e4916dbf6c6917"}
Jul 07 14:07:15.250032 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.250010    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj" event={"ID":"8bedc9c2-3422-47ca-bc0c-fd952491a31b","Type":"ContainerStarted","Data":"939d6f184542b6bd50f4c181f9a6eae7f5320bf321ca035792b628368cbaf407"}
Jul 07 14:07:15.250141 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.250064    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj" event={"ID":"8bedc9c2-3422-47ca-bc0c-fd952491a31b","Type":"ContainerStarted","Data":"e382c81e1a6a48838657407934ded68f108fe61ef1ef5fabdc2920493388f3d1"}
Jul 07 14:07:15.250141 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.250108    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj" event={"ID":"8bedc9c2-3422-47ca-bc0c-fd952491a31b","Type":"ContainerStarted","Data":"267ce4623e104064c8bd3c7e6858704a4cfdf2ce167ea3f35b350d25d9d79994"}
Jul 07 14:07:15.250141 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.250139    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj" event={"ID":"8bedc9c2-3422-47ca-bc0c-fd952491a31b","Type":"ContainerStarted","Data":"988ddae3db53522df218b13b6726db1b021f7cf20749a9adb03fac04ef940596"}
Jul 07 14:07:15.250268 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.250165    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj" event={"ID":"8bedc9c2-3422-47ca-bc0c-fd952491a31b","Type":"ContainerStarted","Data":"92c1534d6e673816a7a0fec0db4b76d606f95461e2367dbb7181c5e1c8185ba8"}
Jul 07 14:07:15.260004 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.259965    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z7qgr" podStartSLOduration=1.817778463 podStartE2EDuration="23.259951237s" totalImagesPullingTime="21.442172774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:15.259503332 +0000 UTC m=+24.621826575" watchObservedRunningTime="2026-07-07 14:07:15.259951237 +0000 UTC m=+24.622274403"
Jul 07 14:07:15.273535 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:15.273498    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal" podStartSLOduration=22.273485545 podStartE2EDuration="22.273485545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:06:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:15.273007765 +0000 UTC m=+24.635330931" watchObservedRunningTime="2026-07-07 14:07:15.273485545 +0000 UTC m=+24.635808712"
Jul 07 14:07:16.257886 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:16.255794    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj" event={"ID":"8bedc9c2-3422-47ca-bc0c-fd952491a31b","Type":"ContainerStarted","Data":"4e39dbae95c3ec9147ff031873981611505f1c71a1e43738f05eab450cd1dd39"}
Jul 07 14:07:17.111589 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:17.111558    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:17.111796 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:17.111560    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:17.111796 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:17.111675    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:17.111796 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:17.111560    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:17.111796 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:17.111733    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:17.111992 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:17.111812    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:17.259244 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:17.259194    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5" event={"ID":"19dbaf29-022f-4811-b6e0-a276f0551522","Type":"ContainerStarted","Data":"59f6990e12c173a01358b48ac44499feb6180a2d210daa243c3e070ee91c6cce"}
Jul 07 14:07:17.278008 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:17.277961    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gztc5" podStartSLOduration=3.6403213880000003 podStartE2EDuration="25.277945798s" totalImagesPullingTime="21.63762441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:06:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:17.277594429 +0000 UTC m=+26.639917598" watchObservedRunningTime="2026-07-07 14:07:17.277945798 +0000 UTC m=+26.640268965"
Jul 07 14:07:18.264980 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:18.264940    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj" event={"ID":"8bedc9c2-3422-47ca-bc0c-fd952491a31b","Type":"ContainerStarted","Data":"8c49d9f7b50648df0a81f10046571c66c987fcb39e6b9da39bd4653850d37de1"}
Jul 07 14:07:19.111911 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:19.111878    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:19.112083 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:19.111877    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:19.112083 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:19.111983    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:19.112083 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:19.111877    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:19.112083 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:19.112066    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:19.112297 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:19.112168    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:20.273621 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:20.273581    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj" event={"ID":"8bedc9c2-3422-47ca-bc0c-fd952491a31b","Type":"ContainerStarted","Data":"04ec68e5978faaa94030886d1a95ed0152ccefae2468f64548a3776b12e1b462"}
Jul 07 14:07:20.274335 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:20.273873    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:07:20.274335 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:20.273948    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:07:20.290622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:20.290600    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:07:20.302425 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:20.302376    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj" podStartSLOduration=6.867372181 podStartE2EDuration="28.302357372s" totalImagesPullingTime="21.434985191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:20.301275642 +0000 UTC m=+29.663598808" watchObservedRunningTime="2026-07-07 14:07:20.302357372 +0000 UTC m=+29.664680544"
Jul 07 14:07:21.112625 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:21.112591    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:21.112783 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:21.112667    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:21.112783 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:21.112713    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:21.112783 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:21.112723    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:21.112783 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:21.112769    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:21.112990 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:21.112823    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:21.276466 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:21.276434    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:07:21.292944 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:21.292918    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:07:21.884033 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:21.883989    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wrlhh"]
Jul 07 14:07:21.884202 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:21.884161    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:21.884314 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:21.884285    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:21.887057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:21.887019    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-85vzp"]
Jul 07 14:07:21.887247 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:21.887216    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:21.887480 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:21.887433    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:21.887794 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:21.887762    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zhlsz"]
Jul 07 14:07:21.887878 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:21.887863    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:21.887969 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:21.887949    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:23.282566 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:23.282534    2557 generic.go:356] "Generic (PLEG): container finished" podID="e6552b16-7e6c-4380-85bb-2a30850f511f" containerID="cad9aeaeaa69ad7cb9270f97773bea2ca0901511ad27c99aee9506be240c6185" exitCode=0
Jul 07 14:07:23.282951 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:23.282605    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2jst6" event={"ID":"e6552b16-7e6c-4380-85bb-2a30850f511f","Type":"ContainerDied","Data":"cad9aeaeaa69ad7cb9270f97773bea2ca0901511ad27c99aee9506be240c6185"}
Jul 07 14:07:24.111247 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:24.111203    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:24.111391 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:24.111222    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:24.111391 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:24.111350    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:24.111391 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:24.111390    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:24.111525 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:24.111497    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:24.111612 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:24.111596    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:24.785239 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:24.785198    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:24.785676 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:24.785379    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:24.785676 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:24.785439    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret podName:c661b77e-fb49-41fc-97ae-243728ee2c39 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:56.785425308 +0000 UTC m=+66.147748457 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret") pod "global-pull-secret-syncer-wrlhh" (UID: "c661b77e-fb49-41fc-97ae-243728ee2c39") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:07:24.885802 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:24.885774    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:24.885953 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:24.885899    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:24.885953 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:24.885950    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs podName:7c4fc6fc-66a0-47c4-ac0f-413df650c65e nodeName:}" failed. No retries permitted until 2026-07-07 14:07:56.885936364 +0000 UTC m=+66.248259509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs") pod "network-metrics-daemon-85vzp" (UID: "7c4fc6fc-66a0-47c4-ac0f-413df650c65e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:07:24.986673 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:24.986638    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5clm2\" (UniqueName: \"kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2\") pod \"network-check-target-zhlsz\" (UID: \"4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4\") " pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:24.986818 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:24.986748    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:07:24.986818 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:24.986761    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:07:24.986818 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:24.986770    2557 projected.go:196] Error preparing data for projected volume kube-api-access-5clm2 for pod openshift-network-diagnostics/network-check-target-zhlsz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:24.986818 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:24.986813    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2 podName:4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:56.986800508 +0000 UTC m=+66.349123653 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5clm2" (UniqueName: "kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2") pod "network-check-target-zhlsz" (UID: "4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:07:26.112338 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:26.112144    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:26.112808 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:26.112144    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:26.112808 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:26.112428    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:26.112808 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:26.112144    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:26.112808 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:26.112487    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:26.112808 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:26.112553    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:26.292461 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:26.292424    2557 generic.go:356] "Generic (PLEG): container finished" podID="e6552b16-7e6c-4380-85bb-2a30850f511f" containerID="55e1e620e4de3f00cffbc17faf8fd664ffe07987b83e0a97185f389c84dc845b" exitCode=0
Jul 07 14:07:26.292681 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:26.292485    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2jst6" event={"ID":"e6552b16-7e6c-4380-85bb-2a30850f511f","Type":"ContainerDied","Data":"55e1e620e4de3f00cffbc17faf8fd664ffe07987b83e0a97185f389c84dc845b"}
Jul 07 14:07:28.111980 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.111858    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:28.111980 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.111877    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:28.111980 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.111858    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:28.111980 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:28.111959    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zhlsz" podUID="4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4"
Jul 07 14:07:28.112460 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:28.112036    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrlhh" podUID="c661b77e-fb49-41fc-97ae-243728ee2c39"
Jul 07 14:07:28.112460 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:28.112096    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:07:28.298624 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.298562    2557 generic.go:356] "Generic (PLEG): container finished" podID="e6552b16-7e6c-4380-85bb-2a30850f511f" containerID="6abb6d221ac4132d44ef4ec036e116b1933d4d17e903da7bb078f0e92591e973" exitCode=0
Jul 07 14:07:28.298624 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.298593    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2jst6" event={"ID":"e6552b16-7e6c-4380-85bb-2a30850f511f","Type":"ContainerDied","Data":"6abb6d221ac4132d44ef4ec036e116b1933d4d17e903da7bb078f0e92591e973"}
Jul 07 14:07:28.420168 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.420144    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeReady"
Jul 07 14:07:28.420325 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.420274    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 14:07:28.456875 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.456848    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b9858dc8-29r24"]
Jul 07 14:07:28.458664 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.458647    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.462131 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.462113    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xtlr6\""
Jul 07 14:07:28.462563 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.462549    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 14:07:28.462643 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.462577    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 14:07:28.462917 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.462901    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 14:07:28.468251 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.468215    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 14:07:28.472103 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.472086    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fqnhj"]
Jul 07 14:07:28.473996 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.473983    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:28.475799 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.475777    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9858dc8-29r24"]
Jul 07 14:07:28.476663 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.476646    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 14:07:28.476767 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.476649    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 14:07:28.476767 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.476674    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cxvss\""
Jul 07 14:07:28.478759 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.478738    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pmztk"]
Jul 07 14:07:28.481017 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.480947    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pmztk"
Jul 07 14:07:28.483750 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.483735    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sfsdl\""
Jul 07 14:07:28.484818 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.484801    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 14:07:28.485061 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.485043    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 14:07:28.485102 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.485073    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 14:07:28.492217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.492199    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fqnhj"]
Jul 07 14:07:28.497155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.497138    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pmztk"]
Jul 07 14:07:28.510741 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.510719    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-bound-sa-token\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.510832 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.510758    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-trusted-ca\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.510832 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.510792    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.510909 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.510858    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7fsr\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-kube-api-access-j7fsr\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.510942 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.510915    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-certificates\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.510942 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.510935    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-installation-pull-secrets\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.511022 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.511007    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-image-registry-private-configuration\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.511057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.511035    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-ca-trust-extracted\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.611427 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7fsr\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-kube-api-access-j7fsr\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.611551 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611436    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-certificates\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.611551 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611456    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fab96c66-1f3e-4e40-8933-ca91fa651627-config-volume\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:28.611551 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611487    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-installation-pull-secrets\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.611551 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611513    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7375d1d7-35a7-436f-ae17-b9b7c13761a1-cert\") pod \"ingress-canary-pmztk\" (UID: \"7375d1d7-35a7-436f-ae17-b9b7c13761a1\") " pod="openshift-ingress-canary/ingress-canary-pmztk"
Jul 07 14:07:28.611551 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611530    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:28.611788 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611560    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-image-registry-private-configuration\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.611788 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611582    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-ca-trust-extracted\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.611788 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611606    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fab96c66-1f3e-4e40-8933-ca91fa651627-tmp-dir\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:28.611788 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611687    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-bound-sa-token\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.611788 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611718    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpk97\" (UniqueName: \"kubernetes.io/projected/fab96c66-1f3e-4e40-8933-ca91fa651627-kube-api-access-mpk97\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:28.611788 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611749    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-trusted-ca\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.611788 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611779    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz65g\" (UniqueName: \"kubernetes.io/projected/7375d1d7-35a7-436f-ae17-b9b7c13761a1-kube-api-access-lz65g\") pod \"ingress-canary-pmztk\" (UID: \"7375d1d7-35a7-436f-ae17-b9b7c13761a1\") " pod="openshift-ingress-canary/ingress-canary-pmztk"
Jul 07 14:07:28.612068 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.611819    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.612068 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:28.611920    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:07:28.612068 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:28.611935    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9858dc8-29r24: secret "image-registry-tls" not found
Jul 07 14:07:28.612068 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:28.611988    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls podName:6b52d79d-6dfc-4201-8d9e-a5bc8e667d94 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:29.11196813 +0000 UTC m=+38.474291288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls") pod "image-registry-5b9858dc8-29r24" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94") : secret "image-registry-tls" not found
Jul 07 14:07:28.612273 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.612220    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-certificates\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.612713 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.612695    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-trusted-ca\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.612760 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.612741    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-ca-trust-extracted\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.615515 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.615494    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-installation-pull-secrets\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.615595 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.615498    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-image-registry-private-configuration\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.620421 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.620400    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-bound-sa-token\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.620909 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.620892    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7fsr\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-kube-api-access-j7fsr\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:28.713078 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.713050    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpk97\" (UniqueName: \"kubernetes.io/projected/fab96c66-1f3e-4e40-8933-ca91fa651627-kube-api-access-mpk97\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:28.713205 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.713091    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz65g\" (UniqueName: \"kubernetes.io/projected/7375d1d7-35a7-436f-ae17-b9b7c13761a1-kube-api-access-lz65g\") pod \"ingress-canary-pmztk\" (UID: \"7375d1d7-35a7-436f-ae17-b9b7c13761a1\") " pod="openshift-ingress-canary/ingress-canary-pmztk"
Jul 07 14:07:28.713298 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.713219    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fab96c66-1f3e-4e40-8933-ca91fa651627-config-volume\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:28.713298 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.713278    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7375d1d7-35a7-436f-ae17-b9b7c13761a1-cert\") pod \"ingress-canary-pmztk\" (UID: \"7375d1d7-35a7-436f-ae17-b9b7c13761a1\") " pod="openshift-ingress-canary/ingress-canary-pmztk"
Jul 07 14:07:28.713387 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.713299    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:28.713387 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.713330    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fab96c66-1f3e-4e40-8933-ca91fa651627-tmp-dir\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:28.713481 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:28.713431    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:07:28.716621 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.713820    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fab96c66-1f3e-4e40-8933-ca91fa651627-tmp-dir\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:28.716621 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:28.713846    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls podName:fab96c66-1f3e-4e40-8933-ca91fa651627 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:29.213714473 +0000 UTC m=+38.576037635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls") pod "dns-default-fqnhj" (UID: "fab96c66-1f3e-4e40-8933-ca91fa651627") : secret "dns-default-metrics-tls" not found
Jul 07 14:07:28.716621 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.714043    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fab96c66-1f3e-4e40-8933-ca91fa651627-config-volume\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:28.716621 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.716263    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7375d1d7-35a7-436f-ae17-b9b7c13761a1-cert\") pod \"ingress-canary-pmztk\" (UID: \"7375d1d7-35a7-436f-ae17-b9b7c13761a1\") " pod="openshift-ingress-canary/ingress-canary-pmztk"
Jul 07 14:07:28.723530 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.723510    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpk97\" (UniqueName: \"kubernetes.io/projected/fab96c66-1f3e-4e40-8933-ca91fa651627-kube-api-access-mpk97\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:28.724429 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.724410    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz65g\" (UniqueName: \"kubernetes.io/projected/7375d1d7-35a7-436f-ae17-b9b7c13761a1-kube-api-access-lz65g\") pod \"ingress-canary-pmztk\" (UID: \"7375d1d7-35a7-436f-ae17-b9b7c13761a1\") " pod="openshift-ingress-canary/ingress-canary-pmztk"
Jul 07 14:07:28.789520 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.789496    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pmztk"
Jul 07 14:07:28.935916 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:28.935705    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pmztk"]
Jul 07 14:07:28.939925 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:07:28.939901    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7375d1d7_35a7_436f_ae17_b9b7c13761a1.slice/crio-74f0a81f4f659b267eb3f8069f90e7918cc5b008fd59d898a6d2ed66a3f0edca WatchSource:0}: Error finding container 74f0a81f4f659b267eb3f8069f90e7918cc5b008fd59d898a6d2ed66a3f0edca: Status 404 returned error can't find the container with id 74f0a81f4f659b267eb3f8069f90e7918cc5b008fd59d898a6d2ed66a3f0edca
Jul 07 14:07:29.117996 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:29.117923    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:29.118550 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:29.118048    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:07:29.118550 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:29.118060    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9858dc8-29r24: secret "image-registry-tls" not found
Jul 07 14:07:29.118550 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:29.118103    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls podName:6b52d79d-6dfc-4201-8d9e-a5bc8e667d94 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:30.118091433 +0000 UTC m=+39.480414579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls") pod "image-registry-5b9858dc8-29r24" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94") : secret "image-registry-tls" not found
Jul 07 14:07:29.218825 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:29.218789    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:29.218980 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:29.218942    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:07:29.219028 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:29.219015    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls podName:fab96c66-1f3e-4e40-8933-ca91fa651627 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:30.218995136 +0000 UTC m=+39.581318284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls") pod "dns-default-fqnhj" (UID: "fab96c66-1f3e-4e40-8933-ca91fa651627") : secret "dns-default-metrics-tls" not found
Jul 07 14:07:29.302754 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:29.302724    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pmztk" event={"ID":"7375d1d7-35a7-436f-ae17-b9b7c13761a1","Type":"ContainerStarted","Data":"74f0a81f4f659b267eb3f8069f90e7918cc5b008fd59d898a6d2ed66a3f0edca"}
Jul 07 14:07:30.111588 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:30.111550    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:30.111784 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:30.111599    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:30.111784 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:30.111599    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:30.114699 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:30.114677    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 14:07:30.115613 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:30.115581    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wgdzp\""
Jul 07 14:07:30.115855 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:30.115834    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 14:07:30.115970 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:30.115857    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 14:07:30.115970 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:30.115879    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d5l84\""
Jul 07 14:07:30.116141 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:30.116128    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 14:07:30.126649 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:30.126626    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:30.126986 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:30.126751    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:07:30.126986 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:30.126764    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9858dc8-29r24: secret "image-registry-tls" not found
Jul 07 14:07:30.126986 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:30.126812    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls podName:6b52d79d-6dfc-4201-8d9e-a5bc8e667d94 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:32.126797872 +0000 UTC m=+41.489121017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls") pod "image-registry-5b9858dc8-29r24" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94") : secret "image-registry-tls" not found
Jul 07 14:07:30.227856 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:30.227823    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:30.228035 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:30.228017    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:07:30.228100 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:30.228093    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls podName:fab96c66-1f3e-4e40-8933-ca91fa651627 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:32.228071986 +0000 UTC m=+41.590395139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls") pod "dns-default-fqnhj" (UID: "fab96c66-1f3e-4e40-8933-ca91fa651627") : secret "dns-default-metrics-tls" not found
Jul 07 14:07:31.067922 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:31.067876    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2zhl_90a5edcc-b022-470d-9537-5a969feb1153/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:31.151472 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:31.151426    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2zhl_90a5edcc-b022-470d-9537-5a969feb1153/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:32.141536 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:32.141501    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:32.141719 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:32.141668    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:07:32.141719 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:32.141688    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9858dc8-29r24: secret "image-registry-tls" not found
Jul 07 14:07:32.141807 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:32.141752    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls podName:6b52d79d-6dfc-4201-8d9e-a5bc8e667d94 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:36.141730321 +0000 UTC m=+45.504053483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls") pod "image-registry-5b9858dc8-29r24" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94") : secret "image-registry-tls" not found
Jul 07 14:07:32.242173 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:32.242145    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:32.242554 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:32.242279    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:07:32.242554 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:32.242339    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls podName:fab96c66-1f3e-4e40-8933-ca91fa651627 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:36.242325811 +0000 UTC m=+45.604648955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls") pod "dns-default-fqnhj" (UID: "fab96c66-1f3e-4e40-8933-ca91fa651627") : secret "dns-default-metrics-tls" not found
Jul 07 14:07:33.314080 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:33.314043    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pmztk" event={"ID":"7375d1d7-35a7-436f-ae17-b9b7c13761a1","Type":"ContainerStarted","Data":"77d1e98fc4a7caaa2af88c07ef9d24e2529fe3efda73bd1de079f75e2ed77a25"}
Jul 07 14:07:33.330806 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:33.330763    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pmztk" podStartSLOduration=2.002901316 podStartE2EDuration="5.330750116s" totalImagesPullingTime="3.3278488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:33.330000042 +0000 UTC m=+42.692323201" watchObservedRunningTime="2026-07-07 14:07:33.330750116 +0000 UTC m=+42.693073283"
Jul 07 14:07:36.170838 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:36.170760    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:36.171167 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:36.170874    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:07:36.171167 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:36.170885    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9858dc8-29r24: secret "image-registry-tls" not found
Jul 07 14:07:36.171167 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:36.170931    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls podName:6b52d79d-6dfc-4201-8d9e-a5bc8e667d94 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:44.17091797 +0000 UTC m=+53.533241115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls") pod "image-registry-5b9858dc8-29r24" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94") : secret "image-registry-tls" not found
Jul 07 14:07:36.271551 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:36.271520    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:36.271688 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:36.271662    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:07:36.271733 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:36.271719    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls podName:fab96c66-1f3e-4e40-8933-ca91fa651627 nodeName:}" failed. No retries permitted until 2026-07-07 14:07:44.271705301 +0000 UTC m=+53.634028449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls") pod "dns-default-fqnhj" (UID: "fab96c66-1f3e-4e40-8933-ca91fa651627") : secret "dns-default-metrics-tls" not found
Jul 07 14:07:36.323537 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:36.323508    2557 generic.go:356] "Generic (PLEG): container finished" podID="e6552b16-7e6c-4380-85bb-2a30850f511f" containerID="c17cd2d9c031c0b63685d161887b52985287ece6764c85ffa7a20d6cfd29c70b" exitCode=0
Jul 07 14:07:36.323655 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:36.323569    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2jst6" event={"ID":"e6552b16-7e6c-4380-85bb-2a30850f511f","Type":"ContainerDied","Data":"c17cd2d9c031c0b63685d161887b52985287ece6764c85ffa7a20d6cfd29c70b"}
Jul 07 14:07:37.328684 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:37.328503    2557 generic.go:356] "Generic (PLEG): container finished" podID="e6552b16-7e6c-4380-85bb-2a30850f511f" containerID="d9c2fc4c33e6779ed3dac1692e216900003c792a66b8b6bfd809c17fc32ab92b" exitCode=0
Jul 07 14:07:37.329022 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:37.328576    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2jst6" event={"ID":"e6552b16-7e6c-4380-85bb-2a30850f511f","Type":"ContainerDied","Data":"d9c2fc4c33e6779ed3dac1692e216900003c792a66b8b6bfd809c17fc32ab92b"}
Jul 07 14:07:37.354683 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:37.354648    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2zhl_90a5edcc-b022-470d-9537-5a969feb1153/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:37.958450 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:37.958417    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2zhl_90a5edcc-b022-470d-9537-5a969feb1153/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:38.063104 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:38.063067    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2zhl_90a5edcc-b022-470d-9537-5a969feb1153/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:38.333801 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:38.333772    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2jst6" event={"ID":"e6552b16-7e6c-4380-85bb-2a30850f511f","Type":"ContainerStarted","Data":"bab7c14d1d9a1120f36b3236e0fae7442315ae6253c4da788fc9dc85b5d61f5a"}
Jul 07 14:07:38.360413 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:38.360361    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2jst6" podStartSLOduration=11.761150581999999 podStartE2EDuration="46.360344332s" totalImagesPullingTime="34.59919375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:06:52 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:38.358567857 +0000 UTC m=+47.720891026" watchObservedRunningTime="2026-07-07 14:07:38.360344332 +0000 UTC m=+47.722667499"
Jul 07 14:07:38.484311 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:38.484275    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2zhl_90a5edcc-b022-470d-9537-5a969feb1153/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:38.543057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:38.543026    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2zhl_90a5edcc-b022-470d-9537-5a969feb1153/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:39.788208 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:39.788178    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2zhl_90a5edcc-b022-470d-9537-5a969feb1153/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:39.889753 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:39.889718    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-k2zhl_90a5edcc-b022-470d-9537-5a969feb1153/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:44.235198 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:44.235157    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:07:44.235663 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:44.235318    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:07:44.235663 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:44.235338    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9858dc8-29r24: secret "image-registry-tls" not found
Jul 07 14:07:44.235663 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:44.235393    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls podName:6b52d79d-6dfc-4201-8d9e-a5bc8e667d94 nodeName:}" failed. No retries permitted until 2026-07-07 14:08:00.235378346 +0000 UTC m=+69.597701491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls") pod "image-registry-5b9858dc8-29r24" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94") : secret "image-registry-tls" not found
Jul 07 14:07:44.335869 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:44.335841    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:07:44.336004 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:44.335984    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:07:44.336065 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:44.336055    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls podName:fab96c66-1f3e-4e40-8933-ca91fa651627 nodeName:}" failed. No retries permitted until 2026-07-07 14:08:00.336041443 +0000 UTC m=+69.698364593 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls") pod "dns-default-fqnhj" (UID: "fab96c66-1f3e-4e40-8933-ca91fa651627") : secret "dns-default-metrics-tls" not found
Jul 07 14:07:45.989260 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:45.989214    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8"]
Jul 07 14:07:45.991076 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:45.991062    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8"
Jul 07 14:07:45.993070 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:45.993044    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"]
Jul 07 14:07:45.993737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:45.993716    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-txzq5\""
Jul 07 14:07:45.993824 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:45.993805    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 14:07:45.993955 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:45.993935    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 14:07:45.994540 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:45.994525    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 14:07:45.994782 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:45.994764    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 14:07:45.995010 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:45.994993    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"]
Jul 07 14:07:45.995091 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:45.995080    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:07:45.997093 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:45.997077    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:45.997582 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:45.997566    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 14:07:46.000013 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:45.999993    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 14:07:46.000110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.000039    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8"]
Jul 07 14:07:46.000110 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.000082    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 14:07:46.000411 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.000388    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 14:07:46.000502 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.000414    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 14:07:46.007066 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.007035    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"]
Jul 07 14:07:46.007781 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.007757    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"]
Jul 07 14:07:46.149722 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.149693    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-hub\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.149722 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.149722    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.149885 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.149750    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72d29703-a616-47de-a9b1-4d8d49f84bda-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69dbd6775d-7gbn8\" (UID: \"72d29703-a616-47de-a9b1-4d8d49f84bda\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8"
Jul 07 14:07:46.149885 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.149765    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82baaffc-4548-4d1a-b89a-4d46f64c96df-tmp\") pod \"klusterlet-addon-workmgr-7d76dd6858-jzddl\" (UID: \"82baaffc-4548-4d1a-b89a-4d46f64c96df\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:07:46.149885 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.149823    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82baaffc-4548-4d1a-b89a-4d46f64c96df-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d76dd6858-jzddl\" (UID: \"82baaffc-4548-4d1a-b89a-4d46f64c96df\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:07:46.149885 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.149852    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.150007 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.149897    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrq9h\" (UniqueName: \"kubernetes.io/projected/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-kube-api-access-wrq9h\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.150007 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.149923    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.150007 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.149948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jln7s\" (UniqueName: \"kubernetes.io/projected/82baaffc-4548-4d1a-b89a-4d46f64c96df-kube-api-access-jln7s\") pod \"klusterlet-addon-workmgr-7d76dd6858-jzddl\" (UID: \"82baaffc-4548-4d1a-b89a-4d46f64c96df\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:07:46.150007 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.149963    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-ca\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.150124 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.150044    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d7hj\" (UniqueName: \"kubernetes.io/projected/72d29703-a616-47de-a9b1-4d8d49f84bda-kube-api-access-8d7hj\") pod \"managed-serviceaccount-addon-agent-69dbd6775d-7gbn8\" (UID: \"72d29703-a616-47de-a9b1-4d8d49f84bda\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8"
Jul 07 14:07:46.250811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.250753    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-hub\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.250811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.250781    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.250921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.250806    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72d29703-a616-47de-a9b1-4d8d49f84bda-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69dbd6775d-7gbn8\" (UID: \"72d29703-a616-47de-a9b1-4d8d49f84bda\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8"
Jul 07 14:07:46.250921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.250830    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82baaffc-4548-4d1a-b89a-4d46f64c96df-tmp\") pod \"klusterlet-addon-workmgr-7d76dd6858-jzddl\" (UID: \"82baaffc-4548-4d1a-b89a-4d46f64c96df\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:07:46.250921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.250857    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82baaffc-4548-4d1a-b89a-4d46f64c96df-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d76dd6858-jzddl\" (UID: \"82baaffc-4548-4d1a-b89a-4d46f64c96df\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:07:46.250921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.250883    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.250921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.250908    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrq9h\" (UniqueName: \"kubernetes.io/projected/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-kube-api-access-wrq9h\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.251139 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.250938    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.251139 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.250968    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jln7s\" (UniqueName: \"kubernetes.io/projected/82baaffc-4548-4d1a-b89a-4d46f64c96df-kube-api-access-jln7s\") pod \"klusterlet-addon-workmgr-7d76dd6858-jzddl\" (UID: \"82baaffc-4548-4d1a-b89a-4d46f64c96df\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:07:46.251139 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.250987    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-ca\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.251139 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.251043    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d7hj\" (UniqueName: \"kubernetes.io/projected/72d29703-a616-47de-a9b1-4d8d49f84bda-kube-api-access-8d7hj\") pod \"managed-serviceaccount-addon-agent-69dbd6775d-7gbn8\" (UID: \"72d29703-a616-47de-a9b1-4d8d49f84bda\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8"
Jul 07 14:07:46.251354 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.251214    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82baaffc-4548-4d1a-b89a-4d46f64c96df-tmp\") pod \"klusterlet-addon-workmgr-7d76dd6858-jzddl\" (UID: \"82baaffc-4548-4d1a-b89a-4d46f64c96df\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:07:46.251878 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.251854    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.255065 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.255040    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.255142 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.255089    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-ca\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.255181 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.255156    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/82baaffc-4548-4d1a-b89a-4d46f64c96df-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d76dd6858-jzddl\" (UID: \"82baaffc-4548-4d1a-b89a-4d46f64c96df\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:07:46.255266 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.255250    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-hub\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.255387 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.255373    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72d29703-a616-47de-a9b1-4d8d49f84bda-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69dbd6775d-7gbn8\" (UID: \"72d29703-a616-47de-a9b1-4d8d49f84bda\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8"
Jul 07 14:07:46.255444 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.255424    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.259189 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.259163    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrq9h\" (UniqueName: \"kubernetes.io/projected/d3b6eae4-53c8-4421-acf0-bf3df9a93cd7-kube-api-access-wrq9h\") pod \"cluster-proxy-proxy-agent-6b94595b95-dds86\" (UID: \"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.259447 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.259430    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jln7s\" (UniqueName: \"kubernetes.io/projected/82baaffc-4548-4d1a-b89a-4d46f64c96df-kube-api-access-jln7s\") pod \"klusterlet-addon-workmgr-7d76dd6858-jzddl\" (UID: \"82baaffc-4548-4d1a-b89a-4d46f64c96df\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:07:46.259492 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.259460    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d7hj\" (UniqueName: \"kubernetes.io/projected/72d29703-a616-47de-a9b1-4d8d49f84bda-kube-api-access-8d7hj\") pod \"managed-serviceaccount-addon-agent-69dbd6775d-7gbn8\" (UID: \"72d29703-a616-47de-a9b1-4d8d49f84bda\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8"
Jul 07 14:07:46.312306 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.312286    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8"
Jul 07 14:07:46.318022 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.318003    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:07:46.323025 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.322996    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:07:46.462140 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.462039    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8"]
Jul 07 14:07:46.468777 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:07:46.468752    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72d29703_a616_47de_a9b1_4d8d49f84bda.slice/crio-2ef59ba9a904a2688fa2ae647edbd16f944d1bc54c7ebfa5071f214f9298edad WatchSource:0}: Error finding container 2ef59ba9a904a2688fa2ae647edbd16f944d1bc54c7ebfa5071f214f9298edad: Status 404 returned error can't find the container with id 2ef59ba9a904a2688fa2ae647edbd16f944d1bc54c7ebfa5071f214f9298edad
Jul 07 14:07:46.478567 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.478534    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"]
Jul 07 14:07:46.481245 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:07:46.481203    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82baaffc_4548_4d1a_b89a_4d46f64c96df.slice/crio-b42605890e0d659a04fcca8aa21107b87f39c4c52ef59dc868c2ecda34a27f19 WatchSource:0}: Error finding container b42605890e0d659a04fcca8aa21107b87f39c4c52ef59dc868c2ecda34a27f19: Status 404 returned error can't find the container with id b42605890e0d659a04fcca8aa21107b87f39c4c52ef59dc868c2ecda34a27f19
Jul 07 14:07:46.497733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:46.497712    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"]
Jul 07 14:07:46.500207 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:07:46.500185    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3b6eae4_53c8_4421_acf0_bf3df9a93cd7.slice/crio-80920e1a736e7b745221616f246a958a471100abc3cd57b3425451bc1adf574e WatchSource:0}: Error finding container 80920e1a736e7b745221616f246a958a471100abc3cd57b3425451bc1adf574e: Status 404 returned error can't find the container with id 80920e1a736e7b745221616f246a958a471100abc3cd57b3425451bc1adf574e
Jul 07 14:07:47.355819 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:47.355777    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8" event={"ID":"72d29703-a616-47de-a9b1-4d8d49f84bda","Type":"ContainerStarted","Data":"2ef59ba9a904a2688fa2ae647edbd16f944d1bc54c7ebfa5071f214f9298edad"}
Jul 07 14:07:47.357167 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:47.357139    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl" event={"ID":"82baaffc-4548-4d1a-b89a-4d46f64c96df","Type":"ContainerStarted","Data":"b42605890e0d659a04fcca8aa21107b87f39c4c52ef59dc868c2ecda34a27f19"}
Jul 07 14:07:47.358448 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:47.358423    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86" event={"ID":"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7","Type":"ContainerStarted","Data":"80920e1a736e7b745221616f246a958a471100abc3cd57b3425451bc1adf574e"}
Jul 07 14:07:51.370428 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:51.370386    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86" event={"ID":"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7","Type":"ContainerStarted","Data":"c2572fc0449103b8b63524f3625f5236b7d8a780bb3b11f36e9c7e70674e1148"}
Jul 07 14:07:51.370859 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:51.370436    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86" event={"ID":"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7","Type":"ContainerStarted","Data":"d19d8cc5ae73b2ef40ddf239f183a190ad87e97c2f83ded770db9436140528e1"}
Jul 07 14:07:51.370859 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:51.370452    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86" event={"ID":"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7","Type":"ContainerStarted","Data":"dcb9606ff4daeb96407831e94ba33b4fe093a131d3cf31d8ce070462aa3bc544"}
Jul 07 14:07:51.371799 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:51.371765    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8" event={"ID":"72d29703-a616-47de-a9b1-4d8d49f84bda","Type":"ContainerStarted","Data":"04e013d68cfe491a375fd54decb96724c199557da4b9f0cc8f244ca3df7c54a4"}
Jul 07 14:07:51.389787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:51.389703    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86" podStartSLOduration=2.223432802 podStartE2EDuration="6.389690578s" totalImagesPullingTime="4.166257776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:51.388305371 +0000 UTC m=+60.750628539" watchObservedRunningTime="2026-07-07 14:07:51.389690578 +0000 UTC m=+60.752013779"
Jul 07 14:07:51.402093 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:51.402055    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8" podStartSLOduration=2.214808255 podStartE2EDuration="6.402042924s" totalImagesPullingTime="4.187234669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:51.40193842 +0000 UTC m=+60.764261587" watchObservedRunningTime="2026-07-07 14:07:51.402042924 +0000 UTC m=+60.764366091"
Jul 07 14:07:53.293463 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:53.293436    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sjcnj"
Jul 07 14:07:56.833678 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:56.833634    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:56.836724 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:56.836689    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 14:07:56.846189 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:56.846158    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c661b77e-fb49-41fc-97ae-243728ee2c39-original-pull-secret\") pod \"global-pull-secret-syncer-wrlhh\" (UID: \"c661b77e-fb49-41fc-97ae-243728ee2c39\") " pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:56.934999 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:56.934968    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:07:56.937563 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:56.937538    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 14:07:56.945506 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:56.945477    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 14:07:56.945611 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:07:56.945569    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs podName:7c4fc6fc-66a0-47c4-ac0f-413df650c65e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:00.945549419 +0000 UTC m=+130.307872581 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs") pod "network-metrics-daemon-85vzp" (UID: "7c4fc6fc-66a0-47c4-ac0f-413df650c65e") : secret "metrics-daemon-secret" not found
Jul 07 14:07:57.036196 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:57.036150    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5clm2\" (UniqueName: \"kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2\") pod \"network-check-target-zhlsz\" (UID: \"4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4\") " pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:57.039462 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:57.039439    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 14:07:57.049164 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:57.049139    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 14:07:57.060361 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:57.060333    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5clm2\" (UniqueName: \"kubernetes.io/projected/4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4-kube-api-access-5clm2\") pod \"network-check-target-zhlsz\" (UID: \"4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4\") " pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:57.126719 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:57.126646    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d5l84\""
Jul 07 14:07:57.134975 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:57.134954    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:07:57.137250 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:57.137208    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrlhh"
Jul 07 14:07:58.090802 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:58.090773    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wrlhh"]
Jul 07 14:07:58.094060 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:07:58.094035    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc661b77e_fb49_41fc_97ae_243728ee2c39.slice/crio-f74135298f6b3917591aeff83cd44da5a15e6b0b72e3105e59f91fc8e7583577 WatchSource:0}: Error finding container f74135298f6b3917591aeff83cd44da5a15e6b0b72e3105e59f91fc8e7583577: Status 404 returned error can't find the container with id f74135298f6b3917591aeff83cd44da5a15e6b0b72e3105e59f91fc8e7583577
Jul 07 14:07:58.107038 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:58.107015    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zhlsz"]
Jul 07 14:07:58.109478 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:07:58.109455    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6cdc0e_3dcc_42c3_b52e_1831d9ca6ea4.slice/crio-b00ae936d91e458639ca4dff9efdbe1fa2769e08af4dc542e053cc92b8a800b4 WatchSource:0}: Error finding container b00ae936d91e458639ca4dff9efdbe1fa2769e08af4dc542e053cc92b8a800b4: Status 404 returned error can't find the container with id b00ae936d91e458639ca4dff9efdbe1fa2769e08af4dc542e053cc92b8a800b4
Jul 07 14:07:58.391883 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:58.391844    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wrlhh" event={"ID":"c661b77e-fb49-41fc-97ae-243728ee2c39","Type":"ContainerStarted","Data":"f74135298f6b3917591aeff83cd44da5a15e6b0b72e3105e59f91fc8e7583577"}
Jul 07 14:07:58.392841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:58.392822    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zhlsz" event={"ID":"4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4","Type":"ContainerStarted","Data":"b00ae936d91e458639ca4dff9efdbe1fa2769e08af4dc542e053cc92b8a800b4"}
Jul 07 14:07:58.394109 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:58.394085    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl" event={"ID":"82baaffc-4548-4d1a-b89a-4d46f64c96df","Type":"ContainerStarted","Data":"07cdee7e4ee96e3bb13f5d0745f351f79175b8c25f80a85902c374268097ddb4"}
Jul 07 14:07:58.394309 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:58.394260    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:07:58.395866 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:58.395847    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:07:58.410919 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:07:58.410880    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl" podStartSLOduration=1.8750445 podStartE2EDuration="13.410867632s" totalImagesPullingTime="11.535823132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:58.41014309 +0000 UTC m=+67.772466270" watchObservedRunningTime="2026-07-07 14:07:58.410867632 +0000 UTC m=+67.773190791"
Jul 07 14:08:00.263537 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:08:00.263498    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:08:00.263984 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:08:00.263653    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:08:00.263984 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:08:00.263670    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9858dc8-29r24: secret "image-registry-tls" not found
Jul 07 14:08:00.263984 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:08:00.263742    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls podName:6b52d79d-6dfc-4201-8d9e-a5bc8e667d94 nodeName:}" failed. No retries permitted until 2026-07-07 14:08:32.263722548 +0000 UTC m=+101.626045695 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls") pod "image-registry-5b9858dc8-29r24" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94") : secret "image-registry-tls" not found
Jul 07 14:08:00.363869 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:08:00.363824    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:08:00.364073 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:08:00.363996    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:08:00.364138 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:08:00.364085    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls podName:fab96c66-1f3e-4e40-8933-ca91fa651627 nodeName:}" failed. No retries permitted until 2026-07-07 14:08:32.364064893 +0000 UTC m=+101.726388053 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls") pod "dns-default-fqnhj" (UID: "fab96c66-1f3e-4e40-8933-ca91fa651627") : secret "dns-default-metrics-tls" not found
Jul 07 14:08:04.418270 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:08:04.418220    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wrlhh" event={"ID":"c661b77e-fb49-41fc-97ae-243728ee2c39","Type":"ContainerStarted","Data":"5a96ba28c5dd9ee027e83c7af91b00cbc9ad758186385133f05ee4760b174582"}
Jul 07 14:08:04.419827 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:08:04.419791    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zhlsz" event={"ID":"4d6cdc0e-3dcc-42c3-b52e-1831d9ca6ea4","Type":"ContainerStarted","Data":"27a28903ef3fa4db06b6ae63376102286abedb721054966ec3e8188e13360d6b"}
Jul 07 14:08:04.419953 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:08:04.419934    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:08:04.440702 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:08:04.440661    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wrlhh" podStartSLOduration=66.671942117 podStartE2EDuration="1m12.440649556s" totalImagesPullingTime="5.768707439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:08:04.439931125 +0000 UTC m=+73.802254293" watchObservedRunningTime="2026-07-07 14:08:04.440649556 +0000 UTC m=+73.802972722"
Jul 07 14:08:04.455511 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:08:04.455471    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zhlsz" podStartSLOduration=66.702430582 podStartE2EDuration="1m12.455459829s" totalImagesPullingTime="5.753029247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:08:04.455116456 +0000 UTC m=+73.817439623" watchObservedRunningTime="2026-07-07 14:08:04.455459829 +0000 UTC m=+73.817782997"
Jul 07 14:08:32.278337 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:08:32.278290    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:08:32.278768 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:08:32.278425    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:08:32.278768 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:08:32.278444    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9858dc8-29r24: secret "image-registry-tls" not found
Jul 07 14:08:32.278768 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:08:32.278501    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls podName:6b52d79d-6dfc-4201-8d9e-a5bc8e667d94 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:36.278487512 +0000 UTC m=+165.640810656 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls") pod "image-registry-5b9858dc8-29r24" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94") : secret "image-registry-tls" not found
Jul 07 14:08:32.379366 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:08:32.379329    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:08:32.379537 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:08:32.379444    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:08:32.379537 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:08:32.379496    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls podName:fab96c66-1f3e-4e40-8933-ca91fa651627 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:36.379481894 +0000 UTC m=+165.741805040 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls") pod "dns-default-fqnhj" (UID: "fab96c66-1f3e-4e40-8933-ca91fa651627") : secret "dns-default-metrics-tls" not found
Jul 07 14:08:35.424649 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:08:35.424621    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zhlsz"
Jul 07 14:09:00.978918 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:00.978881    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:09:00.979300 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:09:00.978989    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 14:09:00.979300 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:09:00.979055    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs podName:7c4fc6fc-66a0-47c4-ac0f-413df650c65e nodeName:}" failed. No retries permitted until 2026-07-07 14:11:02.979037087 +0000 UTC m=+252.341360249 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs") pod "network-metrics-daemon-85vzp" (UID: "7c4fc6fc-66a0-47c4-ac0f-413df650c65e") : secret "metrics-daemon-secret" not found
Jul 07 14:09:31.467759 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:09:31.467656    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b9858dc8-29r24" podUID="6b52d79d-6dfc-4201-8d9e-a5bc8e667d94"
Jul 07 14:09:31.483978 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:09:31.483942    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fqnhj" podUID="fab96c66-1f3e-4e40-8933-ca91fa651627"
Jul 07 14:09:31.659739 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:31.659708    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:09:31.659940 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:31.659708    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:09:33.131794 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:09:33.131748    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-85vzp" podUID="7c4fc6fc-66a0-47c4-ac0f-413df650c65e"
Jul 07 14:09:36.332295 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:36.332261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:09:36.332680 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:09:36.332398    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:09:36.332680 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:09:36.332414    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b9858dc8-29r24: secret "image-registry-tls" not found
Jul 07 14:09:36.332680 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:09:36.332473    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls podName:6b52d79d-6dfc-4201-8d9e-a5bc8e667d94 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:38.332458053 +0000 UTC m=+287.694781198 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls") pod "image-registry-5b9858dc8-29r24" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94") : secret "image-registry-tls" not found
Jul 07 14:09:36.432668 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:36.432635    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:09:36.432841 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:09:36.432792    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:09:36.432882 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:09:36.432859    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls podName:fab96c66-1f3e-4e40-8933-ca91fa651627 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:38.43284435 +0000 UTC m=+287.795167495 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls") pod "dns-default-fqnhj" (UID: "fab96c66-1f3e-4e40-8933-ca91fa651627") : secret "dns-default-metrics-tls" not found
Jul 07 14:09:47.111444 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:47.111349    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:09:51.717408 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:51.717370    2557 generic.go:356] "Generic (PLEG): container finished" podID="72d29703-a616-47de-a9b1-4d8d49f84bda" containerID="04e013d68cfe491a375fd54decb96724c199557da4b9f0cc8f244ca3df7c54a4" exitCode=255
Jul 07 14:09:51.717786 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:51.717427    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8" event={"ID":"72d29703-a616-47de-a9b1-4d8d49f84bda","Type":"ContainerDied","Data":"04e013d68cfe491a375fd54decb96724c199557da4b9f0cc8f244ca3df7c54a4"}
Jul 07 14:09:51.717786 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:51.717695    2557 scope.go:117] "RemoveContainer" containerID="04e013d68cfe491a375fd54decb96724c199557da4b9f0cc8f244ca3df7c54a4"
Jul 07 14:09:52.722253 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:52.722203    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8" event={"ID":"72d29703-a616-47de-a9b1-4d8d49f84bda","Type":"ContainerStarted","Data":"7b93b236c948e59bffadf065e9645f250e77677bcc1d18492767cd179e672f99"}
Jul 07 14:09:58.395270 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:58.395164    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl" podUID="82baaffc-4548-4d1a-b89a-4d46f64c96df" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused"
Jul 07 14:09:58.741658 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:58.741566    2557 generic.go:356] "Generic (PLEG): container finished" podID="82baaffc-4548-4d1a-b89a-4d46f64c96df" containerID="07cdee7e4ee96e3bb13f5d0745f351f79175b8c25f80a85902c374268097ddb4" exitCode=1
Jul 07 14:09:58.741658 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:58.741617    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl" event={"ID":"82baaffc-4548-4d1a-b89a-4d46f64c96df","Type":"ContainerDied","Data":"07cdee7e4ee96e3bb13f5d0745f351f79175b8c25f80a85902c374268097ddb4"}
Jul 07 14:09:58.741983 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:58.741965    2557 scope.go:117] "RemoveContainer" containerID="07cdee7e4ee96e3bb13f5d0745f351f79175b8c25f80a85902c374268097ddb4"
Jul 07 14:09:59.745755 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:59.745717    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl" event={"ID":"82baaffc-4548-4d1a-b89a-4d46f64c96df","Type":"ContainerStarted","Data":"2fe5fb91f6f1fdb07ac1b4c5b6d447b45e5894737a9a0382aa1c226caa90c46c"}
Jul 07 14:09:59.746200 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:59.746000    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:09:59.746635 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:09:59.746619    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:10:28.366753 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.366719    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fbrjm"]
Jul 07 14:10:28.370594 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.370575    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.373047 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.373020    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 14:10:28.373167 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.373119    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vkw4d\""
Jul 07 14:10:28.375365 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.375343    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 14:10:28.375841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.375819    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 14:10:28.375934 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.375909    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 14:10:28.382400 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.382382    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbrjm"]
Jul 07 14:10:28.393810 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.393786    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.393909 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.393826    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2730dc18-8aec-409b-8cb4-5db3428eba75-crio-socket\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.393909 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.393859    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqs2d\" (UniqueName: \"kubernetes.io/projected/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-api-access-zqs2d\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.393909 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.393894    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2730dc18-8aec-409b-8cb4-5db3428eba75-data-volume\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.394008 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.393953    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.494746 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.494707    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.494931 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.494765    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.494931 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.494805    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2730dc18-8aec-409b-8cb4-5db3428eba75-crio-socket\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.494931 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:28.494830    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:10:28.494931 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:28.494912    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm podName:2730dc18-8aec-409b-8cb4-5db3428eba75 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:28.994892302 +0000 UTC m=+218.357215464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbrjm" (UID: "2730dc18-8aec-409b-8cb4-5db3428eba75") : configmap "kube-rbac-proxy" not found
Jul 07 14:10:28.494931 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.494911    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2730dc18-8aec-409b-8cb4-5db3428eba75-crio-socket\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.494931 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.494833    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqs2d\" (UniqueName: \"kubernetes.io/projected/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-api-access-zqs2d\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.495262 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:28.494958    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:28.495262 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.494998    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2730dc18-8aec-409b-8cb4-5db3428eba75-data-volume\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.495262 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:28.495031    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls podName:2730dc18-8aec-409b-8cb4-5db3428eba75 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:28.99500965 +0000 UTC m=+218.357332809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbrjm" (UID: "2730dc18-8aec-409b-8cb4-5db3428eba75") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:28.495372 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.495281    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2730dc18-8aec-409b-8cb4-5db3428eba75-data-volume\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.506574 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.506551    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqs2d\" (UniqueName: \"kubernetes.io/projected/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-api-access-zqs2d\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.999006 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.998967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.999201 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:28.999070    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:28.999201 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:28.999116    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:28.999201 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:28.999164    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:10:28.999201 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:28.999182    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls podName:2730dc18-8aec-409b-8cb4-5db3428eba75 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:29.999166338 +0000 UTC m=+219.361489484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbrjm" (UID: "2730dc18-8aec-409b-8cb4-5db3428eba75") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:28.999409 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:28.999225    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm podName:2730dc18-8aec-409b-8cb4-5db3428eba75 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:29.999209238 +0000 UTC m=+219.361532397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbrjm" (UID: "2730dc18-8aec-409b-8cb4-5db3428eba75") : configmap "kube-rbac-proxy" not found
Jul 07 14:10:30.006354 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:30.006315    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:30.006793 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:30.006386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:30.006793 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:30.006447    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:10:30.006793 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:30.006473    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:30.006793 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:30.006510    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm podName:2730dc18-8aec-409b-8cb4-5db3428eba75 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:32.006496601 +0000 UTC m=+221.368819749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbrjm" (UID: "2730dc18-8aec-409b-8cb4-5db3428eba75") : configmap "kube-rbac-proxy" not found
Jul 07 14:10:30.006793 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:30.006525    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls podName:2730dc18-8aec-409b-8cb4-5db3428eba75 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:32.006518803 +0000 UTC m=+221.368841948 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbrjm" (UID: "2730dc18-8aec-409b-8cb4-5db3428eba75") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:30.557359 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:30.557332    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dnfwh_0565009f-db88-49d2-84e8-de0653188d27/dns-node-resolver/0.log"
Jul 07 14:10:31.357107 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:31.357079    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lj45b_d25dc2c0-12a6-4c21-b56e-6a681deaba83/node-ca/0.log"
Jul 07 14:10:32.021964 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:32.021927    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:32.022137 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:32.022002    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:32.022137 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:32.022063    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:10:32.022137 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:32.022075    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:32.022137 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:32.022123    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm podName:2730dc18-8aec-409b-8cb4-5db3428eba75 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:36.022109522 +0000 UTC m=+225.384432666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbrjm" (UID: "2730dc18-8aec-409b-8cb4-5db3428eba75") : configmap "kube-rbac-proxy" not found
Jul 07 14:10:32.022137 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:32.022135    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls podName:2730dc18-8aec-409b-8cb4-5db3428eba75 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:36.022129493 +0000 UTC m=+225.384452638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbrjm" (UID: "2730dc18-8aec-409b-8cb4-5db3428eba75") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:32.357492 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:32.357472    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pmztk_7375d1d7-35a7-436f-ae17-b9b7c13761a1/serve-healthcheck-canary/0.log"
Jul 07 14:10:36.048248 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:36.048205    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:36.048632 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:36.048265    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:36.048632 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:36.048324    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:10:36.048632 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:36.048376    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:36.048632 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:36.048388    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm podName:2730dc18-8aec-409b-8cb4-5db3428eba75 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:44.048374075 +0000 UTC m=+233.410697223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbrjm" (UID: "2730dc18-8aec-409b-8cb4-5db3428eba75") : configmap "kube-rbac-proxy" not found
Jul 07 14:10:36.048632 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:36.048414    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls podName:2730dc18-8aec-409b-8cb4-5db3428eba75 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:44.048403381 +0000 UTC m=+233.410726527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbrjm" (UID: "2730dc18-8aec-409b-8cb4-5db3428eba75") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:44.112387 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:44.112345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:44.112771 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:44.112402    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:10:44.112771 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:44.112505    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:44.112771 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:10:44.112573    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls podName:2730dc18-8aec-409b-8cb4-5db3428eba75 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:00.112558235 +0000 UTC m=+249.474881387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbrjm" (UID: "2730dc18-8aec-409b-8cb4-5db3428eba75") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:10:44.112891 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:10:44.112828    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2730dc18-8aec-409b-8cb4-5db3428eba75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:11:00.136686 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:00.136632    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:11:00.138943 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:00.138921    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2730dc18-8aec-409b-8cb4-5db3428eba75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbrjm\" (UID: \"2730dc18-8aec-409b-8cb4-5db3428eba75\") " pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:11:00.181826 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:00.181801    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vkw4d\""
Jul 07 14:11:00.189453 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:00.189437    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbrjm"
Jul 07 14:11:00.309216 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:00.309185    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbrjm"]
Jul 07 14:11:00.312354 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:11:00.312331    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2730dc18_8aec_409b_8cb4_5db3428eba75.slice/crio-ad3b9a9a401eaca26edd35af0fab06e74fa8f66edadf8e79a2112802d7e12fd7 WatchSource:0}: Error finding container ad3b9a9a401eaca26edd35af0fab06e74fa8f66edadf8e79a2112802d7e12fd7: Status 404 returned error can't find the container with id ad3b9a9a401eaca26edd35af0fab06e74fa8f66edadf8e79a2112802d7e12fd7
Jul 07 14:11:00.921185 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:00.921105    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbrjm" event={"ID":"2730dc18-8aec-409b-8cb4-5db3428eba75","Type":"ContainerStarted","Data":"ad3b9a9a401eaca26edd35af0fab06e74fa8f66edadf8e79a2112802d7e12fd7"}
Jul 07 14:11:03.060418 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:03.060376    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:11:03.062884 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:03.062847    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c4fc6fc-66a0-47c4-ac0f-413df650c65e-metrics-certs\") pod \"network-metrics-daemon-85vzp\" (UID: \"7c4fc6fc-66a0-47c4-ac0f-413df650c65e\") " pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:11:03.314970 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:03.314902    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wgdzp\""
Jul 07 14:11:03.322404 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:03.322377    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-85vzp"
Jul 07 14:11:04.175829 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:04.175806    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-85vzp"]
Jul 07 14:11:04.178772 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:11:04.178748    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c4fc6fc_66a0_47c4_ac0f_413df650c65e.slice/crio-b1f7f85b266b1a3c86f463a81c758e616dfe4248f2813bcea2332f797868d134 WatchSource:0}: Error finding container b1f7f85b266b1a3c86f463a81c758e616dfe4248f2813bcea2332f797868d134: Status 404 returned error can't find the container with id b1f7f85b266b1a3c86f463a81c758e616dfe4248f2813bcea2332f797868d134
Jul 07 14:11:04.934659 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:04.934628    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-85vzp" event={"ID":"7c4fc6fc-66a0-47c4-ac0f-413df650c65e","Type":"ContainerStarted","Data":"b1f7f85b266b1a3c86f463a81c758e616dfe4248f2813bcea2332f797868d134"}
Jul 07 14:11:04.935972 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:04.935949    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbrjm" event={"ID":"2730dc18-8aec-409b-8cb4-5db3428eba75","Type":"ContainerStarted","Data":"2c8fd3abf15d5f39a78bf1259b8b8be2f0a5bcede8908644a5531e5a34fa8fda"}
Jul 07 14:11:05.941757 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:05.941671    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbrjm" event={"ID":"2730dc18-8aec-409b-8cb4-5db3428eba75","Type":"ContainerStarted","Data":"1a8541687cf18ca62637b8a4ac1b45c519d6a9c383ede605e8a0f062fcd79280"}
Jul 07 14:11:05.943568 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:05.943533    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-85vzp" event={"ID":"7c4fc6fc-66a0-47c4-ac0f-413df650c65e","Type":"ContainerStarted","Data":"0905aa57748b461ca73f153d52580e84e151106e83a938783c48e390a8dc8d7b"}
Jul 07 14:11:05.943722 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:05.943587    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-85vzp" event={"ID":"7c4fc6fc-66a0-47c4-ac0f-413df650c65e","Type":"ContainerStarted","Data":"dc3ff86a966e135588003a89d28067e3b901a09b783dc71737e2655e5028c544"}
Jul 07 14:11:05.960010 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:05.959958    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-85vzp" podStartSLOduration=252.572556403 podStartE2EDuration="4m13.959938881s" totalImagesPullingTime="1.387382478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:06:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:05.95879519 +0000 UTC m=+255.321118358" watchObservedRunningTime="2026-07-07 14:11:05.959938881 +0000 UTC m=+255.322262048"
Jul 07 14:11:07.058417 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.058381    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gzhhq"]
Jul 07 14:11:07.061911 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.061888    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.064848 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.064823    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 14:11:07.064995 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.064862    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 14:11:07.064995 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.064862    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5v7xh\""
Jul 07 14:11:07.065692 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.065673    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 14:11:07.065806 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.065682    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 14:11:07.065806 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.065713    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 14:11:07.065806 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.065740    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 14:11:07.197718 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.197681    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-textfile\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.197718 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.197719    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19c7dd19-c21e-4d43-9f24-029e41e0766b-sys\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.197921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.197739    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-accelerators-collector-config\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.197921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.197769    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.197921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.197793    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-tls\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.197921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.197809    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrljm\" (UniqueName: \"kubernetes.io/projected/19c7dd19-c21e-4d43-9f24-029e41e0766b-kube-api-access-lrljm\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.197921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.197843    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-wtmp\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.197921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.197882    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19c7dd19-c21e-4d43-9f24-029e41e0766b-metrics-client-ca\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.198149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.197992    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19c7dd19-c21e-4d43-9f24-029e41e0766b-root\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.298404 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298363    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-wtmp\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.298404 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298409    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19c7dd19-c21e-4d43-9f24-029e41e0766b-metrics-client-ca\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.298635 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298561    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19c7dd19-c21e-4d43-9f24-029e41e0766b-root\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.298635 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298606    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/19c7dd19-c21e-4d43-9f24-029e41e0766b-root\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.298635 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298632    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-textfile\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.298783 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19c7dd19-c21e-4d43-9f24-029e41e0766b-sys\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.298783 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298565    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-wtmp\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.298783 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-accelerators-collector-config\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.298783 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298735    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19c7dd19-c21e-4d43-9f24-029e41e0766b-sys\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.298980 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298818    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.298980 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298852    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-tls\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.298980 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298875    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrljm\" (UniqueName: \"kubernetes.io/projected/19c7dd19-c21e-4d43-9f24-029e41e0766b-kube-api-access-lrljm\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.298980 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298885    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-textfile\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.299175 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:11:07.298981    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 14:11:07.299175 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.298988    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19c7dd19-c21e-4d43-9f24-029e41e0766b-metrics-client-ca\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.299175 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:11:07.299049    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-tls podName:19c7dd19-c21e-4d43-9f24-029e41e0766b nodeName:}" failed. No retries permitted until 2026-07-07 14:11:07.799030483 +0000 UTC m=+257.161353631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-tls") pod "node-exporter-gzhhq" (UID: "19c7dd19-c21e-4d43-9f24-029e41e0766b") : secret "node-exporter-tls" not found
Jul 07 14:11:07.299354 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.299172    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-accelerators-collector-config\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.301404 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.301381    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.310270 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.310250    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrljm\" (UniqueName: \"kubernetes.io/projected/19c7dd19-c21e-4d43-9f24-029e41e0766b-kube-api-access-lrljm\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.803458 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.803382    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-tls\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.805521 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.805493    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/19c7dd19-c21e-4d43-9f24-029e41e0766b-node-exporter-tls\") pod \"node-exporter-gzhhq\" (UID: \"19c7dd19-c21e-4d43-9f24-029e41e0766b\") " pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.951617 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.951581    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbrjm" event={"ID":"2730dc18-8aec-409b-8cb4-5db3428eba75","Type":"ContainerStarted","Data":"705368e3ea67315d098fcb588e894cdab1275af3d6f1fb4988fc4f1b84388251"}
Jul 07 14:11:07.972973 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.972919    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gzhhq"
Jul 07 14:11:07.973077 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:07.973034    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fbrjm" podStartSLOduration=32.538968579 podStartE2EDuration="39.973018486s" totalImagesPullingTime="7.434049907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:10:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:07.97181676 +0000 UTC m=+257.334139927" watchObservedRunningTime="2026-07-07 14:11:07.973018486 +0000 UTC m=+257.335341659"
Jul 07 14:11:07.981763 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:11:07.981737    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c7dd19_c21e_4d43_9f24_029e41e0766b.slice/crio-e96051309e66dcb7914ccdf418df9c3ca9bcc12c9d6f1300dc9ed5a762a0c790 WatchSource:0}: Error finding container e96051309e66dcb7914ccdf418df9c3ca9bcc12c9d6f1300dc9ed5a762a0c790: Status 404 returned error can't find the container with id e96051309e66dcb7914ccdf418df9c3ca9bcc12c9d6f1300dc9ed5a762a0c790
Jul 07 14:11:08.960309 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:08.960282    2557 generic.go:356] "Generic (PLEG): container finished" podID="19c7dd19-c21e-4d43-9f24-029e41e0766b" containerID="5c01a32db0c57a454dec5c969a9ba8d65f97ed35ea385d9b6642da6bd90a4b32" exitCode=0
Jul 07 14:11:08.960578 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:08.960351    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzhhq" event={"ID":"19c7dd19-c21e-4d43-9f24-029e41e0766b","Type":"ContainerDied","Data":"5c01a32db0c57a454dec5c969a9ba8d65f97ed35ea385d9b6642da6bd90a4b32"}
Jul 07 14:11:08.960578 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:08.960424    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzhhq" event={"ID":"19c7dd19-c21e-4d43-9f24-029e41e0766b","Type":"ContainerStarted","Data":"e96051309e66dcb7914ccdf418df9c3ca9bcc12c9d6f1300dc9ed5a762a0c790"}
Jul 07 14:11:09.965537 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:09.965502    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzhhq" event={"ID":"19c7dd19-c21e-4d43-9f24-029e41e0766b","Type":"ContainerStarted","Data":"1ec9fdc538ac669e28ed7848494f49f0f1697f1b3536d6d578a81bb4271d561e"}
Jul 07 14:11:09.965910 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:09.965557    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzhhq" event={"ID":"19c7dd19-c21e-4d43-9f24-029e41e0766b","Type":"ContainerStarted","Data":"3e8453ded84801fca4ed5b4dd3ce9b870e81e1dee114c95abbeb16db1b6073a8"}
Jul 07 14:11:09.988170 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:09.988122    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gzhhq" podStartSLOduration=2.089190473 podStartE2EDuration="2.988105695s" totalImagesPullingTime="835.417457ms" totalInitContainerRuntime="63.497765ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:11:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:09.98669751 +0000 UTC m=+259.349020678" watchObservedRunningTime="2026-07-07 14:11:09.988105695 +0000 UTC m=+259.350428876"
Jul 07 14:11:34.660298 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:11:34.660257    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b9858dc8-29r24" podUID="6b52d79d-6dfc-4201-8d9e-a5bc8e667d94"
Jul 07 14:11:34.660298 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:11:34.660259    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fqnhj" podUID="fab96c66-1f3e-4e40-8933-ca91fa651627"
Jul 07 14:11:35.044547 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:35.044466    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:11:35.044693 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:35.044466    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:11:36.324346 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:36.324309    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86" podUID="d3b6eae4-53c8-4421-acf0-bf3df9a93cd7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 14:11:38.424396 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:38.424356    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:11:38.426777 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:38.426757    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") pod \"image-registry-5b9858dc8-29r24\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") " pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:11:38.525399 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:38.525359    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:11:38.527694 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:38.527670    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fab96c66-1f3e-4e40-8933-ca91fa651627-metrics-tls\") pod \"dns-default-fqnhj\" (UID: \"fab96c66-1f3e-4e40-8933-ca91fa651627\") " pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:11:38.648414 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:38.648387    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cxvss\""
Jul 07 14:11:38.648414 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:38.648387    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xtlr6\""
Jul 07 14:11:38.655169 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:38.655145    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:11:38.655169 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:38.655161    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:11:38.954402 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:38.954371    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fqnhj"]
Jul 07 14:11:38.957335 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:11:38.957304    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab96c66_1f3e_4e40_8933_ca91fa651627.slice/crio-5cfb7258c39ab2a81f20d69536cd2e599b71d7f052074035a0bb9d96354a4e7a WatchSource:0}: Error finding container 5cfb7258c39ab2a81f20d69536cd2e599b71d7f052074035a0bb9d96354a4e7a: Status 404 returned error can't find the container with id 5cfb7258c39ab2a81f20d69536cd2e599b71d7f052074035a0bb9d96354a4e7a
Jul 07 14:11:38.974074 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:38.974050    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9858dc8-29r24"]
Jul 07 14:11:38.977766 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:11:38.977743    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b52d79d_6dfc_4201_8d9e_a5bc8e667d94.slice/crio-3d4db4b19f43503e23618c04e4ba75ba12e08be427903a19b7c64402b9c656fc WatchSource:0}: Error finding container 3d4db4b19f43503e23618c04e4ba75ba12e08be427903a19b7c64402b9c656fc: Status 404 returned error can't find the container with id 3d4db4b19f43503e23618c04e4ba75ba12e08be427903a19b7c64402b9c656fc
Jul 07 14:11:39.057880 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:39.057849    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fqnhj" event={"ID":"fab96c66-1f3e-4e40-8933-ca91fa651627","Type":"ContainerStarted","Data":"5cfb7258c39ab2a81f20d69536cd2e599b71d7f052074035a0bb9d96354a4e7a"}
Jul 07 14:11:39.059451 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:39.059428    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9858dc8-29r24" event={"ID":"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94","Type":"ContainerStarted","Data":"3d4db4b19f43503e23618c04e4ba75ba12e08be427903a19b7c64402b9c656fc"}
Jul 07 14:11:40.064664 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:40.064630    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9858dc8-29r24" event={"ID":"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94","Type":"ContainerStarted","Data":"a239a3159bc855bf0555eb7d3d97a06271e7c98c1c5e0134e627d103116a3ef5"}
Jul 07 14:11:40.065020 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:40.064728    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:11:40.086824 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:40.086783    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b9858dc8-29r24" podStartSLOduration=288.086763198 podStartE2EDuration="4m48.086763198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:06:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:40.086418767 +0000 UTC m=+289.448741933" watchObservedRunningTime="2026-07-07 14:11:40.086763198 +0000 UTC m=+289.449086364"
Jul 07 14:11:41.070140 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:41.070102    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fqnhj" event={"ID":"fab96c66-1f3e-4e40-8933-ca91fa651627","Type":"ContainerStarted","Data":"e6378688477de7d54998e49fad78c4aeccd896816bad083d1601ca37250602fd"}
Jul 07 14:11:41.070593 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:41.070161    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fqnhj" event={"ID":"fab96c66-1f3e-4e40-8933-ca91fa651627","Type":"ContainerStarted","Data":"3b82ffc0167f6833de396daaee3e41248e684b96a1bb8f49b0fcecac81b004c7"}
Jul 07 14:11:41.088460 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:41.088414    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fqnhj" podStartSLOduration=251.16560829 podStartE2EDuration="4m13.08839832s" totalImagesPullingTime="1.92279003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:41.086941855 +0000 UTC m=+290.449265070" watchObservedRunningTime="2026-07-07 14:11:41.08839832 +0000 UTC m=+290.450721486"
Jul 07 14:11:42.073134 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:42.073100    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:11:46.324568 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:46.324536    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86" podUID="d3b6eae4-53c8-4421-acf0-bf3df9a93cd7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 14:11:51.017812 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:51.017772    2557 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 14:11:52.077992 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:52.077958    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fqnhj"
Jul 07 14:11:52.112366 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:52.112300    2557 generic.go:356] "Generic (PLEG): container finished" podID="72d29703-a616-47de-a9b1-4d8d49f84bda" containerID="7b93b236c948e59bffadf065e9645f250e77677bcc1d18492767cd179e672f99" exitCode=255
Jul 07 14:11:52.112501 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:52.112367    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8" event={"ID":"72d29703-a616-47de-a9b1-4d8d49f84bda","Type":"ContainerDied","Data":"7b93b236c948e59bffadf065e9645f250e77677bcc1d18492767cd179e672f99"}
Jul 07 14:11:52.112501 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:52.112418    2557 scope.go:117] "RemoveContainer" containerID="04e013d68cfe491a375fd54decb96724c199557da4b9f0cc8f244ca3df7c54a4"
Jul 07 14:11:52.112703 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:52.112679    2557 scope.go:117] "RemoveContainer" containerID="7b93b236c948e59bffadf065e9645f250e77677bcc1d18492767cd179e672f99"
Jul 07 14:11:52.112879 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:11:52.112861    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-69dbd6775d-7gbn8_open-cluster-management-agent-addon(72d29703-a616-47de-a9b1-4d8d49f84bda)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8" podUID="72d29703-a616-47de-a9b1-4d8d49f84bda"
Jul 07 14:11:55.316361 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:55.316337    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzhhq_19c7dd19-c21e-4d43-9f24-029e41e0766b/init-textfile/0.log"
Jul 07 14:11:55.517316 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:55.517285    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzhhq_19c7dd19-c21e-4d43-9f24-029e41e0766b/node-exporter/0.log"
Jul 07 14:11:55.716428 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:55.716352    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzhhq_19c7dd19-c21e-4d43-9f24-029e41e0766b/kube-rbac-proxy/0.log"
Jul 07 14:11:56.313414 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:56.313383    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8"
Jul 07 14:11:56.313660 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:56.313648    2557 scope.go:117] "RemoveContainer" containerID="7b93b236c948e59bffadf065e9645f250e77677bcc1d18492767cd179e672f99"
Jul 07 14:11:56.313803 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:11:56.313785    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-69dbd6775d-7gbn8_open-cluster-management-agent-addon(72d29703-a616-47de-a9b1-4d8d49f84bda)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8" podUID="72d29703-a616-47de-a9b1-4d8d49f84bda"
Jul 07 14:11:56.324105 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:56.324078    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86" podUID="d3b6eae4-53c8-4421-acf0-bf3df9a93cd7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 07 14:11:56.324433 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:56.324139    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86"
Jul 07 14:11:56.324563 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:56.324535    2557 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c2572fc0449103b8b63524f3625f5236b7d8a780bb3b11f36e9c7e70674e1148"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 07 14:11:56.324599 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:56.324581    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86" podUID="d3b6eae4-53c8-4421-acf0-bf3df9a93cd7" containerName="service-proxy" containerID="cri-o://c2572fc0449103b8b63524f3625f5236b7d8a780bb3b11f36e9c7e70674e1148" gracePeriod=30
Jul 07 14:11:57.131795 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:57.131764    2557 generic.go:356] "Generic (PLEG): container finished" podID="d3b6eae4-53c8-4421-acf0-bf3df9a93cd7" containerID="c2572fc0449103b8b63524f3625f5236b7d8a780bb3b11f36e9c7e70674e1148" exitCode=2
Jul 07 14:11:57.131978 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:57.131823    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86" event={"ID":"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7","Type":"ContainerDied","Data":"c2572fc0449103b8b63524f3625f5236b7d8a780bb3b11f36e9c7e70674e1148"}
Jul 07 14:11:57.131978 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:57.131875    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b94595b95-dds86" event={"ID":"d3b6eae4-53c8-4421-acf0-bf3df9a93cd7","Type":"ContainerStarted","Data":"1a050527ebbe994b82f2476ff887117b987e3b259955d2bc5fe1a6368b45ad64"}
Jul 07 14:11:58.659858 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:58.659808    2557 patch_prober.go:28] interesting pod/image-registry-5b9858dc8-29r24 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 14:11:58.660306 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:58.659875    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b9858dc8-29r24" podUID="6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 14:11:59.138955 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:59.138923    2557 generic.go:356] "Generic (PLEG): container finished" podID="82baaffc-4548-4d1a-b89a-4d46f64c96df" containerID="2fe5fb91f6f1fdb07ac1b4c5b6d447b45e5894737a9a0382aa1c226caa90c46c" exitCode=1
Jul 07 14:11:59.139096 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:59.138977    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl" event={"ID":"82baaffc-4548-4d1a-b89a-4d46f64c96df","Type":"ContainerDied","Data":"2fe5fb91f6f1fdb07ac1b4c5b6d447b45e5894737a9a0382aa1c226caa90c46c"}
Jul 07 14:11:59.139096 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:59.139022    2557 scope.go:117] "RemoveContainer" containerID="07cdee7e4ee96e3bb13f5d0745f351f79175b8c25f80a85902c374268097ddb4"
Jul 07 14:11:59.139325 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:59.139304    2557 scope.go:117] "RemoveContainer" containerID="2fe5fb91f6f1fdb07ac1b4c5b6d447b45e5894737a9a0382aa1c226caa90c46c"
Jul 07 14:11:59.139496 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:11:59.139475    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7d76dd6858-jzddl_open-cluster-management-agent-addon(82baaffc-4548-4d1a-b89a-4d46f64c96df)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl" podUID="82baaffc-4548-4d1a-b89a-4d46f64c96df"
Jul 07 14:11:59.746179 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:11:59.746148    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:12:00.144656 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:00.144623    2557 scope.go:117] "RemoveContainer" containerID="2fe5fb91f6f1fdb07ac1b4c5b6d447b45e5894737a9a0382aa1c226caa90c46c"
Jul 07 14:12:00.144835 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:12:00.144796    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7d76dd6858-jzddl_open-cluster-management-agent-addon(82baaffc-4548-4d1a-b89a-4d46f64c96df)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl" podUID="82baaffc-4548-4d1a-b89a-4d46f64c96df"
Jul 07 14:12:01.075225 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:01.075188    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:12:02.517057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:02.517024    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fqnhj_fab96c66-1f3e-4e40-8933-ca91fa651627/dns/0.log"
Jul 07 14:12:02.716081 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:02.716048    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fqnhj_fab96c66-1f3e-4e40-8933-ca91fa651627/kube-rbac-proxy/0.log"
Jul 07 14:12:03.715800 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:03.715772    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dnfwh_0565009f-db88-49d2-84e8-de0653188d27/dns-node-resolver/0.log"
Jul 07 14:12:03.918598 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:03.918572    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b9858dc8-29r24_6b52d79d-6dfc-4201-8d9e-a5bc8e667d94/registry/0.log"
Jul 07 14:12:04.517320 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:04.517291    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lj45b_d25dc2c0-12a6-4c21-b56e-6a681deaba83/node-ca/0.log"
Jul 07 14:12:05.517295 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:05.517262    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pmztk_7375d1d7-35a7-436f-ae17-b9b7c13761a1/serve-healthcheck-canary/0.log"
Jul 07 14:12:06.319146 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:06.319102    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:12:06.319543 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:06.319530    2557 scope.go:117] "RemoveContainer" containerID="2fe5fb91f6f1fdb07ac1b4c5b6d447b45e5894737a9a0382aa1c226caa90c46c"
Jul 07 14:12:06.319710 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:12:06.319689    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7d76dd6858-jzddl_open-cluster-management-agent-addon(82baaffc-4548-4d1a-b89a-4d46f64c96df)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl" podUID="82baaffc-4548-4d1a-b89a-4d46f64c96df"
Jul 07 14:12:09.112224 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:09.112194    2557 scope.go:117] "RemoveContainer" containerID="7b93b236c948e59bffadf065e9645f250e77677bcc1d18492767cd179e672f99"
Jul 07 14:12:09.178361 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:09.178333    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69dbd6775d-7gbn8" event={"ID":"72d29703-a616-47de-a9b1-4d8d49f84bda","Type":"ContainerStarted","Data":"ae2188e4a9915b28e34536ea4006bb9435323d7a15bab9d9e8fbca09e9693fa2"}
Jul 07 14:12:18.189902 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:18.189864    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b9858dc8-29r24"]
Jul 07 14:12:22.111959 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:22.111926    2557 scope.go:117] "RemoveContainer" containerID="2fe5fb91f6f1fdb07ac1b4c5b6d447b45e5894737a9a0382aa1c226caa90c46c"
Jul 07 14:12:22.223637 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:22.223603    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl" event={"ID":"82baaffc-4548-4d1a-b89a-4d46f64c96df","Type":"ContainerStarted","Data":"cf67a8673029bb5ad43e02c0ac8261d985240b5835439719d4352c1caaaab790"}
Jul 07 14:12:22.223901 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:22.223873    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:12:22.225293 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:22.225274    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d76dd6858-jzddl"
Jul 07 14:12:43.210146 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.210067    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b9858dc8-29r24" podUID="6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" containerName="registry" containerID="cri-o://a239a3159bc855bf0555eb7d3d97a06271e7c98c1c5e0134e627d103116a3ef5" gracePeriod=30
Jul 07 14:12:43.445277 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.445256    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:12:43.585336 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.585307    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-ca-trust-extracted\") pod \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") "
Jul 07 14:12:43.585504 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.585354    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-certificates\") pod \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") "
Jul 07 14:12:43.585504 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.585393    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-image-registry-private-configuration\") pod \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") "
Jul 07 14:12:43.585504 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.585418    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-trusted-ca\") pod \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") "
Jul 07 14:12:43.585504 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.585441    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-installation-pull-secrets\") pod \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") "
Jul 07 14:12:43.585504 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.585494    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7fsr\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-kube-api-access-j7fsr\") pod \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") "
Jul 07 14:12:43.585741 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.585530    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") pod \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") "
Jul 07 14:12:43.585741 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.585591    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-bound-sa-token\") pod \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\" (UID: \"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94\") "
Jul 07 14:12:43.585842 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.585797    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:12:43.585960 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.585930    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:12:43.587889 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.587846    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:12:43.588035 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.588014    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:12:43.588035 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.588014    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-kube-api-access-j7fsr" (OuterVolumeSpecName: "kube-api-access-j7fsr") pod "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94"). InnerVolumeSpecName "kube-api-access-j7fsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:12:43.588138 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.588054    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:12:43.588184 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.588160    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:12:43.593693 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.593670    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" (UID: "6b52d79d-6dfc-4201-8d9e-a5bc8e667d94"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:12:43.686240 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.686208    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-certificates\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:12:43.686323 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.686241    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-image-registry-private-configuration\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:12:43.686323 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.686252    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-trusted-ca\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:12:43.686323 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.686260    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-installation-pull-secrets\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:12:43.686323 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.686268    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7fsr\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-kube-api-access-j7fsr\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:12:43.686323 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.686276    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-registry-tls\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:12:43.686323 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.686284    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-bound-sa-token\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:12:43.686323 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:43.686291    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94-ca-trust-extracted\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:12:44.293680 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:44.293644    2557 generic.go:356] "Generic (PLEG): container finished" podID="6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" containerID="a239a3159bc855bf0555eb7d3d97a06271e7c98c1c5e0134e627d103116a3ef5" exitCode=0
Jul 07 14:12:44.294131 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:44.293701    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9858dc8-29r24"
Jul 07 14:12:44.294131 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:44.293694    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9858dc8-29r24" event={"ID":"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94","Type":"ContainerDied","Data":"a239a3159bc855bf0555eb7d3d97a06271e7c98c1c5e0134e627d103116a3ef5"}
Jul 07 14:12:44.294131 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:44.293758    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9858dc8-29r24" event={"ID":"6b52d79d-6dfc-4201-8d9e-a5bc8e667d94","Type":"ContainerDied","Data":"3d4db4b19f43503e23618c04e4ba75ba12e08be427903a19b7c64402b9c656fc"}
Jul 07 14:12:44.294131 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:44.293787    2557 scope.go:117] "RemoveContainer" containerID="a239a3159bc855bf0555eb7d3d97a06271e7c98c1c5e0134e627d103116a3ef5"
Jul 07 14:12:44.302016 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:44.301999    2557 scope.go:117] "RemoveContainer" containerID="a239a3159bc855bf0555eb7d3d97a06271e7c98c1c5e0134e627d103116a3ef5"
Jul 07 14:12:44.302275 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:12:44.302252    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a239a3159bc855bf0555eb7d3d97a06271e7c98c1c5e0134e627d103116a3ef5\": container with ID starting with a239a3159bc855bf0555eb7d3d97a06271e7c98c1c5e0134e627d103116a3ef5 not found: ID does not exist" containerID="a239a3159bc855bf0555eb7d3d97a06271e7c98c1c5e0134e627d103116a3ef5"
Jul 07 14:12:44.302373 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:44.302279    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a239a3159bc855bf0555eb7d3d97a06271e7c98c1c5e0134e627d103116a3ef5"} err="failed to get container status \"a239a3159bc855bf0555eb7d3d97a06271e7c98c1c5e0134e627d103116a3ef5\": rpc error: code = NotFound desc = could not find container \"a239a3159bc855bf0555eb7d3d97a06271e7c98c1c5e0134e627d103116a3ef5\": container with ID starting with a239a3159bc855bf0555eb7d3d97a06271e7c98c1c5e0134e627d103116a3ef5 not found: ID does not exist"
Jul 07 14:12:44.314262 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:44.314222    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b9858dc8-29r24"]
Jul 07 14:12:44.318512 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:44.318492    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b9858dc8-29r24"]
Jul 07 14:12:45.116473 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:12:45.116439    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" path="/var/lib/kubelet/pods/6b52d79d-6dfc-4201-8d9e-a5bc8e667d94/volumes"
Jul 07 14:13:52.725377 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.725342    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2vppv"]
Jul 07 14:13:52.725813 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.725575    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" containerName="registry"
Jul 07 14:13:52.725813 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.725585    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" containerName="registry"
Jul 07 14:13:52.725813 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.725634    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b52d79d-6dfc-4201-8d9e-a5bc8e667d94" containerName="registry"
Jul 07 14:13:52.727397 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.727383    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2vppv"
Jul 07 14:13:52.729951 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.729931    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 14:13:52.730055 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.729955    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 14:13:52.730907 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.730892    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-rb5r8\""
Jul 07 14:13:52.736146 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.736126    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2vppv"]
Jul 07 14:13:52.847315 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.847283    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffdc0f6f-52e8-487a-b95f-d31e18da3b73-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2vppv\" (UID: \"ffdc0f6f-52e8-487a-b95f-d31e18da3b73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2vppv"
Jul 07 14:13:52.847455 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.847327    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22fkr\" (UniqueName: \"kubernetes.io/projected/ffdc0f6f-52e8-487a-b95f-d31e18da3b73-kube-api-access-22fkr\") pod \"cert-manager-webhook-6486ffd997-2vppv\" (UID: \"ffdc0f6f-52e8-487a-b95f-d31e18da3b73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2vppv"
Jul 07 14:13:52.948587 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.948561    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffdc0f6f-52e8-487a-b95f-d31e18da3b73-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2vppv\" (UID: \"ffdc0f6f-52e8-487a-b95f-d31e18da3b73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2vppv"
Jul 07 14:13:52.948679 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.948602    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22fkr\" (UniqueName: \"kubernetes.io/projected/ffdc0f6f-52e8-487a-b95f-d31e18da3b73-kube-api-access-22fkr\") pod \"cert-manager-webhook-6486ffd997-2vppv\" (UID: \"ffdc0f6f-52e8-487a-b95f-d31e18da3b73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2vppv"
Jul 07 14:13:52.956521 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.956497    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ffdc0f6f-52e8-487a-b95f-d31e18da3b73-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2vppv\" (UID: \"ffdc0f6f-52e8-487a-b95f-d31e18da3b73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2vppv"
Jul 07 14:13:52.956721 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:52.956698    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22fkr\" (UniqueName: \"kubernetes.io/projected/ffdc0f6f-52e8-487a-b95f-d31e18da3b73-kube-api-access-22fkr\") pod \"cert-manager-webhook-6486ffd997-2vppv\" (UID: \"ffdc0f6f-52e8-487a-b95f-d31e18da3b73\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2vppv"
Jul 07 14:13:53.036178 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:53.036104    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2vppv"
Jul 07 14:13:53.154487 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:53.154457    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2vppv"]
Jul 07 14:13:53.157551 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:13:53.157522    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffdc0f6f_52e8_487a_b95f_d31e18da3b73.slice/crio-268eb3f8780d4631dd98dbdbb968cfe17cd7933dc410ff0009438fe0851f5e60 WatchSource:0}: Error finding container 268eb3f8780d4631dd98dbdbb968cfe17cd7933dc410ff0009438fe0851f5e60: Status 404 returned error can't find the container with id 268eb3f8780d4631dd98dbdbb968cfe17cd7933dc410ff0009438fe0851f5e60
Jul 07 14:13:53.159376 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:53.159362    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:13:53.508517 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:53.508480    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2vppv" event={"ID":"ffdc0f6f-52e8-487a-b95f-d31e18da3b73","Type":"ContainerStarted","Data":"268eb3f8780d4631dd98dbdbb968cfe17cd7933dc410ff0009438fe0851f5e60"}
Jul 07 14:13:56.522431 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:56.522345    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2vppv" event={"ID":"ffdc0f6f-52e8-487a-b95f-d31e18da3b73","Type":"ContainerStarted","Data":"b76b287362b675d5664b48f00998e14712f7b7087866e522df055a8216a39f70"}
Jul 07 14:13:56.522791 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:56.522482    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2vppv"
Jul 07 14:13:56.538818 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:13:56.538777    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2vppv" podStartSLOduration=1.441821496 podStartE2EDuration="4.538764119s" totalImagesPullingTime="3.096942623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:13:56.537544105 +0000 UTC m=+425.899867272" watchObservedRunningTime="2026-07-07 14:13:56.538764119 +0000 UTC m=+425.901087284"
Jul 07 14:14:02.528617 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:02.528582    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2vppv"
Jul 07 14:14:19.493225 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.493192    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"]
Jul 07 14:14:19.495829 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.495813    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.498542 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.498524    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 14:14:19.498716 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.498606    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-55ddl\""
Jul 07 14:14:19.498716 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.498621    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 14:14:19.498716 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.498629    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 14:14:19.499038 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.499017    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 14:14:19.511034 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.511010    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"]
Jul 07 14:14:19.638381 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.638350    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/397f85ae-abb0-46a5-bbb3-af5e6586f59a-webhook-cert\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.638381 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.638383    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/397f85ae-abb0-46a5-bbb3-af5e6586f59a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.638586 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.638460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/397f85ae-abb0-46a5-bbb3-af5e6586f59a-manifests\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.638586 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.638488    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd8dt\" (UniqueName: \"kubernetes.io/projected/397f85ae-abb0-46a5-bbb3-af5e6586f59a-kube-api-access-pd8dt\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.638586 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.638514    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/397f85ae-abb0-46a5-bbb3-af5e6586f59a-tmp\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.739217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.739176    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/397f85ae-abb0-46a5-bbb3-af5e6586f59a-manifests\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.739438 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.739246    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd8dt\" (UniqueName: \"kubernetes.io/projected/397f85ae-abb0-46a5-bbb3-af5e6586f59a-kube-api-access-pd8dt\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.739438 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.739273    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/397f85ae-abb0-46a5-bbb3-af5e6586f59a-tmp\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.739438 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.739307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/397f85ae-abb0-46a5-bbb3-af5e6586f59a-webhook-cert\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.739438 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.739333    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/397f85ae-abb0-46a5-bbb3-af5e6586f59a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.739717 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.739648    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/397f85ae-abb0-46a5-bbb3-af5e6586f59a-manifests\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.741618 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.741598    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/397f85ae-abb0-46a5-bbb3-af5e6586f59a-tmp\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.741745 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.741727    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/397f85ae-abb0-46a5-bbb3-af5e6586f59a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.741825 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.741806    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/397f85ae-abb0-46a5-bbb3-af5e6586f59a-webhook-cert\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.747974 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.747922    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd8dt\" (UniqueName: \"kubernetes.io/projected/397f85ae-abb0-46a5-bbb3-af5e6586f59a-kube-api-access-pd8dt\") pod \"opendatahub-operator-controller-manager-55dcd65d78-c9lf4\" (UID: \"397f85ae-abb0-46a5-bbb3-af5e6586f59a\") " pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.805776 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.805743    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:19.934605 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:19.934577    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"]
Jul 07 14:14:19.937128 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:14:19.937099    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397f85ae_abb0_46a5_bbb3_af5e6586f59a.slice/crio-bacb8c8fa217e3c03e5f71276e1fc6c9ef5e6127388cb51687d6daa23f04a3ca WatchSource:0}: Error finding container bacb8c8fa217e3c03e5f71276e1fc6c9ef5e6127388cb51687d6daa23f04a3ca: Status 404 returned error can't find the container with id bacb8c8fa217e3c03e5f71276e1fc6c9ef5e6127388cb51687d6daa23f04a3ca
Jul 07 14:14:20.601840 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:20.601803    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4" event={"ID":"397f85ae-abb0-46a5-bbb3-af5e6586f59a","Type":"ContainerStarted","Data":"bacb8c8fa217e3c03e5f71276e1fc6c9ef5e6127388cb51687d6daa23f04a3ca"}
Jul 07 14:14:23.614275 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:23.614224    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4" event={"ID":"397f85ae-abb0-46a5-bbb3-af5e6586f59a","Type":"ContainerStarted","Data":"5d3d46bd7b8836b65fe30ab2637ee7ce9322df0f91623a68c5b209076a97829f"}
Jul 07 14:14:24.619396 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:24.619364    2557 generic.go:356] "Generic (PLEG): container finished" podID="397f85ae-abb0-46a5-bbb3-af5e6586f59a" containerID="5d3d46bd7b8836b65fe30ab2637ee7ce9322df0f91623a68c5b209076a97829f" exitCode=0
Jul 07 14:14:24.619734 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:24.619436    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4" event={"ID":"397f85ae-abb0-46a5-bbb3-af5e6586f59a","Type":"ContainerDied","Data":"5d3d46bd7b8836b65fe30ab2637ee7ce9322df0f91623a68c5b209076a97829f"}
Jul 07 14:14:25.624609 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:25.624573    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4" event={"ID":"397f85ae-abb0-46a5-bbb3-af5e6586f59a","Type":"ContainerStarted","Data":"777d1d6202e92157f929d17502da9b8dace0451ee098a042daee0f7349eda423"}
Jul 07 14:14:25.624985 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:25.624707    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:25.650955 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:25.650900    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4" podStartSLOduration=2.072467754 podStartE2EDuration="6.650885249s" totalImagesPullingTime="3.541567559s" totalInitContainerRuntime="1.036849936s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:25.648776753 +0000 UTC m=+455.011099944" watchObservedRunningTime="2026-07-07 14:14:25.650885249 +0000 UTC m=+455.013208414"
Jul 07 14:14:36.630381 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:36.630351    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-55dcd65d78-c9lf4"
Jul 07 14:14:40.094846 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.094815    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9xbjv"]
Jul 07 14:14:40.101934 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.101915    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv"
Jul 07 14:14:40.104830 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.104812    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 14:14:40.104944 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.104908    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-np5cz\""
Jul 07 14:14:40.116635 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.116602    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9xbjv"]
Jul 07 14:14:40.236591 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.236560    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"]
Jul 07 14:14:40.239023 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.239003    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"
Jul 07 14:14:40.241626 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.241608    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 14:14:40.241729 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.241714    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b6xcm\""
Jul 07 14:14:40.241905 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.241890    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 14:14:40.241982 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.241966    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 14:14:40.242028 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.241994    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 14:14:40.250895 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.250868    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"]
Jul 07 14:14:40.291508 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.291478    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xld8k\" (UniqueName: \"kubernetes.io/projected/53f188b2-31dd-4ff0-9113-0115211425ce-kube-api-access-xld8k\") pod \"odh-model-controller-7998c67dc4-9xbjv\" (UID: \"53f188b2-31dd-4ff0-9113-0115211425ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv"
Jul 07 14:14:40.291650 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.291522    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53f188b2-31dd-4ff0-9113-0115211425ce-cert\") pod \"odh-model-controller-7998c67dc4-9xbjv\" (UID: \"53f188b2-31dd-4ff0-9113-0115211425ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv"
Jul 07 14:14:40.392655 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.392562    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xld8k\" (UniqueName: \"kubernetes.io/projected/53f188b2-31dd-4ff0-9113-0115211425ce-kube-api-access-xld8k\") pod \"odh-model-controller-7998c67dc4-9xbjv\" (UID: \"53f188b2-31dd-4ff0-9113-0115211425ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv"
Jul 07 14:14:40.392655 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.392617    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53f188b2-31dd-4ff0-9113-0115211425ce-cert\") pod \"odh-model-controller-7998c67dc4-9xbjv\" (UID: \"53f188b2-31dd-4ff0-9113-0115211425ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv"
Jul 07 14:14:40.392883 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.392659    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99679e7e-647a-482d-9b71-d1ae8cff966a-tmp\") pod \"kube-auth-proxy-769bbd759d-4kzfq\" (UID: \"99679e7e-647a-482d-9b71-d1ae8cff966a\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"
Jul 07 14:14:40.392883 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.392720    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99679e7e-647a-482d-9b71-d1ae8cff966a-tls-certs\") pod \"kube-auth-proxy-769bbd759d-4kzfq\" (UID: \"99679e7e-647a-482d-9b71-d1ae8cff966a\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"
Jul 07 14:14:40.392883 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.392755    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mczs4\" (UniqueName: \"kubernetes.io/projected/99679e7e-647a-482d-9b71-d1ae8cff966a-kube-api-access-mczs4\") pod \"kube-auth-proxy-769bbd759d-4kzfq\" (UID: \"99679e7e-647a-482d-9b71-d1ae8cff966a\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"
Jul 07 14:14:40.392883 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:14:40.392799    2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 07 14:14:40.392883 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:14:40.392883    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f188b2-31dd-4ff0-9113-0115211425ce-cert podName:53f188b2-31dd-4ff0-9113-0115211425ce nodeName:}" failed. No retries permitted until 2026-07-07 14:14:40.892862062 +0000 UTC m=+470.255185221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/53f188b2-31dd-4ff0-9113-0115211425ce-cert") pod "odh-model-controller-7998c67dc4-9xbjv" (UID: "53f188b2-31dd-4ff0-9113-0115211425ce") : secret "odh-model-controller-webhook-cert" not found
Jul 07 14:14:40.402061 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.402032    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xld8k\" (UniqueName: \"kubernetes.io/projected/53f188b2-31dd-4ff0-9113-0115211425ce-kube-api-access-xld8k\") pod \"odh-model-controller-7998c67dc4-9xbjv\" (UID: \"53f188b2-31dd-4ff0-9113-0115211425ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv"
Jul 07 14:14:40.493755 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.493715    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99679e7e-647a-482d-9b71-d1ae8cff966a-tls-certs\") pod \"kube-auth-proxy-769bbd759d-4kzfq\" (UID: \"99679e7e-647a-482d-9b71-d1ae8cff966a\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"
Jul 07 14:14:40.493755 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.493759    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mczs4\" (UniqueName: \"kubernetes.io/projected/99679e7e-647a-482d-9b71-d1ae8cff966a-kube-api-access-mczs4\") pod \"kube-auth-proxy-769bbd759d-4kzfq\" (UID: \"99679e7e-647a-482d-9b71-d1ae8cff966a\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"
Jul 07 14:14:40.493953 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.493811    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99679e7e-647a-482d-9b71-d1ae8cff966a-tmp\") pod \"kube-auth-proxy-769bbd759d-4kzfq\" (UID: \"99679e7e-647a-482d-9b71-d1ae8cff966a\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"
Jul 07 14:14:40.493953 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:14:40.493876    2557 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 07 14:14:40.494014 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:14:40.493963    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99679e7e-647a-482d-9b71-d1ae8cff966a-tls-certs podName:99679e7e-647a-482d-9b71-d1ae8cff966a nodeName:}" failed. No retries permitted until 2026-07-07 14:14:40.993943194 +0000 UTC m=+470.356266338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/99679e7e-647a-482d-9b71-d1ae8cff966a-tls-certs") pod "kube-auth-proxy-769bbd759d-4kzfq" (UID: "99679e7e-647a-482d-9b71-d1ae8cff966a") : secret "kube-auth-proxy-tls" not found
Jul 07 14:14:40.496057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.496033    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99679e7e-647a-482d-9b71-d1ae8cff966a-tmp\") pod \"kube-auth-proxy-769bbd759d-4kzfq\" (UID: \"99679e7e-647a-482d-9b71-d1ae8cff966a\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"
Jul 07 14:14:40.509955 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.509928    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mczs4\" (UniqueName: \"kubernetes.io/projected/99679e7e-647a-482d-9b71-d1ae8cff966a-kube-api-access-mczs4\") pod \"kube-auth-proxy-769bbd759d-4kzfq\" (UID: \"99679e7e-647a-482d-9b71-d1ae8cff966a\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"
Jul 07 14:14:40.723319 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.723245    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ggb46"]
Jul 07 14:14:40.725526 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.725511    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ggb46"
Jul 07 14:14:40.727893 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.727864    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 14:14:40.737345 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.737320    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ggb46"]
Jul 07 14:14:40.897798 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.897760    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs9wc\" (UniqueName: \"kubernetes.io/projected/c52600f7-3d3c-4157-a337-3af9d64781e9-kube-api-access-rs9wc\") pod \"model-serving-api-54d89bd5fc-ggb46\" (UID: \"c52600f7-3d3c-4157-a337-3af9d64781e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-ggb46"
Jul 07 14:14:40.897951 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.897882    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c52600f7-3d3c-4157-a337-3af9d64781e9-tls-certs\") pod \"model-serving-api-54d89bd5fc-ggb46\" (UID: \"c52600f7-3d3c-4157-a337-3af9d64781e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-ggb46"
Jul 07 14:14:40.897951 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.897920    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53f188b2-31dd-4ff0-9113-0115211425ce-cert\") pod \"odh-model-controller-7998c67dc4-9xbjv\" (UID: \"53f188b2-31dd-4ff0-9113-0115211425ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv"
Jul 07 14:14:40.900453 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.900427    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53f188b2-31dd-4ff0-9113-0115211425ce-cert\") pod \"odh-model-controller-7998c67dc4-9xbjv\" (UID: \"53f188b2-31dd-4ff0-9113-0115211425ce\") " pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv"
Jul 07 14:14:40.998846 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.998768    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c52600f7-3d3c-4157-a337-3af9d64781e9-tls-certs\") pod \"model-serving-api-54d89bd5fc-ggb46\" (UID: \"c52600f7-3d3c-4157-a337-3af9d64781e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-ggb46"
Jul 07 14:14:40.998846 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.998820    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs9wc\" (UniqueName: \"kubernetes.io/projected/c52600f7-3d3c-4157-a337-3af9d64781e9-kube-api-access-rs9wc\") pod \"model-serving-api-54d89bd5fc-ggb46\" (UID: \"c52600f7-3d3c-4157-a337-3af9d64781e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-ggb46"
Jul 07 14:14:40.999064 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:40.998876    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99679e7e-647a-482d-9b71-d1ae8cff966a-tls-certs\") pod \"kube-auth-proxy-769bbd759d-4kzfq\" (UID: \"99679e7e-647a-482d-9b71-d1ae8cff966a\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"
Jul 07 14:14:41.001178 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.001147    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c52600f7-3d3c-4157-a337-3af9d64781e9-tls-certs\") pod \"model-serving-api-54d89bd5fc-ggb46\" (UID: \"c52600f7-3d3c-4157-a337-3af9d64781e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-ggb46"
Jul 07 14:14:41.001312 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.001246    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/99679e7e-647a-482d-9b71-d1ae8cff966a-tls-certs\") pod \"kube-auth-proxy-769bbd759d-4kzfq\" (UID: \"99679e7e-647a-482d-9b71-d1ae8cff966a\") " pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"
Jul 07 14:14:41.007673 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.007654    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs9wc\" (UniqueName: \"kubernetes.io/projected/c52600f7-3d3c-4157-a337-3af9d64781e9-kube-api-access-rs9wc\") pod \"model-serving-api-54d89bd5fc-ggb46\" (UID: \"c52600f7-3d3c-4157-a337-3af9d64781e9\") " pod="opendatahub/model-serving-api-54d89bd5fc-ggb46"
Jul 07 14:14:41.011465 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.011447    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv"
Jul 07 14:14:41.035190 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.035172    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ggb46"
Jul 07 14:14:41.148635 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.148603    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"
Jul 07 14:14:41.151060 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.150956    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9xbjv"]
Jul 07 14:14:41.153699 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:14:41.153665    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f188b2_31dd_4ff0_9113_0115211425ce.slice/crio-e86cfd481dfbb9a608b01d5e55ba4220f031e30ab50443ec3e7b70ee331600a8 WatchSource:0}: Error finding container e86cfd481dfbb9a608b01d5e55ba4220f031e30ab50443ec3e7b70ee331600a8: Status 404 returned error can't find the container with id e86cfd481dfbb9a608b01d5e55ba4220f031e30ab50443ec3e7b70ee331600a8
Jul 07 14:14:41.170998 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.170900    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ggb46"]
Jul 07 14:14:41.173341 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:14:41.173306    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52600f7_3d3c_4157_a337_3af9d64781e9.slice/crio-c640596701d86a1697604c76f98f050c37b469e39a11be1de5cad725d8a06f08 WatchSource:0}: Error finding container c640596701d86a1697604c76f98f050c37b469e39a11be1de5cad725d8a06f08: Status 404 returned error can't find the container with id c640596701d86a1697604c76f98f050c37b469e39a11be1de5cad725d8a06f08
Jul 07 14:14:41.289044 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.289014    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq"]
Jul 07 14:14:41.290809 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:14:41.290785    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99679e7e_647a_482d_9b71_d1ae8cff966a.slice/crio-d0d263abf3044414bcec2c87b36c120cb8e31ae8cc3b0d5dde2015483e387f7c WatchSource:0}: Error finding container d0d263abf3044414bcec2c87b36c120cb8e31ae8cc3b0d5dde2015483e387f7c: Status 404 returned error can't find the container with id d0d263abf3044414bcec2c87b36c120cb8e31ae8cc3b0d5dde2015483e387f7c
Jul 07 14:14:41.469267 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.469220    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"]
Jul 07 14:14:41.472354 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.472338    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.475210 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.475191    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 14:14:41.475334 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.475210    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nnwlf\""
Jul 07 14:14:41.475334 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.475196    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 14:14:41.476381 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.476365    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 14:14:41.476534 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.476515    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 14:14:41.487356 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.487335    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"]
Jul 07 14:14:41.605339 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.605307    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.605522 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.605351    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edebd8bf-83ca-41f3-95c5-699305304351-istio-token\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.605522 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.605371    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-cacerts\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.605522 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.605389    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtsv5\" (UniqueName: \"kubernetes.io/projected/edebd8bf-83ca-41f3-95c5-699305304351-kube-api-access-dtsv5\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.605522 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.605451    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.605522 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.605470    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/edebd8bf-83ca-41f3-95c5-699305304351-local-certs\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.605522 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.605495    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/edebd8bf-83ca-41f3-95c5-699305304351-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.676279 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.676220    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq" event={"ID":"99679e7e-647a-482d-9b71-d1ae8cff966a","Type":"ContainerStarted","Data":"d0d263abf3044414bcec2c87b36c120cb8e31ae8cc3b0d5dde2015483e387f7c"}
Jul 07 14:14:41.677489 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.677459    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv" event={"ID":"53f188b2-31dd-4ff0-9113-0115211425ce","Type":"ContainerStarted","Data":"e86cfd481dfbb9a608b01d5e55ba4220f031e30ab50443ec3e7b70ee331600a8"}
Jul 07 14:14:41.678593 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.678573    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ggb46" event={"ID":"c52600f7-3d3c-4157-a337-3af9d64781e9","Type":"ContainerStarted","Data":"c640596701d86a1697604c76f98f050c37b469e39a11be1de5cad725d8a06f08"}
Jul 07 14:14:41.706090 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.706054    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.706202 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.706109    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/edebd8bf-83ca-41f3-95c5-699305304351-local-certs\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.706202 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.706155    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/edebd8bf-83ca-41f3-95c5-699305304351-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.706368 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.706201    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.706368 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.706273    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edebd8bf-83ca-41f3-95c5-699305304351-istio-token\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.706368 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.706302    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-cacerts\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.706781 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.706437    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtsv5\" (UniqueName: \"kubernetes.io/projected/edebd8bf-83ca-41f3-95c5-699305304351-kube-api-access-dtsv5\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.707120 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.707101    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/edebd8bf-83ca-41f3-95c5-699305304351-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.708644 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.708619    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/edebd8bf-83ca-41f3-95c5-699305304351-local-certs\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.709028 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.709003    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.709132 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.709099    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-cacerts\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.709220 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.709202    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.714664 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.714638    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edebd8bf-83ca-41f3-95c5-699305304351-istio-token\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.714892 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.714872    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtsv5\" (UniqueName: \"kubernetes.io/projected/edebd8bf-83ca-41f3-95c5-699305304351-kube-api-access-dtsv5\") pod \"istiod-openshift-gateway-7574459656-7k2hd\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.782576 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.782544    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:41.922551 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:41.922451    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"]
Jul 07 14:14:41.925046 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:14:41.925015    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedebd8bf_83ca_41f3_95c5_699305304351.slice/crio-e3933bbc79d34be7e7755572d72ba4cbec47e0ee38a322da0bbbdcb88dd3ee8b WatchSource:0}: Error finding container e3933bbc79d34be7e7755572d72ba4cbec47e0ee38a322da0bbbdcb88dd3ee8b: Status 404 returned error can't find the container with id e3933bbc79d34be7e7755572d72ba4cbec47e0ee38a322da0bbbdcb88dd3ee8b
Jul 07 14:14:42.685836 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:42.685757    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd" event={"ID":"edebd8bf-83ca-41f3-95c5-699305304351","Type":"ContainerStarted","Data":"e3933bbc79d34be7e7755572d72ba4cbec47e0ee38a322da0bbbdcb88dd3ee8b"}
Jul 07 14:14:43.692494 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:43.692415    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ggb46" event={"ID":"c52600f7-3d3c-4157-a337-3af9d64781e9","Type":"ContainerStarted","Data":"b402d4cd8fd8de038dd13c20406f4211ff4a0e4f6ac0573dc1ad430338e0add6"}
Jul 07 14:14:43.692863 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:43.692540    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ggb46"
Jul 07 14:14:43.711944 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:43.711871    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ggb46" podStartSLOduration=1.457494753 podStartE2EDuration="3.711853337s" totalImagesPullingTime="2.254358584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:43.710130881 +0000 UTC m=+473.072454061" watchObservedRunningTime="2026-07-07 14:14:43.711853337 +0000 UTC m=+473.074176507"
Jul 07 14:14:45.704644 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:45.704496    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv" event={"ID":"53f188b2-31dd-4ff0-9113-0115211425ce","Type":"ContainerStarted","Data":"e072a4125409ecd91a3bdd764ca0f3cc757c72343a478655b907dd1c7967bb2f"}
Jul 07 14:14:45.704644 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:45.704564    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv"
Jul 07 14:14:45.706352 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:45.706324    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq" event={"ID":"99679e7e-647a-482d-9b71-d1ae8cff966a","Type":"ContainerStarted","Data":"3c29c9544098bf900880a2d5373ecb1e870146a90db8b452fb6f66b88f953065"}
Jul 07 14:14:45.723425 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:45.723369    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv" podStartSLOduration=1.438963514 podStartE2EDuration="5.723350777s" totalImagesPullingTime="4.284387263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:45.722115115 +0000 UTC m=+475.084438305" watchObservedRunningTime="2026-07-07 14:14:45.723350777 +0000 UTC m=+475.085673943"
Jul 07 14:14:47.417363 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:47.417320    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:14:47.417644 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:47.417385    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:14:47.715710 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:47.715628    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd" event={"ID":"edebd8bf-83ca-41f3-95c5-699305304351","Type":"ContainerStarted","Data":"df4021ad33e8bbe0809bd00817da396436148f15172b4596db90195ca1c261a1"}
Jul 07 14:14:47.715856 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:47.715775    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:47.737828 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:47.737778    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-769bbd759d-4kzfq" podStartSLOduration=3.591500768 podStartE2EDuration="7.737766163s" totalImagesPullingTime="4.146265395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:45.739134739 +0000 UTC m=+475.101457904" watchObservedRunningTime="2026-07-07 14:14:47.737766163 +0000 UTC m=+477.100089359"
Jul 07 14:14:47.738478 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:47.738442    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd" podStartSLOduration=1.249131058 podStartE2EDuration="6.738434081s" totalImagesPullingTime="5.489303023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:47.736474652 +0000 UTC m=+477.098797819" watchObservedRunningTime="2026-07-07 14:14:47.738434081 +0000 UTC m=+477.100757246"
Jul 07 14:14:48.721626 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:48.721594    2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-7k2hd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 14:14:48.721978 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:48.721645    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd" podUID="edebd8bf-83ca-41f3-95c5-699305304351" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 14:14:49.443244 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.443208    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"]
Jul 07 14:14:49.446044 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.446022    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.448606 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.448581    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7pnzd\""
Jul 07 14:14:49.460734 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.460710    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"]
Jul 07 14:14:49.471395 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.471372    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8cf52e3-e469-407d-b9db-5f416d7e953f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.471500 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.471405    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.471500 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.471434    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.471500 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.471479    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.471636 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.471515    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.471685 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.471642    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.471685 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.471678    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8cf52e3-e469-407d-b9db-5f416d7e953f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.471786 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.471707    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8cf52e3-e469-407d-b9db-5f416d7e953f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.471786 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.471749    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v4n9\" (UniqueName: \"kubernetes.io/projected/b8cf52e3-e469-407d-b9db-5f416d7e953f-kube-api-access-5v4n9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.572631 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.572592    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.572834 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.572654    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.572834 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.572678    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.572834 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.572766    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.572834 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.572792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8cf52e3-e469-407d-b9db-5f416d7e953f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.572834 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.572816    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8cf52e3-e469-407d-b9db-5f416d7e953f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.573093 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.572877    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v4n9\" (UniqueName: \"kubernetes.io/projected/b8cf52e3-e469-407d-b9db-5f416d7e953f-kube-api-access-5v4n9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.573093 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.572943    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8cf52e3-e469-407d-b9db-5f416d7e953f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.573093 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.572975    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.573093 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.572976    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.573321 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.573133    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.573321 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.573222    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.573321 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.573310    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.573652 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.573627    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8cf52e3-e469-407d-b9db-5f416d7e953f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.575806 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.575787    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8cf52e3-e469-407d-b9db-5f416d7e953f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.576031 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.576012    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8cf52e3-e469-407d-b9db-5f416d7e953f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.587151 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.587123    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v4n9\" (UniqueName: \"kubernetes.io/projected/b8cf52e3-e469-407d-b9db-5f416d7e953f-kube-api-access-5v4n9\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.587868 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.587849    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8cf52e3-e469-407d-b9db-5f416d7e953f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf462jcp\" (UID: \"b8cf52e3-e469-407d-b9db-5f416d7e953f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.756456 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.756368    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:49.884714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:49.884649    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"]
Jul 07 14:14:49.886707 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:14:49.886679    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8cf52e3_e469_407d_b9db_5f416d7e953f.slice/crio-972055bff89a6a6ab3f39b27f01be3d53d89c0cd5eb2346c62adf51fc8e0d316 WatchSource:0}: Error finding container 972055bff89a6a6ab3f39b27f01be3d53d89c0cd5eb2346c62adf51fc8e0d316: Status 404 returned error can't find the container with id 972055bff89a6a6ab3f39b27f01be3d53d89c0cd5eb2346c62adf51fc8e0d316
Jul 07 14:14:50.728294 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:50.728255    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp" event={"ID":"b8cf52e3-e469-407d-b9db-5f416d7e953f","Type":"ContainerStarted","Data":"972055bff89a6a6ab3f39b27f01be3d53d89c0cd5eb2346c62adf51fc8e0d316"}
Jul 07 14:14:51.393295 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.393252    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r"]
Jul 07 14:14:51.397301 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.397281    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"]
Jul 07 14:14:51.397428 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.397402    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r"
Jul 07 14:14:51.399954 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.399911    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"
Jul 07 14:14:51.400155 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.400127    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 14:14:51.400342 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.400319    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2s6wl\""
Jul 07 14:14:51.402460 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.402441    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 14:14:51.402543 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.402474    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-44zg7\""
Jul 07 14:14:51.407832 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.407809    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r"]
Jul 07 14:14:51.410831 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.410810    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"]
Jul 07 14:14:51.489542 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.489504    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bb224bf-cd7a-476a-b30a-2b9207e15c0c-cert\") pod \"kserve-controller-manager-d6f4b65b8-lbb7r\" (UID: \"3bb224bf-cd7a-476a-b30a-2b9207e15c0c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r"
Jul 07 14:14:51.489542 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.489556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m47rs\" (UniqueName: \"kubernetes.io/projected/0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03-kube-api-access-m47rs\") pod \"llmisvc-controller-manager-777c6bd7d5-nk582\" (UID: \"0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"
Jul 07 14:14:51.489743 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.489575    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8pdz\" (UniqueName: \"kubernetes.io/projected/3bb224bf-cd7a-476a-b30a-2b9207e15c0c-kube-api-access-c8pdz\") pod \"kserve-controller-manager-d6f4b65b8-lbb7r\" (UID: \"3bb224bf-cd7a-476a-b30a-2b9207e15c0c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r"
Jul 07 14:14:51.489743 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.489673    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nk582\" (UID: \"0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"
Jul 07 14:14:51.590470 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.590429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bb224bf-cd7a-476a-b30a-2b9207e15c0c-cert\") pod \"kserve-controller-manager-d6f4b65b8-lbb7r\" (UID: \"3bb224bf-cd7a-476a-b30a-2b9207e15c0c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r"
Jul 07 14:14:51.590470 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.590476    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47rs\" (UniqueName: \"kubernetes.io/projected/0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03-kube-api-access-m47rs\") pod \"llmisvc-controller-manager-777c6bd7d5-nk582\" (UID: \"0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"
Jul 07 14:14:51.590725 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.590501    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8pdz\" (UniqueName: \"kubernetes.io/projected/3bb224bf-cd7a-476a-b30a-2b9207e15c0c-kube-api-access-c8pdz\") pod \"kserve-controller-manager-d6f4b65b8-lbb7r\" (UID: \"3bb224bf-cd7a-476a-b30a-2b9207e15c0c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r"
Jul 07 14:14:51.590725 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.590547    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nk582\" (UID: \"0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"
Jul 07 14:14:51.590725 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:14:51.590664    2557 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 07 14:14:51.590864 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:14:51.590749    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03-cert podName:0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03 nodeName:}" failed. No retries permitted until 2026-07-07 14:14:52.09072474 +0000 UTC m=+481.453047886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03-cert") pod "llmisvc-controller-manager-777c6bd7d5-nk582" (UID: "0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03") : secret "llmisvc-webhook-server-cert" not found
Jul 07 14:14:51.593203 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.593176    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bb224bf-cd7a-476a-b30a-2b9207e15c0c-cert\") pod \"kserve-controller-manager-d6f4b65b8-lbb7r\" (UID: \"3bb224bf-cd7a-476a-b30a-2b9207e15c0c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r"
Jul 07 14:14:51.609575 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.609544    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m47rs\" (UniqueName: \"kubernetes.io/projected/0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03-kube-api-access-m47rs\") pod \"llmisvc-controller-manager-777c6bd7d5-nk582\" (UID: \"0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"
Jul 07 14:14:51.615153 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.615118    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8pdz\" (UniqueName: \"kubernetes.io/projected/3bb224bf-cd7a-476a-b30a-2b9207e15c0c-kube-api-access-c8pdz\") pod \"kserve-controller-manager-d6f4b65b8-lbb7r\" (UID: \"3bb224bf-cd7a-476a-b30a-2b9207e15c0c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r"
Jul 07 14:14:51.713339 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.713247    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r"
Jul 07 14:14:51.721163 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:51.721142    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:52.094349 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:52.094317    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nk582\" (UID: \"0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"
Jul 07 14:14:52.097054 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:52.097025    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-nk582\" (UID: \"0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"
Jul 07 14:14:52.320820 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:52.320767    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"
Jul 07 14:14:52.447067 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:52.446564    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:14:52.447067 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:52.446665    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:14:52.447067 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:52.446710    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:14:52.574649 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:52.574626    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r"]
Jul 07 14:14:52.577591 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:14:52.577523    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb224bf_cd7a_476a_b30a_2b9207e15c0c.slice/crio-8e04cba21cecb68363e8723648fd3f54ecf296b5fe26e90bc95b1003355d5c5f WatchSource:0}: Error finding container 8e04cba21cecb68363e8723648fd3f54ecf296b5fe26e90bc95b1003355d5c5f: Status 404 returned error can't find the container with id 8e04cba21cecb68363e8723648fd3f54ecf296b5fe26e90bc95b1003355d5c5f
Jul 07 14:14:52.599316 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:52.599260    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"]
Jul 07 14:14:52.602611 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:14:52.602586    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0ce18c26_f7ff_4e8a_b2c4_e36f66ee3a03.slice/crio-25efb9dcf523a57fd155889866971ee1a93e1f360a436c1acb1bcf6793e7ec15 WatchSource:0}: Error finding container 25efb9dcf523a57fd155889866971ee1a93e1f360a436c1acb1bcf6793e7ec15: Status 404 returned error can't find the container with id 25efb9dcf523a57fd155889866971ee1a93e1f360a436c1acb1bcf6793e7ec15
Jul 07 14:14:52.738527 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:52.738444    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582" event={"ID":"0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03","Type":"ContainerStarted","Data":"25efb9dcf523a57fd155889866971ee1a93e1f360a436c1acb1bcf6793e7ec15"}
Jul 07 14:14:52.739643 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:52.739612    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r" event={"ID":"3bb224bf-cd7a-476a-b30a-2b9207e15c0c","Type":"ContainerStarted","Data":"8e04cba21cecb68363e8723648fd3f54ecf296b5fe26e90bc95b1003355d5c5f"}
Jul 07 14:14:52.740905 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:52.740882    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp" event={"ID":"b8cf52e3-e469-407d-b9db-5f416d7e953f","Type":"ContainerStarted","Data":"a0b3d13e13fbe56625a680329e4ad9cdaa7e2586b76744e25da17686890e4e5e"}
Jul 07 14:14:52.756939 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:52.756921    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:52.763046 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:52.763009    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp" podStartSLOduration=1.2056994460000001 podStartE2EDuration="3.762996214s" totalImagesPullingTime="2.557296768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:52.761442151 +0000 UTC m=+482.123765348" watchObservedRunningTime="2026-07-07 14:14:52.762996214 +0000 UTC m=+482.125319379"
Jul 07 14:14:53.018290 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.018204    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"]
Jul 07 14:14:53.018413 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.018387    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd" podUID="edebd8bf-83ca-41f3-95c5-699305304351" containerName="discovery" containerID="cri-o://df4021ad33e8bbe0809bd00817da396436148f15172b4596db90195ca1c261a1" gracePeriod=30
Jul 07 14:14:53.271189 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.271135    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:53.304839 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.304817    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtsv5\" (UniqueName: \"kubernetes.io/projected/edebd8bf-83ca-41f3-95c5-699305304351-kube-api-access-dtsv5\") pod \"edebd8bf-83ca-41f3-95c5-699305304351\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") "
Jul 07 14:14:53.304960 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.304845    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-istio-kubeconfig\") pod \"edebd8bf-83ca-41f3-95c5-699305304351\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") "
Jul 07 14:14:53.304960 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.304888    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-istio-csr-dns-cert\") pod \"edebd8bf-83ca-41f3-95c5-699305304351\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") "
Jul 07 14:14:53.304960 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.304925    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-cacerts\") pod \"edebd8bf-83ca-41f3-95c5-699305304351\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") "
Jul 07 14:14:53.304960 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.304942    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/edebd8bf-83ca-41f3-95c5-699305304351-local-certs\") pod \"edebd8bf-83ca-41f3-95c5-699305304351\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") "
Jul 07 14:14:53.305149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.304973    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edebd8bf-83ca-41f3-95c5-699305304351-istio-token\") pod \"edebd8bf-83ca-41f3-95c5-699305304351\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") "
Jul 07 14:14:53.305149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.305021    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/edebd8bf-83ca-41f3-95c5-699305304351-istio-csr-ca-configmap\") pod \"edebd8bf-83ca-41f3-95c5-699305304351\" (UID: \"edebd8bf-83ca-41f3-95c5-699305304351\") "
Jul 07 14:14:53.305580 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.305541    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edebd8bf-83ca-41f3-95c5-699305304351-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "edebd8bf-83ca-41f3-95c5-699305304351" (UID: "edebd8bf-83ca-41f3-95c5-699305304351"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:14:53.307220 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.307146    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "edebd8bf-83ca-41f3-95c5-699305304351" (UID: "edebd8bf-83ca-41f3-95c5-699305304351"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:14:53.307220 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.307194    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "edebd8bf-83ca-41f3-95c5-699305304351" (UID: "edebd8bf-83ca-41f3-95c5-699305304351"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:14:53.307380 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.307350    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-cacerts" (OuterVolumeSpecName: "cacerts") pod "edebd8bf-83ca-41f3-95c5-699305304351" (UID: "edebd8bf-83ca-41f3-95c5-699305304351"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:14:53.307415 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.307377    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edebd8bf-83ca-41f3-95c5-699305304351-local-certs" (OuterVolumeSpecName: "local-certs") pod "edebd8bf-83ca-41f3-95c5-699305304351" (UID: "edebd8bf-83ca-41f3-95c5-699305304351"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:14:53.307415 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.307391    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edebd8bf-83ca-41f3-95c5-699305304351-istio-token" (OuterVolumeSpecName: "istio-token") pod "edebd8bf-83ca-41f3-95c5-699305304351" (UID: "edebd8bf-83ca-41f3-95c5-699305304351"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:14:53.307487 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.307403    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edebd8bf-83ca-41f3-95c5-699305304351-kube-api-access-dtsv5" (OuterVolumeSpecName: "kube-api-access-dtsv5") pod "edebd8bf-83ca-41f3-95c5-699305304351" (UID: "edebd8bf-83ca-41f3-95c5-699305304351"). InnerVolumeSpecName "kube-api-access-dtsv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:14:53.406101 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.406071    2557 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-cacerts\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:14:53.406101 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.406098    2557 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/edebd8bf-83ca-41f3-95c5-699305304351-local-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:14:53.406101 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.406108    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edebd8bf-83ca-41f3-95c5-699305304351-istio-token\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:14:53.406321 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.406119    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/edebd8bf-83ca-41f3-95c5-699305304351-istio-csr-ca-configmap\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:14:53.406321 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.406128    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtsv5\" (UniqueName: \"kubernetes.io/projected/edebd8bf-83ca-41f3-95c5-699305304351-kube-api-access-dtsv5\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:14:53.406321 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.406136    2557 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-istio-kubeconfig\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:14:53.406321 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.406144    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/edebd8bf-83ca-41f3-95c5-699305304351-istio-csr-dns-cert\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:14:53.746620 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.746585    2557 generic.go:356] "Generic (PLEG): container finished" podID="edebd8bf-83ca-41f3-95c5-699305304351" containerID="df4021ad33e8bbe0809bd00817da396436148f15172b4596db90195ca1c261a1" exitCode=0
Jul 07 14:14:53.747045 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.746797    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd" event={"ID":"edebd8bf-83ca-41f3-95c5-699305304351","Type":"ContainerDied","Data":"df4021ad33e8bbe0809bd00817da396436148f15172b4596db90195ca1c261a1"}
Jul 07 14:14:53.747045 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.746848    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd" event={"ID":"edebd8bf-83ca-41f3-95c5-699305304351","Type":"ContainerDied","Data":"e3933bbc79d34be7e7755572d72ba4cbec47e0ee38a322da0bbbdcb88dd3ee8b"}
Jul 07 14:14:53.747045 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.746876    2557 scope.go:117] "RemoveContainer" containerID="df4021ad33e8bbe0809bd00817da396436148f15172b4596db90195ca1c261a1"
Jul 07 14:14:53.747045 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.746941    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"
Jul 07 14:14:53.762087 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.762066    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:53.769717 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.769694    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"]
Jul 07 14:14:53.773830 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.773813    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7k2hd"]
Jul 07 14:14:53.837133 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.837096    2557 scope.go:117] "RemoveContainer" containerID="df4021ad33e8bbe0809bd00817da396436148f15172b4596db90195ca1c261a1"
Jul 07 14:14:53.837607 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:14:53.837520    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df4021ad33e8bbe0809bd00817da396436148f15172b4596db90195ca1c261a1\": container with ID starting with df4021ad33e8bbe0809bd00817da396436148f15172b4596db90195ca1c261a1 not found: ID does not exist" containerID="df4021ad33e8bbe0809bd00817da396436148f15172b4596db90195ca1c261a1"
Jul 07 14:14:53.837607 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:53.837563    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4021ad33e8bbe0809bd00817da396436148f15172b4596db90195ca1c261a1"} err="failed to get container status \"df4021ad33e8bbe0809bd00817da396436148f15172b4596db90195ca1c261a1\": rpc error: code = NotFound desc = could not find container \"df4021ad33e8bbe0809bd00817da396436148f15172b4596db90195ca1c261a1\": container with ID starting with df4021ad33e8bbe0809bd00817da396436148f15172b4596db90195ca1c261a1 not found: ID does not exist"
Jul 07 14:14:54.701517 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:54.701487    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ggb46"
Jul 07 14:14:54.753363 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:54.753305    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:54.754566 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:54.754547    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf462jcp"
Jul 07 14:14:55.115987 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:55.115956    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edebd8bf-83ca-41f3-95c5-699305304351" path="/var/lib/kubelet/pods/edebd8bf-83ca-41f3-95c5-699305304351/volumes"
Jul 07 14:14:56.712960 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:56.712878    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9xbjv"
Jul 07 14:14:56.763741 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:56.763709    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582" event={"ID":"0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03","Type":"ContainerStarted","Data":"49f15dd29714388f254548e51f28b71827e34c42524b83a79cf6f2994668fef9"}
Jul 07 14:14:56.764445 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:56.764425    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"
Jul 07 14:14:56.766041 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:56.766016    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r" event={"ID":"3bb224bf-cd7a-476a-b30a-2b9207e15c0c","Type":"ContainerStarted","Data":"89ed341dec74c646ded4295af30cd4ba496f852d49f73b58cd6fd3ab11ae040c"}
Jul 07 14:14:56.766153 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:56.766129    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r"
Jul 07 14:14:56.797586 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:56.797534    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582" podStartSLOduration=1.980147144 podStartE2EDuration="5.797512708s" totalImagesPullingTime="3.817365564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:56.794385228 +0000 UTC m=+486.156708393" watchObservedRunningTime="2026-07-07 14:14:56.797512708 +0000 UTC m=+486.159835874"
Jul 07 14:14:56.823959 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:14:56.823900    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r" podStartSLOduration=1.977442868 podStartE2EDuration="5.823877633s" totalImagesPullingTime="3.846434765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:56.823199377 +0000 UTC m=+486.185522542" watchObservedRunningTime="2026-07-07 14:14:56.823877633 +0000 UTC m=+486.186200798"
Jul 07 14:15:27.775142 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:27.775107    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lbb7r"
Jul 07 14:15:28.776603 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:28.776574    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-nk582"
Jul 07 14:15:40.544366 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.544332    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9bwc"]
Jul 07 14:15:40.544723 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.544603    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edebd8bf-83ca-41f3-95c5-699305304351" containerName="discovery"
Jul 07 14:15:40.544723 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.544615    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="edebd8bf-83ca-41f3-95c5-699305304351" containerName="discovery"
Jul 07 14:15:40.544723 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.544664    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="edebd8bf-83ca-41f3-95c5-699305304351" containerName="discovery"
Jul 07 14:15:40.558655 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.558580    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v9bwc"
Jul 07 14:15:40.560826 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.560796    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9bwc"]
Jul 07 14:15:40.561916 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.561888    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 14:15:40.562042 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.561935    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-h55wk\""
Jul 07 14:15:40.563096 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.563074    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 14:15:40.565910 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.565887    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m2wk\" (UniqueName: \"kubernetes.io/projected/25519837-566c-45a1-8b5a-d679b135534c-kube-api-access-5m2wk\") pod \"kuadrant-operator-catalog-v9bwc\" (UID: \"25519837-566c-45a1-8b5a-d679b135534c\") " pod="kuadrant-system/kuadrant-operator-catalog-v9bwc"
Jul 07 14:15:40.667028 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.666994    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m2wk\" (UniqueName: \"kubernetes.io/projected/25519837-566c-45a1-8b5a-d679b135534c-kube-api-access-5m2wk\") pod \"kuadrant-operator-catalog-v9bwc\" (UID: \"25519837-566c-45a1-8b5a-d679b135534c\") " pod="kuadrant-system/kuadrant-operator-catalog-v9bwc"
Jul 07 14:15:40.674885 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.674865    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m2wk\" (UniqueName: \"kubernetes.io/projected/25519837-566c-45a1-8b5a-d679b135534c-kube-api-access-5m2wk\") pod \"kuadrant-operator-catalog-v9bwc\" (UID: \"25519837-566c-45a1-8b5a-d679b135534c\") " pod="kuadrant-system/kuadrant-operator-catalog-v9bwc"
Jul 07 14:15:40.868913 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.868884    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v9bwc"
Jul 07 14:15:40.907656 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.907632    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9bwc"]
Jul 07 14:15:40.989899 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:40.989869    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9bwc"]
Jul 07 14:15:40.992709 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:15:40.992684    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25519837_566c_45a1_8b5a_d679b135534c.slice/crio-79344b59337e0b8da9e18e4c66f271776b14b8511d38b3d274302de8967a72b9 WatchSource:0}: Error finding container 79344b59337e0b8da9e18e4c66f271776b14b8511d38b3d274302de8967a72b9: Status 404 returned error can't find the container with id 79344b59337e0b8da9e18e4c66f271776b14b8511d38b3d274302de8967a72b9
Jul 07 14:15:41.116823 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:41.116791    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pt6rj"]
Jul 07 14:15:41.119644 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:41.119605    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pt6rj"
Jul 07 14:15:41.126704 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:41.126683    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pt6rj"]
Jul 07 14:15:41.170360 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:41.170334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8hw8\" (UniqueName: \"kubernetes.io/projected/4085c432-3a99-4779-bae0-1eb98d19c2f5-kube-api-access-x8hw8\") pod \"kuadrant-operator-catalog-pt6rj\" (UID: \"4085c432-3a99-4779-bae0-1eb98d19c2f5\") " pod="kuadrant-system/kuadrant-operator-catalog-pt6rj"
Jul 07 14:15:41.270862 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:41.270841    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8hw8\" (UniqueName: \"kubernetes.io/projected/4085c432-3a99-4779-bae0-1eb98d19c2f5-kube-api-access-x8hw8\") pod \"kuadrant-operator-catalog-pt6rj\" (UID: \"4085c432-3a99-4779-bae0-1eb98d19c2f5\") " pod="kuadrant-system/kuadrant-operator-catalog-pt6rj"
Jul 07 14:15:41.278824 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:41.278799    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8hw8\" (UniqueName: \"kubernetes.io/projected/4085c432-3a99-4779-bae0-1eb98d19c2f5-kube-api-access-x8hw8\") pod \"kuadrant-operator-catalog-pt6rj\" (UID: \"4085c432-3a99-4779-bae0-1eb98d19c2f5\") " pod="kuadrant-system/kuadrant-operator-catalog-pt6rj"
Jul 07 14:15:41.428981 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:41.428917    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pt6rj"
Jul 07 14:15:41.555171 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:41.555144    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pt6rj"]
Jul 07 14:15:41.557398 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:15:41.557361    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4085c432_3a99_4779_bae0_1eb98d19c2f5.slice/crio-c55c4c2366883781341fe70fb21ae4a2bfe8c4e85464f62494f75dcf5d8d3dd3 WatchSource:0}: Error finding container c55c4c2366883781341fe70fb21ae4a2bfe8c4e85464f62494f75dcf5d8d3dd3: Status 404 returned error can't find the container with id c55c4c2366883781341fe70fb21ae4a2bfe8c4e85464f62494f75dcf5d8d3dd3
Jul 07 14:15:41.940132 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:41.940097    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pt6rj" event={"ID":"4085c432-3a99-4779-bae0-1eb98d19c2f5","Type":"ContainerStarted","Data":"c55c4c2366883781341fe70fb21ae4a2bfe8c4e85464f62494f75dcf5d8d3dd3"}
Jul 07 14:15:41.941548 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:41.941524    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v9bwc" event={"ID":"25519837-566c-45a1-8b5a-d679b135534c","Type":"ContainerStarted","Data":"79344b59337e0b8da9e18e4c66f271776b14b8511d38b3d274302de8967a72b9"}
Jul 07 14:15:43.950507 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:43.950471    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pt6rj" event={"ID":"4085c432-3a99-4779-bae0-1eb98d19c2f5","Type":"ContainerStarted","Data":"e18902366e465d2e9b781231d88aa118f951f6fd7c1497da1fb0e76a39002d5b"}
Jul 07 14:15:43.951771 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:43.951748    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v9bwc" event={"ID":"25519837-566c-45a1-8b5a-d679b135534c","Type":"ContainerStarted","Data":"2c0a74753b4bde5bb905c5d28626df7fb1a47bddc264bca8083f9a6134c44f73"}
Jul 07 14:15:43.951845 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:43.951822    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-v9bwc" podUID="25519837-566c-45a1-8b5a-d679b135534c" containerName="registry-server" containerID="cri-o://2c0a74753b4bde5bb905c5d28626df7fb1a47bddc264bca8083f9a6134c44f73" gracePeriod=2
Jul 07 14:15:43.968947 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:43.968907    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pt6rj" podStartSLOduration=1.538049708 podStartE2EDuration="2.968892585s" totalImagesPullingTime="1.430842877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:15:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:15:43.967501321 +0000 UTC m=+533.329824499" watchObservedRunningTime="2026-07-07 14:15:43.968892585 +0000 UTC m=+533.331215751"
Jul 07 14:15:43.982946 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:43.982913    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-v9bwc" podStartSLOduration=2.020027242 podStartE2EDuration="3.982902844s" totalImagesPullingTime="1.962875602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:15:43.982433721 +0000 UTC m=+533.344756888" watchObservedRunningTime="2026-07-07 14:15:43.982902844 +0000 UTC m=+533.345226010"
Jul 07 14:15:44.188142 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:44.188122    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v9bwc"
Jul 07 14:15:44.193723 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:44.193705    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m2wk\" (UniqueName: \"kubernetes.io/projected/25519837-566c-45a1-8b5a-d679b135534c-kube-api-access-5m2wk\") pod \"25519837-566c-45a1-8b5a-d679b135534c\" (UID: \"25519837-566c-45a1-8b5a-d679b135534c\") "
Jul 07 14:15:44.195614 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:44.195590    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25519837-566c-45a1-8b5a-d679b135534c-kube-api-access-5m2wk" (OuterVolumeSpecName: "kube-api-access-5m2wk") pod "25519837-566c-45a1-8b5a-d679b135534c" (UID: "25519837-566c-45a1-8b5a-d679b135534c"). InnerVolumeSpecName "kube-api-access-5m2wk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:15:44.294415 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:44.294365    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m2wk\" (UniqueName: \"kubernetes.io/projected/25519837-566c-45a1-8b5a-d679b135534c-kube-api-access-5m2wk\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:15:44.956813 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:44.956783    2557 generic.go:356] "Generic (PLEG): container finished" podID="25519837-566c-45a1-8b5a-d679b135534c" containerID="2c0a74753b4bde5bb905c5d28626df7fb1a47bddc264bca8083f9a6134c44f73" exitCode=0
Jul 07 14:15:44.957260 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:44.956823    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v9bwc"
Jul 07 14:15:44.957260 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:44.956863    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v9bwc" event={"ID":"25519837-566c-45a1-8b5a-d679b135534c","Type":"ContainerDied","Data":"2c0a74753b4bde5bb905c5d28626df7fb1a47bddc264bca8083f9a6134c44f73"}
Jul 07 14:15:44.957260 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:44.956907    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v9bwc" event={"ID":"25519837-566c-45a1-8b5a-d679b135534c","Type":"ContainerDied","Data":"79344b59337e0b8da9e18e4c66f271776b14b8511d38b3d274302de8967a72b9"}
Jul 07 14:15:44.957260 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:44.956927    2557 scope.go:117] "RemoveContainer" containerID="2c0a74753b4bde5bb905c5d28626df7fb1a47bddc264bca8083f9a6134c44f73"
Jul 07 14:15:44.969793 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:44.969773    2557 scope.go:117] "RemoveContainer" containerID="2c0a74753b4bde5bb905c5d28626df7fb1a47bddc264bca8083f9a6134c44f73"
Jul 07 14:15:44.970047 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:15:44.970027    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c0a74753b4bde5bb905c5d28626df7fb1a47bddc264bca8083f9a6134c44f73\": container with ID starting with 2c0a74753b4bde5bb905c5d28626df7fb1a47bddc264bca8083f9a6134c44f73 not found: ID does not exist" containerID="2c0a74753b4bde5bb905c5d28626df7fb1a47bddc264bca8083f9a6134c44f73"
Jul 07 14:15:44.970103 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:44.970055    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c0a74753b4bde5bb905c5d28626df7fb1a47bddc264bca8083f9a6134c44f73"} err="failed to get container status \"2c0a74753b4bde5bb905c5d28626df7fb1a47bddc264bca8083f9a6134c44f73\": rpc error: code = NotFound desc = could not find container \"2c0a74753b4bde5bb905c5d28626df7fb1a47bddc264bca8083f9a6134c44f73\": container with ID starting with 2c0a74753b4bde5bb905c5d28626df7fb1a47bddc264bca8083f9a6134c44f73 not found: ID does not exist"
Jul 07 14:15:44.983575 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:44.983555    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9bwc"]
Jul 07 14:15:44.986803 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:44.986783    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9bwc"]
Jul 07 14:15:45.117510 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:45.117480    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25519837-566c-45a1-8b5a-d679b135534c" path="/var/lib/kubelet/pods/25519837-566c-45a1-8b5a-d679b135534c/volumes"
Jul 07 14:15:51.430150 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:51.430094    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pt6rj"
Jul 07 14:15:51.430150 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:51.430168    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pt6rj"
Jul 07 14:15:51.452140 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:51.452112    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pt6rj"
Jul 07 14:15:52.007598 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:15:52.007573    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pt6rj"
Jul 07 14:16:12.534608 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:12.534575    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wftvg"]
Jul 07 14:16:12.535060 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:12.534861    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25519837-566c-45a1-8b5a-d679b135534c" containerName="registry-server"
Jul 07 14:16:12.535060 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:12.534871    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="25519837-566c-45a1-8b5a-d679b135534c" containerName="registry-server"
Jul 07 14:16:12.535060 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:12.534927    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="25519837-566c-45a1-8b5a-d679b135534c" containerName="registry-server"
Jul 07 14:16:12.536781 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:12.536765    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wftvg"
Jul 07 14:16:12.539905 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:12.539874    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-h97b7\""
Jul 07 14:16:12.540059 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:12.539905    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 14:16:12.546853 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:12.546829    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wftvg"]
Jul 07 14:16:12.604115 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:12.604087    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2svs\" (UniqueName: \"kubernetes.io/projected/a190aeed-32e9-4741-a1be-86b4dea2dc37-kube-api-access-x2svs\") pod \"dns-operator-controller-manager-864dd78c4c-wftvg\" (UID: \"a190aeed-32e9-4741-a1be-86b4dea2dc37\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wftvg"
Jul 07 14:16:12.704788 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:12.704754    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2svs\" (UniqueName: \"kubernetes.io/projected/a190aeed-32e9-4741-a1be-86b4dea2dc37-kube-api-access-x2svs\") pod \"dns-operator-controller-manager-864dd78c4c-wftvg\" (UID: \"a190aeed-32e9-4741-a1be-86b4dea2dc37\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wftvg"
Jul 07 14:16:12.721705 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:12.721681    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2svs\" (UniqueName: \"kubernetes.io/projected/a190aeed-32e9-4741-a1be-86b4dea2dc37-kube-api-access-x2svs\") pod \"dns-operator-controller-manager-864dd78c4c-wftvg\" (UID: \"a190aeed-32e9-4741-a1be-86b4dea2dc37\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wftvg"
Jul 07 14:16:12.846016 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:12.845991    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wftvg"
Jul 07 14:16:12.974329 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:12.974307    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wftvg"]
Jul 07 14:16:12.976633 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:16:12.976604    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda190aeed_32e9_4741_a1be_86b4dea2dc37.slice/crio-3b4b748953dfbf58645a1a168c8d818e702303c59dc95fcb7ae780261dff9be8 WatchSource:0}: Error finding container 3b4b748953dfbf58645a1a168c8d818e702303c59dc95fcb7ae780261dff9be8: Status 404 returned error can't find the container with id 3b4b748953dfbf58645a1a168c8d818e702303c59dc95fcb7ae780261dff9be8
Jul 07 14:16:13.065944 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:13.065910    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wftvg" event={"ID":"a190aeed-32e9-4741-a1be-86b4dea2dc37","Type":"ContainerStarted","Data":"3b4b748953dfbf58645a1a168c8d818e702303c59dc95fcb7ae780261dff9be8"}
Jul 07 14:16:16.079416 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:16.079383    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wftvg" event={"ID":"a190aeed-32e9-4741-a1be-86b4dea2dc37","Type":"ContainerStarted","Data":"9038e152f1b038b4f00b69ed24b40dca2b677ea36b31224b65b2f405ff788db5"}
Jul 07 14:16:16.079756 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:16.079546    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wftvg"
Jul 07 14:16:17.942921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:17.942868    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wftvg" podStartSLOduration=3.316559206 podStartE2EDuration="5.942848741s" totalImagesPullingTime="2.626289535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:16:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:16:16.096161303 +0000 UTC m=+565.458484500" watchObservedRunningTime="2026-07-07 14:16:17.942848741 +0000 UTC m=+567.305171908"
Jul 07 14:16:17.948219 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:17.944218    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"]
Jul 07 14:16:17.950793 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:17.950754    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:17.954199 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:17.954178    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jgl9n\""
Jul 07 14:16:17.977336 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:17.977283    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"]
Jul 07 14:16:18.047825 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:18.047804    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkr7f\" (UniqueName: \"kubernetes.io/projected/cb749f31-7866-42f2-93af-fa49a3a4a01a-kube-api-access-pkr7f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" (UID: \"cb749f31-7866-42f2-93af-fa49a3a4a01a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:18.047971 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:18.047842    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb749f31-7866-42f2-93af-fa49a3a4a01a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" (UID: \"cb749f31-7866-42f2-93af-fa49a3a4a01a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:18.148317 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:18.148294    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkr7f\" (UniqueName: \"kubernetes.io/projected/cb749f31-7866-42f2-93af-fa49a3a4a01a-kube-api-access-pkr7f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" (UID: \"cb749f31-7866-42f2-93af-fa49a3a4a01a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:18.148440 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:18.148332    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb749f31-7866-42f2-93af-fa49a3a4a01a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" (UID: \"cb749f31-7866-42f2-93af-fa49a3a4a01a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:18.148655 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:18.148639    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb749f31-7866-42f2-93af-fa49a3a4a01a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" (UID: \"cb749f31-7866-42f2-93af-fa49a3a4a01a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:18.165644 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:18.165621    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkr7f\" (UniqueName: \"kubernetes.io/projected/cb749f31-7866-42f2-93af-fa49a3a4a01a-kube-api-access-pkr7f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" (UID: \"cb749f31-7866-42f2-93af-fa49a3a4a01a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:18.261704 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:18.261638    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:18.392614 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:18.392584    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"]
Jul 07 14:16:18.395699 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:16:18.395674    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb749f31_7866_42f2_93af_fa49a3a4a01a.slice/crio-32674152c86fa2eb93bcf92f3697578b78dbeb162fbe736ac863aad2a0262a3a WatchSource:0}: Error finding container 32674152c86fa2eb93bcf92f3697578b78dbeb162fbe736ac863aad2a0262a3a: Status 404 returned error can't find the container with id 32674152c86fa2eb93bcf92f3697578b78dbeb162fbe736ac863aad2a0262a3a
Jul 07 14:16:19.092001 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:19.091965    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs" event={"ID":"cb749f31-7866-42f2-93af-fa49a3a4a01a","Type":"ContainerStarted","Data":"32674152c86fa2eb93bcf92f3697578b78dbeb162fbe736ac863aad2a0262a3a"}
Jul 07 14:16:22.014024 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:22.013995    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"]
Jul 07 14:16:22.016240 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:22.016207    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:22.018798 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:22.018778    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dx6dv\""
Jul 07 14:16:22.029729 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:22.029707    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"]
Jul 07 14:16:22.077286 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:22.077261    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5zj7\" (UniqueName: \"kubernetes.io/projected/4903b474-477c-443c-9d3e-05f0bc3ccfb6-kube-api-access-j5zj7\") pod \"limitador-operator-controller-manager-859d7b78bd-llsf7\" (UID: \"4903b474-477c-443c-9d3e-05f0bc3ccfb6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:22.178113 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:22.178087    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5zj7\" (UniqueName: \"kubernetes.io/projected/4903b474-477c-443c-9d3e-05f0bc3ccfb6-kube-api-access-j5zj7\") pod \"limitador-operator-controller-manager-859d7b78bd-llsf7\" (UID: \"4903b474-477c-443c-9d3e-05f0bc3ccfb6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:22.185966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:22.185939    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5zj7\" (UniqueName: \"kubernetes.io/projected/4903b474-477c-443c-9d3e-05f0bc3ccfb6-kube-api-access-j5zj7\") pod \"limitador-operator-controller-manager-859d7b78bd-llsf7\" (UID: \"4903b474-477c-443c-9d3e-05f0bc3ccfb6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:22.326279 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:22.326256    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:22.457360 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:22.457276    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"]
Jul 07 14:16:22.459855 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:16:22.459826    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4903b474_477c_443c_9d3e_05f0bc3ccfb6.slice/crio-6c5258378a3d297c687111dab6d5434522ce842419f435d800347217e61f843b WatchSource:0}: Error finding container 6c5258378a3d297c687111dab6d5434522ce842419f435d800347217e61f843b: Status 404 returned error can't find the container with id 6c5258378a3d297c687111dab6d5434522ce842419f435d800347217e61f843b
Jul 07 14:16:23.110085 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:23.110048    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7" event={"ID":"4903b474-477c-443c-9d3e-05f0bc3ccfb6","Type":"ContainerStarted","Data":"6c5258378a3d297c687111dab6d5434522ce842419f435d800347217e61f843b"}
Jul 07 14:16:25.473859 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:25.473826    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h45t2"]
Jul 07 14:16:25.476531 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:25.476513    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h45t2"
Jul 07 14:16:25.479044 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:25.479026    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-q7zqn\""
Jul 07 14:16:25.485559 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:25.485531    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h45t2"]
Jul 07 14:16:25.606444 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:25.606412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rprjn\" (UniqueName: \"kubernetes.io/projected/3863f54e-3835-42c2-9bd0-77056e1847b2-kube-api-access-rprjn\") pod \"authorino-operator-75cc8d5cb7-h45t2\" (UID: \"3863f54e-3835-42c2-9bd0-77056e1847b2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h45t2"
Jul 07 14:16:25.707774 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:25.707696    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rprjn\" (UniqueName: \"kubernetes.io/projected/3863f54e-3835-42c2-9bd0-77056e1847b2-kube-api-access-rprjn\") pod \"authorino-operator-75cc8d5cb7-h45t2\" (UID: \"3863f54e-3835-42c2-9bd0-77056e1847b2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h45t2"
Jul 07 14:16:25.719811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:25.719778    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rprjn\" (UniqueName: \"kubernetes.io/projected/3863f54e-3835-42c2-9bd0-77056e1847b2-kube-api-access-rprjn\") pod \"authorino-operator-75cc8d5cb7-h45t2\" (UID: \"3863f54e-3835-42c2-9bd0-77056e1847b2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-h45t2"
Jul 07 14:16:25.787393 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:25.787360    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h45t2"
Jul 07 14:16:26.131454 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:26.131418    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs" event={"ID":"cb749f31-7866-42f2-93af-fa49a3a4a01a","Type":"ContainerStarted","Data":"5d3cf256f2fba54a8a7424c9bed2e675dc87a61c237e184255eeb41672c5830a"}
Jul 07 14:16:26.131607 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:26.131530    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:26.155560 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:26.155509    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs" podStartSLOduration=2.190071239 podStartE2EDuration="9.15549188s" totalImagesPullingTime="6.965420641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:16:26.1534987 +0000 UTC m=+575.515821865" watchObservedRunningTime="2026-07-07 14:16:26.15549188 +0000 UTC m=+575.517815045"
Jul 07 14:16:26.225978 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:26.225956    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-h45t2"]
Jul 07 14:16:26.228480 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:16:26.228455    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3863f54e_3835_42c2_9bd0_77056e1847b2.slice/crio-19be9625e6cf4c955ba40335cdc2452e125c7288d9d26f49b6a24afb0156cf1c WatchSource:0}: Error finding container 19be9625e6cf4c955ba40335cdc2452e125c7288d9d26f49b6a24afb0156cf1c: Status 404 returned error can't find the container with id 19be9625e6cf4c955ba40335cdc2452e125c7288d9d26f49b6a24afb0156cf1c
Jul 07 14:16:27.085810 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:27.085782    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wftvg"
Jul 07 14:16:27.138552 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:27.138502    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h45t2" event={"ID":"3863f54e-3835-42c2-9bd0-77056e1847b2","Type":"ContainerStarted","Data":"19be9625e6cf4c955ba40335cdc2452e125c7288d9d26f49b6a24afb0156cf1c"}
Jul 07 14:16:27.140625 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:27.140596    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7" event={"ID":"4903b474-477c-443c-9d3e-05f0bc3ccfb6","Type":"ContainerStarted","Data":"630f44ef54bf76f7d7053438e11d70454dc79c229063ba7b36013a1dba73c72f"}
Jul 07 14:16:27.140883 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:27.140862    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:27.157862 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:27.157808    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7" podStartSLOduration=2.479973211 podStartE2EDuration="6.157792181s" totalImagesPullingTime="3.67781897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:16:27.156277624 +0000 UTC m=+576.518600792" watchObservedRunningTime="2026-07-07 14:16:27.157792181 +0000 UTC m=+576.520115346"
Jul 07 14:16:28.390094 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.390060    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"]
Jul 07 14:16:28.392807 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.392792    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"
Jul 07 14:16:28.395623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.395560    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 14:16:28.395870 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.395846    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k7vsj\""
Jul 07 14:16:28.395985 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.395866    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 14:16:28.407459 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.405549    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"]
Jul 07 14:16:28.531966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.531912    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/13a2718f-3b7c-422e-8aff-bf6924646a91-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2k6qc\" (UID: \"13a2718f-3b7c-422e-8aff-bf6924646a91\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"
Jul 07 14:16:28.532139 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.531978    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13a2718f-3b7c-422e-8aff-bf6924646a91-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2k6qc\" (UID: \"13a2718f-3b7c-422e-8aff-bf6924646a91\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"
Jul 07 14:16:28.532139 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.532005    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f48t5\" (UniqueName: \"kubernetes.io/projected/13a2718f-3b7c-422e-8aff-bf6924646a91-kube-api-access-f48t5\") pod \"kuadrant-console-plugin-66b5774985-2k6qc\" (UID: \"13a2718f-3b7c-422e-8aff-bf6924646a91\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"
Jul 07 14:16:28.632531 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.632490    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/13a2718f-3b7c-422e-8aff-bf6924646a91-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2k6qc\" (UID: \"13a2718f-3b7c-422e-8aff-bf6924646a91\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"
Jul 07 14:16:28.632531 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.632543    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13a2718f-3b7c-422e-8aff-bf6924646a91-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2k6qc\" (UID: \"13a2718f-3b7c-422e-8aff-bf6924646a91\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"
Jul 07 14:16:28.632780 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.632571    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f48t5\" (UniqueName: \"kubernetes.io/projected/13a2718f-3b7c-422e-8aff-bf6924646a91-kube-api-access-f48t5\") pod \"kuadrant-console-plugin-66b5774985-2k6qc\" (UID: \"13a2718f-3b7c-422e-8aff-bf6924646a91\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"
Jul 07 14:16:28.633546 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.633520    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/13a2718f-3b7c-422e-8aff-bf6924646a91-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2k6qc\" (UID: \"13a2718f-3b7c-422e-8aff-bf6924646a91\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"
Jul 07 14:16:28.635263 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.635216    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/13a2718f-3b7c-422e-8aff-bf6924646a91-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2k6qc\" (UID: \"13a2718f-3b7c-422e-8aff-bf6924646a91\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"
Jul 07 14:16:28.642289 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.642212    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f48t5\" (UniqueName: \"kubernetes.io/projected/13a2718f-3b7c-422e-8aff-bf6924646a91-kube-api-access-f48t5\") pod \"kuadrant-console-plugin-66b5774985-2k6qc\" (UID: \"13a2718f-3b7c-422e-8aff-bf6924646a91\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"
Jul 07 14:16:28.706197 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.706175    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"
Jul 07 14:16:28.830316 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:28.830292    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc"]
Jul 07 14:16:28.832587 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:16:28.832560    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13a2718f_3b7c_422e_8aff_bf6924646a91.slice/crio-8d09df92cc8e0e3bffadb15f872d9aed79aa1e14dd08768221c8a9b399f4f660 WatchSource:0}: Error finding container 8d09df92cc8e0e3bffadb15f872d9aed79aa1e14dd08768221c8a9b399f4f660: Status 404 returned error can't find the container with id 8d09df92cc8e0e3bffadb15f872d9aed79aa1e14dd08768221c8a9b399f4f660
Jul 07 14:16:29.150107 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:29.150069    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc" event={"ID":"13a2718f-3b7c-422e-8aff-bf6924646a91","Type":"ContainerStarted","Data":"8d09df92cc8e0e3bffadb15f872d9aed79aa1e14dd08768221c8a9b399f4f660"}
Jul 07 14:16:29.151468 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:29.151449    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h45t2" event={"ID":"3863f54e-3835-42c2-9bd0-77056e1847b2","Type":"ContainerStarted","Data":"59a17489e9b1ee4bba356849da6115fd0683b28b0fb03610d804f4ba75329311"}
Jul 07 14:16:29.151581 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:29.151571    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h45t2"
Jul 07 14:16:29.169955 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:29.169916    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h45t2" podStartSLOduration=1.720655443 podStartE2EDuration="4.169904991s" totalImagesPullingTime="2.449249548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:16:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:16:29.167626154 +0000 UTC m=+578.529949342" watchObservedRunningTime="2026-07-07 14:16:29.169904991 +0000 UTC m=+578.532228158"
Jul 07 14:16:37.142990 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:37.142960    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:38.148217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:38.148188    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:39.102639 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.102606    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"]
Jul 07 14:16:39.102851 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.102823    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs" podUID="cb749f31-7866-42f2-93af-fa49a3a4a01a" containerName="manager" containerID="cri-o://5d3cf256f2fba54a8a7424c9bed2e675dc87a61c237e184255eeb41672c5830a" gracePeriod=2
Jul 07 14:16:39.116019 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:39.115966    2557 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cb749f31-7866-42f2-93af-fa49a3a4a01a\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-68jhs\": pods \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:39.121316 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.121293    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"]
Jul 07 14:16:39.131016 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.130992    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"]
Jul 07 14:16:39.131504 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.131486    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb749f31-7866-42f2-93af-fa49a3a4a01a" containerName="manager"
Jul 07 14:16:39.131504 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.131506    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb749f31-7866-42f2-93af-fa49a3a4a01a" containerName="manager"
Jul 07 14:16:39.131653 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.131581    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb749f31-7866-42f2-93af-fa49a3a4a01a" containerName="manager"
Jul 07 14:16:39.140222 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.140198    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"]
Jul 07 14:16:39.140341 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.140283    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"
Jul 07 14:16:39.140753 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.140409    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7" podUID="4903b474-477c-443c-9d3e-05f0bc3ccfb6" containerName="manager" containerID="cri-o://630f44ef54bf76f7d7053438e11d70454dc79c229063ba7b36013a1dba73c72f" gracePeriod=2
Jul 07 14:16:39.142645 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.142621    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"]
Jul 07 14:16:39.145252 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:39.144788    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-llsf7\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="4903b474-477c-443c-9d3e-05f0bc3ccfb6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:39.148064 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:39.148029    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="cb749f31-7866-42f2-93af-fa49a3a4a01a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:39.148167 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.148040    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"]
Jul 07 14:16:39.161514 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.161491    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w6cq8"]
Jul 07 14:16:39.161935 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.161786    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4903b474-477c-443c-9d3e-05f0bc3ccfb6" containerName="manager"
Jul 07 14:16:39.161935 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.161798    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4903b474-477c-443c-9d3e-05f0bc3ccfb6" containerName="manager"
Jul 07 14:16:39.161935 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.161862    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4903b474-477c-443c-9d3e-05f0bc3ccfb6" containerName="manager"
Jul 07 14:16:39.168401 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.168378    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w6cq8"
Jul 07 14:16:39.176547 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.176528    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w6cq8"]
Jul 07 14:16:39.179688 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:39.179630    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-llsf7\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="4903b474-477c-443c-9d3e-05f0bc3ccfb6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:39.182027 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:39.181547    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="cb749f31-7866-42f2-93af-fa49a3a4a01a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:39.221756 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.221726    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a8f770-5d5b-4719-a37c-7cd5952c73f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bvpb2\" (UID: \"e4a8f770-5d5b-4719-a37c-7cd5952c73f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"
Jul 07 14:16:39.221929 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.221860    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2sl8\" (UniqueName: \"kubernetes.io/projected/e4a8f770-5d5b-4719-a37c-7cd5952c73f3-kube-api-access-h2sl8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bvpb2\" (UID: \"e4a8f770-5d5b-4719-a37c-7cd5952c73f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"
Jul 07 14:16:39.323312 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.323272    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tknxn\" (UniqueName: \"kubernetes.io/projected/d191e1e1-ef33-4335-9378-ee99663ed828-kube-api-access-tknxn\") pod \"limitador-operator-controller-manager-859d7b78bd-w6cq8\" (UID: \"d191e1e1-ef33-4335-9378-ee99663ed828\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w6cq8"
Jul 07 14:16:39.323496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.323328    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2sl8\" (UniqueName: \"kubernetes.io/projected/e4a8f770-5d5b-4719-a37c-7cd5952c73f3-kube-api-access-h2sl8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bvpb2\" (UID: \"e4a8f770-5d5b-4719-a37c-7cd5952c73f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"
Jul 07 14:16:39.323496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.323422    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a8f770-5d5b-4719-a37c-7cd5952c73f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bvpb2\" (UID: \"e4a8f770-5d5b-4719-a37c-7cd5952c73f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"
Jul 07 14:16:39.323779 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.323759    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a8f770-5d5b-4719-a37c-7cd5952c73f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bvpb2\" (UID: \"e4a8f770-5d5b-4719-a37c-7cd5952c73f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"
Jul 07 14:16:39.334415 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.334393    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2sl8\" (UniqueName: \"kubernetes.io/projected/e4a8f770-5d5b-4719-a37c-7cd5952c73f3-kube-api-access-h2sl8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bvpb2\" (UID: \"e4a8f770-5d5b-4719-a37c-7cd5952c73f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"
Jul 07 14:16:39.424829 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.424750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tknxn\" (UniqueName: \"kubernetes.io/projected/d191e1e1-ef33-4335-9378-ee99663ed828-kube-api-access-tknxn\") pod \"limitador-operator-controller-manager-859d7b78bd-w6cq8\" (UID: \"d191e1e1-ef33-4335-9378-ee99663ed828\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w6cq8"
Jul 07 14:16:39.439765 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.439734    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tknxn\" (UniqueName: \"kubernetes.io/projected/d191e1e1-ef33-4335-9378-ee99663ed828-kube-api-access-tknxn\") pod \"limitador-operator-controller-manager-859d7b78bd-w6cq8\" (UID: \"d191e1e1-ef33-4335-9378-ee99663ed828\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w6cq8"
Jul 07 14:16:39.539354 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.539316    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"
Jul 07 14:16:39.546566 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:39.546537    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w6cq8"
Jul 07 14:16:40.159791 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:40.159763    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-h45t2"
Jul 07 14:16:40.178544 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:40.178504    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-llsf7\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="4903b474-477c-443c-9d3e-05f0bc3ccfb6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:40.180411 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:40.180380    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="cb749f31-7866-42f2-93af-fa49a3a4a01a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:41.117125 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:41.117077    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-llsf7\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="4903b474-477c-443c-9d3e-05f0bc3ccfb6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:41.119208 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:41.119177    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="cb749f31-7866-42f2-93af-fa49a3a4a01a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:51.738152 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:51.737860    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:51.740181 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:51.740153    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="cb749f31-7866-42f2-93af-fa49a3a4a01a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:51.746879 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:51.746861    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:51.748943 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:51.748921    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="cb749f31-7866-42f2-93af-fa49a3a4a01a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:51.750846 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:51.750826    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-llsf7\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="4903b474-477c-443c-9d3e-05f0bc3ccfb6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:51.932387 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:51.932205    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5zj7\" (UniqueName: \"kubernetes.io/projected/4903b474-477c-443c-9d3e-05f0bc3ccfb6-kube-api-access-j5zj7\") pod \"4903b474-477c-443c-9d3e-05f0bc3ccfb6\" (UID: \"4903b474-477c-443c-9d3e-05f0bc3ccfb6\") "
Jul 07 14:16:51.932387 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:51.932326    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkr7f\" (UniqueName: \"kubernetes.io/projected/cb749f31-7866-42f2-93af-fa49a3a4a01a-kube-api-access-pkr7f\") pod \"cb749f31-7866-42f2-93af-fa49a3a4a01a\" (UID: \"cb749f31-7866-42f2-93af-fa49a3a4a01a\") "
Jul 07 14:16:51.932387 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:51.932375    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb749f31-7866-42f2-93af-fa49a3a4a01a-extensions-socket-volume\") pod \"cb749f31-7866-42f2-93af-fa49a3a4a01a\" (UID: \"cb749f31-7866-42f2-93af-fa49a3a4a01a\") "
Jul 07 14:16:51.942603 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:51.932862    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb749f31-7866-42f2-93af-fa49a3a4a01a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cb749f31-7866-42f2-93af-fa49a3a4a01a" (UID: "cb749f31-7866-42f2-93af-fa49a3a4a01a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:16:51.942603 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:51.934195    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4903b474-477c-443c-9d3e-05f0bc3ccfb6-kube-api-access-j5zj7" (OuterVolumeSpecName: "kube-api-access-j5zj7") pod "4903b474-477c-443c-9d3e-05f0bc3ccfb6" (UID: "4903b474-477c-443c-9d3e-05f0bc3ccfb6"). InnerVolumeSpecName "kube-api-access-j5zj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:16:51.942603 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:51.934343    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb749f31-7866-42f2-93af-fa49a3a4a01a-kube-api-access-pkr7f" (OuterVolumeSpecName: "kube-api-access-pkr7f") pod "cb749f31-7866-42f2-93af-fa49a3a4a01a" (UID: "cb749f31-7866-42f2-93af-fa49a3a4a01a"). InnerVolumeSpecName "kube-api-access-pkr7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:16:51.945869 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:51.945797    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w6cq8"]
Jul 07 14:16:51.948492 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:51.948426    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"]
Jul 07 14:16:51.948792 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:16:51.948771    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd191e1e1_ef33_4335_9378_ee99663ed828.slice/crio-73ee2e52aae2c0e662080196770be6fa395f83fb9ca421501d11b7f4a2aee458 WatchSource:0}: Error finding container 73ee2e52aae2c0e662080196770be6fa395f83fb9ca421501d11b7f4a2aee458: Status 404 returned error can't find the container with id 73ee2e52aae2c0e662080196770be6fa395f83fb9ca421501d11b7f4a2aee458
Jul 07 14:16:51.952363 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:16:51.952340    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4a8f770_5d5b_4719_a37c_7cd5952c73f3.slice/crio-60142af983a135aabe917afaa7eda6ee0e4f6b32aa62cd8016e9df1e48d82449 WatchSource:0}: Error finding container 60142af983a135aabe917afaa7eda6ee0e4f6b32aa62cd8016e9df1e48d82449: Status 404 returned error can't find the container with id 60142af983a135aabe917afaa7eda6ee0e4f6b32aa62cd8016e9df1e48d82449
Jul 07 14:16:52.033825 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.033801    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkr7f\" (UniqueName: \"kubernetes.io/projected/cb749f31-7866-42f2-93af-fa49a3a4a01a-kube-api-access-pkr7f\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:16:52.033825 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.033826    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb749f31-7866-42f2-93af-fa49a3a4a01a-extensions-socket-volume\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:16:52.034105 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.033836    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5zj7\" (UniqueName: \"kubernetes.io/projected/4903b474-477c-443c-9d3e-05f0bc3ccfb6-kube-api-access-j5zj7\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:16:52.271797 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.271709    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc" event={"ID":"13a2718f-3b7c-422e-8aff-bf6924646a91","Type":"ContainerStarted","Data":"9a6fd2a627ac4d0e22bad687dba9b8255f4140cc3873b62d1369da4a4622af2b"}
Jul 07 14:16:52.273409 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.273373    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w6cq8" event={"ID":"d191e1e1-ef33-4335-9378-ee99663ed828","Type":"ContainerStarted","Data":"9f1334cc9817a61d0e7acc577b9114eb3bf0958a8c127fbf5f22cbdfee59eb9a"}
Jul 07 14:16:52.273555 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.273430    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w6cq8" event={"ID":"d191e1e1-ef33-4335-9378-ee99663ed828","Type":"ContainerStarted","Data":"73ee2e52aae2c0e662080196770be6fa395f83fb9ca421501d11b7f4a2aee458"}
Jul 07 14:16:52.273555 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.273460    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w6cq8"
Jul 07 14:16:52.274112 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:52.274083    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="cb749f31-7866-42f2-93af-fa49a3a4a01a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:52.274756 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.274722    2557 generic.go:356] "Generic (PLEG): container finished" podID="4903b474-477c-443c-9d3e-05f0bc3ccfb6" containerID="630f44ef54bf76f7d7053438e11d70454dc79c229063ba7b36013a1dba73c72f" exitCode=0
Jul 07 14:16:52.274876 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.274761    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:52.274876 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.274796    2557 scope.go:117] "RemoveContainer" containerID="630f44ef54bf76f7d7053438e11d70454dc79c229063ba7b36013a1dba73c72f"
Jul 07 14:16:52.276880 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.276846    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2" event={"ID":"e4a8f770-5d5b-4719-a37c-7cd5952c73f3","Type":"ContainerStarted","Data":"7a3fd180030be0376630a5052caf1b87c902740e0bea89fc6e5549506076cbed"}
Jul 07 14:16:52.277011 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.276889    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2" event={"ID":"e4a8f770-5d5b-4719-a37c-7cd5952c73f3","Type":"ContainerStarted","Data":"60142af983a135aabe917afaa7eda6ee0e4f6b32aa62cd8016e9df1e48d82449"}
Jul 07 14:16:52.277011 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.276914    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"
Jul 07 14:16:52.278295 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.278274    2557 generic.go:356] "Generic (PLEG): container finished" podID="cb749f31-7866-42f2-93af-fa49a3a4a01a" containerID="5d3cf256f2fba54a8a7424c9bed2e675dc87a61c237e184255eeb41672c5830a" exitCode=0
Jul 07 14:16:52.278409 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.278321    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:52.283840 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.283692    2557 scope.go:117] "RemoveContainer" containerID="630f44ef54bf76f7d7053438e11d70454dc79c229063ba7b36013a1dba73c72f"
Jul 07 14:16:52.283962 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:52.283940    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"630f44ef54bf76f7d7053438e11d70454dc79c229063ba7b36013a1dba73c72f\": container with ID starting with 630f44ef54bf76f7d7053438e11d70454dc79c229063ba7b36013a1dba73c72f not found: ID does not exist" containerID="630f44ef54bf76f7d7053438e11d70454dc79c229063ba7b36013a1dba73c72f"
Jul 07 14:16:52.284049 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.283974    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"630f44ef54bf76f7d7053438e11d70454dc79c229063ba7b36013a1dba73c72f"} err="failed to get container status \"630f44ef54bf76f7d7053438e11d70454dc79c229063ba7b36013a1dba73c72f\": rpc error: code = NotFound desc = could not find container \"630f44ef54bf76f7d7053438e11d70454dc79c229063ba7b36013a1dba73c72f\": container with ID starting with 630f44ef54bf76f7d7053438e11d70454dc79c229063ba7b36013a1dba73c72f not found: ID does not exist"
Jul 07 14:16:52.284049 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.283997    2557 scope.go:117] "RemoveContainer" containerID="5d3cf256f2fba54a8a7424c9bed2e675dc87a61c237e184255eeb41672c5830a"
Jul 07 14:16:52.291548 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.291491    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2k6qc" podStartSLOduration=1.454798994 podStartE2EDuration="24.291479015s" totalImagesPullingTime="22.836680021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:16:52.290492612 +0000 UTC m=+601.652815778" watchObservedRunningTime="2026-07-07 14:16:52.291479015 +0000 UTC m=+601.653802181"
Jul 07 14:16:52.291607 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.291572    2557 scope.go:117] "RemoveContainer" containerID="5d3cf256f2fba54a8a7424c9bed2e675dc87a61c237e184255eeb41672c5830a"
Jul 07 14:16:52.291839 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:52.291819    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d3cf256f2fba54a8a7424c9bed2e675dc87a61c237e184255eeb41672c5830a\": container with ID starting with 5d3cf256f2fba54a8a7424c9bed2e675dc87a61c237e184255eeb41672c5830a not found: ID does not exist" containerID="5d3cf256f2fba54a8a7424c9bed2e675dc87a61c237e184255eeb41672c5830a"
Jul 07 14:16:52.291913 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.291848    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d3cf256f2fba54a8a7424c9bed2e675dc87a61c237e184255eeb41672c5830a"} err="failed to get container status \"5d3cf256f2fba54a8a7424c9bed2e675dc87a61c237e184255eeb41672c5830a\": rpc error: code = NotFound desc = could not find container \"5d3cf256f2fba54a8a7424c9bed2e675dc87a61c237e184255eeb41672c5830a\": container with ID starting with 5d3cf256f2fba54a8a7424c9bed2e675dc87a61c237e184255eeb41672c5830a not found: ID does not exist"
Jul 07 14:16:52.292558 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:52.292539    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-llsf7\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="4903b474-477c-443c-9d3e-05f0bc3ccfb6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:52.294654 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:52.294634    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-llsf7\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="4903b474-477c-443c-9d3e-05f0bc3ccfb6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-llsf7"
Jul 07 14:16:52.296391 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:52.296371    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-68jhs\" is forbidden: User \"system:node:ip-10-0-133-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-139.ec2.internal' and this object" podUID="cb749f31-7866-42f2-93af-fa49a3a4a01a" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-68jhs"
Jul 07 14:16:52.317389 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.317353    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w6cq8" podStartSLOduration=13.317341218 podStartE2EDuration="13.317341218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:16:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:16:52.316514132 +0000 UTC m=+601.678837300" watchObservedRunningTime="2026-07-07 14:16:52.317341218 +0000 UTC m=+601.679664384"
Jul 07 14:16:52.336553 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:52.336507    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2" podStartSLOduration=13.336493045 podStartE2EDuration="13.336493045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:16:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:16:52.336029212 +0000 UTC m=+601.698352377" watchObservedRunningTime="2026-07-07 14:16:52.336493045 +0000 UTC m=+601.698816212"
Jul 07 14:16:53.117418 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:53.117386    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4903b474-477c-443c-9d3e-05f0bc3ccfb6" path="/var/lib/kubelet/pods/4903b474-477c-443c-9d3e-05f0bc3ccfb6/volumes"
Jul 07 14:16:53.117785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:53.117729    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb749f31-7866-42f2-93af-fa49a3a4a01a" path="/var/lib/kubelet/pods/cb749f31-7866-42f2-93af-fa49a3a4a01a/volumes"
Jul 07 14:16:56.615944 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:56.615915    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"]
Jul 07 14:16:56.616430 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:56.616117    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2" podUID="e4a8f770-5d5b-4719-a37c-7cd5952c73f3" containerName="manager" containerID="cri-o://7a3fd180030be0376630a5052caf1b87c902740e0bea89fc6e5549506076cbed" gracePeriod=10
Jul 07 14:16:56.857729 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:56.857703    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"
Jul 07 14:16:56.870183 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:56.870099    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2sl8\" (UniqueName: \"kubernetes.io/projected/e4a8f770-5d5b-4719-a37c-7cd5952c73f3-kube-api-access-h2sl8\") pod \"e4a8f770-5d5b-4719-a37c-7cd5952c73f3\" (UID: \"e4a8f770-5d5b-4719-a37c-7cd5952c73f3\") "
Jul 07 14:16:56.870370 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:56.870201    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a8f770-5d5b-4719-a37c-7cd5952c73f3-extensions-socket-volume\") pod \"e4a8f770-5d5b-4719-a37c-7cd5952c73f3\" (UID: \"e4a8f770-5d5b-4719-a37c-7cd5952c73f3\") "
Jul 07 14:16:56.870552 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:56.870525    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4a8f770-5d5b-4719-a37c-7cd5952c73f3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e4a8f770-5d5b-4719-a37c-7cd5952c73f3" (UID: "e4a8f770-5d5b-4719-a37c-7cd5952c73f3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:16:56.872188 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:56.872163    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4a8f770-5d5b-4719-a37c-7cd5952c73f3-kube-api-access-h2sl8" (OuterVolumeSpecName: "kube-api-access-h2sl8") pod "e4a8f770-5d5b-4719-a37c-7cd5952c73f3" (UID: "e4a8f770-5d5b-4719-a37c-7cd5952c73f3"). InnerVolumeSpecName "kube-api-access-h2sl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:16:56.971548 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:56.971506    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4a8f770-5d5b-4719-a37c-7cd5952c73f3-extensions-socket-volume\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:16:56.971548 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:56.971540    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2sl8\" (UniqueName: \"kubernetes.io/projected/e4a8f770-5d5b-4719-a37c-7cd5952c73f3-kube-api-access-h2sl8\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:16:57.302635 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:57.302603    2557 generic.go:356] "Generic (PLEG): container finished" podID="e4a8f770-5d5b-4719-a37c-7cd5952c73f3" containerID="7a3fd180030be0376630a5052caf1b87c902740e0bea89fc6e5549506076cbed" exitCode=0
Jul 07 14:16:57.302805 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:57.302651    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"
Jul 07 14:16:57.302805 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:57.302687    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2" event={"ID":"e4a8f770-5d5b-4719-a37c-7cd5952c73f3","Type":"ContainerDied","Data":"7a3fd180030be0376630a5052caf1b87c902740e0bea89fc6e5549506076cbed"}
Jul 07 14:16:57.302805 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:57.302737    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2" event={"ID":"e4a8f770-5d5b-4719-a37c-7cd5952c73f3","Type":"ContainerDied","Data":"60142af983a135aabe917afaa7eda6ee0e4f6b32aa62cd8016e9df1e48d82449"}
Jul 07 14:16:57.302805 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:57.302759    2557 scope.go:117] "RemoveContainer" containerID="7a3fd180030be0376630a5052caf1b87c902740e0bea89fc6e5549506076cbed"
Jul 07 14:16:57.310796 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:57.310781    2557 scope.go:117] "RemoveContainer" containerID="7a3fd180030be0376630a5052caf1b87c902740e0bea89fc6e5549506076cbed"
Jul 07 14:16:57.311096 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:16:57.311072    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a3fd180030be0376630a5052caf1b87c902740e0bea89fc6e5549506076cbed\": container with ID starting with 7a3fd180030be0376630a5052caf1b87c902740e0bea89fc6e5549506076cbed not found: ID does not exist" containerID="7a3fd180030be0376630a5052caf1b87c902740e0bea89fc6e5549506076cbed"
Jul 07 14:16:57.311195 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:57.311100    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a3fd180030be0376630a5052caf1b87c902740e0bea89fc6e5549506076cbed"} err="failed to get container status \"7a3fd180030be0376630a5052caf1b87c902740e0bea89fc6e5549506076cbed\": rpc error: code = NotFound desc = could not find container \"7a3fd180030be0376630a5052caf1b87c902740e0bea89fc6e5549506076cbed\": container with ID starting with 7a3fd180030be0376630a5052caf1b87c902740e0bea89fc6e5549506076cbed not found: ID does not exist"
Jul 07 14:16:57.321623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:57.321598    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"]
Jul 07 14:16:57.328475 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:57.328452    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bvpb2"]
Jul 07 14:16:59.117323 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:16:59.117292    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4a8f770-5d5b-4719-a37c-7cd5952c73f3" path="/var/lib/kubelet/pods/e4a8f770-5d5b-4719-a37c-7cd5952c73f3/volumes"
Jul 07 14:17:03.286742 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:03.286709    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w6cq8"
Jul 07 14:17:13.070796 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.070762    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"]
Jul 07 14:17:13.071962 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.071937    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4a8f770-5d5b-4719-a37c-7cd5952c73f3" containerName="manager"
Jul 07 14:17:13.072119 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.072108    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4a8f770-5d5b-4719-a37c-7cd5952c73f3" containerName="manager"
Jul 07 14:17:13.072370 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.072356    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4a8f770-5d5b-4719-a37c-7cd5952c73f3" containerName="manager"
Jul 07 14:17:13.233032 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.232945    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"]
Jul 07 14:17:13.233192 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.233071    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.235637 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.235617    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-l4dlt\""
Jul 07 14:17:13.302547 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.302510    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.302547 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.302551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/317e8963-c493-4237-94c3-a2b1e1e797e4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.302794 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.302580    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.302794 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.302664    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.302794 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.302725    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxp4b\" (UniqueName: \"kubernetes.io/projected/317e8963-c493-4237-94c3-a2b1e1e797e4-kube-api-access-hxp4b\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.302794 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.302769    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/317e8963-c493-4237-94c3-a2b1e1e797e4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.303018 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.302798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/317e8963-c493-4237-94c3-a2b1e1e797e4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.303018 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.302833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.303018 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.302857    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404085 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.403964    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404085 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.404010    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/317e8963-c493-4237-94c3-a2b1e1e797e4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404085 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.404027    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404085 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.404048    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404451 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.404099    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxp4b\" (UniqueName: \"kubernetes.io/projected/317e8963-c493-4237-94c3-a2b1e1e797e4-kube-api-access-hxp4b\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404451 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.404140    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/317e8963-c493-4237-94c3-a2b1e1e797e4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404451 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.404164    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/317e8963-c493-4237-94c3-a2b1e1e797e4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404451 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.404194    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404451 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.404210    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404684 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.404531    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404684 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.404600    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404684 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.404629    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404783 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.404748    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.404971 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.404949    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/317e8963-c493-4237-94c3-a2b1e1e797e4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.406601 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.406575    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/317e8963-c493-4237-94c3-a2b1e1e797e4-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.406708 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.406670    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/317e8963-c493-4237-94c3-a2b1e1e797e4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.412289 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.412269    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxp4b\" (UniqueName: \"kubernetes.io/projected/317e8963-c493-4237-94c3-a2b1e1e797e4-kube-api-access-hxp4b\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.412385 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.412357    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/317e8963-c493-4237-94c3-a2b1e1e797e4-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-zglr5\" (UID: \"317e8963-c493-4237-94c3-a2b1e1e797e4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.543386 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.543355    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:13.694094 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.694071    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"]
Jul 07 14:17:13.696560 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:17:13.696533    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317e8963_c493_4237_94c3_a2b1e1e797e4.slice/crio-eac508aa51fdec186a1758a88cf1dcfa368c3db1747880fac56a59f9e4726e09 WatchSource:0}: Error finding container eac508aa51fdec186a1758a88cf1dcfa368c3db1747880fac56a59f9e4726e09: Status 404 returned error can't find the container with id eac508aa51fdec186a1758a88cf1dcfa368c3db1747880fac56a59f9e4726e09
Jul 07 14:17:13.698692 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.698657    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:17:13.698849 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.698729    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:17:13.698849 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:13.698766    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:17:14.377496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:14.377457    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5" event={"ID":"317e8963-c493-4237-94c3-a2b1e1e797e4","Type":"ContainerStarted","Data":"df4cd9771c3266aff8986ec8f4493ff82aa9e037b10b59d1d5673f58761555c3"}
Jul 07 14:17:14.377888 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:14.377518    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5" event={"ID":"317e8963-c493-4237-94c3-a2b1e1e797e4","Type":"ContainerStarted","Data":"eac508aa51fdec186a1758a88cf1dcfa368c3db1747880fac56a59f9e4726e09"}
Jul 07 14:17:14.400249 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:14.400182    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5" podStartSLOduration=1.400163725 podStartE2EDuration="1.400163725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:17:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:17:14.397696645 +0000 UTC m=+623.760019813" watchObservedRunningTime="2026-07-07 14:17:14.400163725 +0000 UTC m=+623.762486924"
Jul 07 14:17:14.543906 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:14.543863    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:14.549313 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:14.549282    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:15.382059 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:15.382029    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:15.383031 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:15.383015    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:17:15.930265 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:15.930218    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:17:15.935071 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:15.935049    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kbls6"
Jul 07 14:17:15.937716 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:15.937693    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 14:17:15.943658 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:15.943637    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:17:15.976353 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:15.976319    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:17:16.023409 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.023334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7b7n\" (UniqueName: \"kubernetes.io/projected/868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0-kube-api-access-j7b7n\") pod \"limitador-limitador-54d6d988d5-kbls6\" (UID: \"868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kbls6"
Jul 07 14:17:16.023582 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.023460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0-config-file\") pod \"limitador-limitador-54d6d988d5-kbls6\" (UID: \"868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kbls6"
Jul 07 14:17:16.124646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.124615    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7b7n\" (UniqueName: \"kubernetes.io/projected/868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0-kube-api-access-j7b7n\") pod \"limitador-limitador-54d6d988d5-kbls6\" (UID: \"868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kbls6"
Jul 07 14:17:16.124646 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.124658    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0-config-file\") pod \"limitador-limitador-54d6d988d5-kbls6\" (UID: \"868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kbls6"
Jul 07 14:17:16.125293 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.125275    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0-config-file\") pod \"limitador-limitador-54d6d988d5-kbls6\" (UID: \"868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kbls6"
Jul 07 14:17:16.133078 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.133052    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7b7n\" (UniqueName: \"kubernetes.io/projected/868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0-kube-api-access-j7b7n\") pod \"limitador-limitador-54d6d988d5-kbls6\" (UID: \"868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kbls6"
Jul 07 14:17:16.246359 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.246280    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kbls6"
Jul 07 14:17:16.300789 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.300756    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zkgw5"]
Jul 07 14:17:16.311026 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.310143    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zkgw5"
Jul 07 14:17:16.311026 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.310976    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zkgw5"]
Jul 07 14:17:16.313149 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.312976    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z6vxp\""
Jul 07 14:17:16.399426 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.399397    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:17:16.402241 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:17:16.402199    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868c5fb0_a6c6_4d76_bbf2_6c7bf81d8bc0.slice/crio-9f2dedecdb33f1551e1ae48bcd577d99dc14a9e61abbfebbaf6dd991d8c8cbea WatchSource:0}: Error finding container 9f2dedecdb33f1551e1ae48bcd577d99dc14a9e61abbfebbaf6dd991d8c8cbea: Status 404 returned error can't find the container with id 9f2dedecdb33f1551e1ae48bcd577d99dc14a9e61abbfebbaf6dd991d8c8cbea
Jul 07 14:17:16.428347 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.428309    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tbdk\" (UniqueName: \"kubernetes.io/projected/35c9d0dc-87de-4ced-8d57-fc1d7848ceb8-kube-api-access-7tbdk\") pod \"authorino-75d556bd77-zkgw5\" (UID: \"35c9d0dc-87de-4ced-8d57-fc1d7848ceb8\") " pod="kuadrant-system/authorino-75d556bd77-zkgw5"
Jul 07 14:17:16.529272 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.529163    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tbdk\" (UniqueName: \"kubernetes.io/projected/35c9d0dc-87de-4ced-8d57-fc1d7848ceb8-kube-api-access-7tbdk\") pod \"authorino-75d556bd77-zkgw5\" (UID: \"35c9d0dc-87de-4ced-8d57-fc1d7848ceb8\") " pod="kuadrant-system/authorino-75d556bd77-zkgw5"
Jul 07 14:17:16.537393 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.537367    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tbdk\" (UniqueName: \"kubernetes.io/projected/35c9d0dc-87de-4ced-8d57-fc1d7848ceb8-kube-api-access-7tbdk\") pod \"authorino-75d556bd77-zkgw5\" (UID: \"35c9d0dc-87de-4ced-8d57-fc1d7848ceb8\") " pod="kuadrant-system/authorino-75d556bd77-zkgw5"
Jul 07 14:17:16.628040 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.628006    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zkgw5"
Jul 07 14:17:16.929161 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:16.929130    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zkgw5"]
Jul 07 14:17:16.933865 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:17:16.933833    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35c9d0dc_87de_4ced_8d57_fc1d7848ceb8.slice/crio-c13cb45198b00cf1bdac39619b768f67c2d61876a2a86ac8cd073dcc5d36a7e7 WatchSource:0}: Error finding container c13cb45198b00cf1bdac39619b768f67c2d61876a2a86ac8cd073dcc5d36a7e7: Status 404 returned error can't find the container with id c13cb45198b00cf1bdac39619b768f67c2d61876a2a86ac8cd073dcc5d36a7e7
Jul 07 14:17:17.396046 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:17.396007    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zkgw5" event={"ID":"35c9d0dc-87de-4ced-8d57-fc1d7848ceb8","Type":"ContainerStarted","Data":"c13cb45198b00cf1bdac39619b768f67c2d61876a2a86ac8cd073dcc5d36a7e7"}
Jul 07 14:17:17.397582 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:17.397539    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kbls6" event={"ID":"868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0","Type":"ContainerStarted","Data":"9f2dedecdb33f1551e1ae48bcd577d99dc14a9e61abbfebbaf6dd991d8c8cbea"}
Jul 07 14:17:21.418309 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:21.418265    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kbls6" event={"ID":"868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0","Type":"ContainerStarted","Data":"fa6ded2b4c8bbca66d95a0c4ac30c82f96e0070c79be9de74e0dfd1e853a67eb"}
Jul 07 14:17:21.418779 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:21.418387    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kbls6"
Jul 07 14:17:21.419686 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:21.419663    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zkgw5" event={"ID":"35c9d0dc-87de-4ced-8d57-fc1d7848ceb8","Type":"ContainerStarted","Data":"1e61aa4f9cc7cd227fb569c614f493b6f77f81ce88a2860391d816ad0199f1a7"}
Jul 07 14:17:21.438713 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:21.438660    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-kbls6" podStartSLOduration=2.212541024 podStartE2EDuration="6.438643681s" totalImagesPullingTime="4.226102657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:17:21.437458285 +0000 UTC m=+630.799781452" watchObservedRunningTime="2026-07-07 14:17:21.438643681 +0000 UTC m=+630.800967226"
Jul 07 14:17:21.452877 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:21.452827    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zkgw5" podStartSLOduration=1.7007710280000001 podStartE2EDuration="5.452809676s" totalImagesPullingTime="3.752038648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:17:21.451694513 +0000 UTC m=+630.814017681" watchObservedRunningTime="2026-07-07 14:17:21.452809676 +0000 UTC m=+630.815132842"
Jul 07 14:17:32.426019 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:32.425986    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kbls6"
Jul 07 14:17:53.435729 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:53.435691    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zkgw5"]
Jul 07 14:17:53.436277 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:53.435899    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zkgw5" podUID="35c9d0dc-87de-4ced-8d57-fc1d7848ceb8" containerName="authorino" containerID="cri-o://1e61aa4f9cc7cd227fb569c614f493b6f77f81ce88a2860391d816ad0199f1a7" gracePeriod=30
Jul 07 14:17:53.576860 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:53.576830    2557 generic.go:356] "Generic (PLEG): container finished" podID="35c9d0dc-87de-4ced-8d57-fc1d7848ceb8" containerID="1e61aa4f9cc7cd227fb569c614f493b6f77f81ce88a2860391d816ad0199f1a7" exitCode=0
Jul 07 14:17:53.576860 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:53.576870    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zkgw5" event={"ID":"35c9d0dc-87de-4ced-8d57-fc1d7848ceb8","Type":"ContainerDied","Data":"1e61aa4f9cc7cd227fb569c614f493b6f77f81ce88a2860391d816ad0199f1a7"}
Jul 07 14:17:53.679395 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:53.679373    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zkgw5"
Jul 07 14:17:53.737504 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:53.737419    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tbdk\" (UniqueName: \"kubernetes.io/projected/35c9d0dc-87de-4ced-8d57-fc1d7848ceb8-kube-api-access-7tbdk\") pod \"35c9d0dc-87de-4ced-8d57-fc1d7848ceb8\" (UID: \"35c9d0dc-87de-4ced-8d57-fc1d7848ceb8\") "
Jul 07 14:17:53.739453 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:53.739418    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35c9d0dc-87de-4ced-8d57-fc1d7848ceb8-kube-api-access-7tbdk" (OuterVolumeSpecName: "kube-api-access-7tbdk") pod "35c9d0dc-87de-4ced-8d57-fc1d7848ceb8" (UID: "35c9d0dc-87de-4ced-8d57-fc1d7848ceb8"). InnerVolumeSpecName "kube-api-access-7tbdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:17:53.838243 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:53.838208    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tbdk\" (UniqueName: \"kubernetes.io/projected/35c9d0dc-87de-4ced-8d57-fc1d7848ceb8-kube-api-access-7tbdk\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:17:54.582139 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:54.582116    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zkgw5"
Jul 07 14:17:54.582139 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:54.582134    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zkgw5" event={"ID":"35c9d0dc-87de-4ced-8d57-fc1d7848ceb8","Type":"ContainerDied","Data":"c13cb45198b00cf1bdac39619b768f67c2d61876a2a86ac8cd073dcc5d36a7e7"}
Jul 07 14:17:54.582630 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:54.582177    2557 scope.go:117] "RemoveContainer" containerID="1e61aa4f9cc7cd227fb569c614f493b6f77f81ce88a2860391d816ad0199f1a7"
Jul 07 14:17:54.602174 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:54.602148    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zkgw5"]
Jul 07 14:17:54.606587 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:54.606566    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zkgw5"]
Jul 07 14:17:55.117437 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:17:55.117405    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35c9d0dc-87de-4ced-8d57-fc1d7848ceb8" path="/var/lib/kubelet/pods/35c9d0dc-87de-4ced-8d57-fc1d7848ceb8/volumes"
Jul 07 14:18:30.890315 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:30.890277    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:18:38.788661 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:38.788632    2557 generic.go:356] "Generic (PLEG): container finished" podID="317e8963-c493-4237-94c3-a2b1e1e797e4" containerID="df4cd9771c3266aff8986ec8f4493ff82aa9e037b10b59d1d5673f58761555c3" exitCode=0
Jul 07 14:18:38.789095 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:38.788699    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5" event={"ID":"317e8963-c493-4237-94c3-a2b1e1e797e4","Type":"ContainerDied","Data":"df4cd9771c3266aff8986ec8f4493ff82aa9e037b10b59d1d5673f58761555c3"}
Jul 07 14:18:38.789095 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:38.789052    2557 scope.go:117] "RemoveContainer" containerID="df4cd9771c3266aff8986ec8f4493ff82aa9e037b10b59d1d5673f58761555c3"
Jul 07 14:18:38.790067 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:38.790043    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:18:38.790133 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:38.790112    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:18:38.790183 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:38.790168    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:18:39.794649 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:39.794619    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5" event={"ID":"317e8963-c493-4237-94c3-a2b1e1e797e4","Type":"ContainerStarted","Data":"c5495cf1a60e680774c2cee66f5d81b04e426db9d2bb82f980c4ae5715cef149"}
Jul 07 14:18:40.543811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:40.543772    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:18:40.544039 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:40.544004    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zglr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 07 14:18:40.544117 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:40.544060    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5" podUID="317e8963-c493-4237-94c3-a2b1e1e797e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 07 14:18:41.544475 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:41.544438    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zglr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 07 14:18:41.544855 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:41.544492    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5" podUID="317e8963-c493-4237-94c3-a2b1e1e797e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 07 14:18:42.544153 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:42.544112    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zglr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 07 14:18:42.544345 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:42.544183    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5" podUID="317e8963-c493-4237-94c3-a2b1e1e797e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 07 14:18:43.544367 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:43.544277    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-zglr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 07 14:18:43.544367 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:43.544351    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5" podUID="317e8963-c493-4237-94c3-a2b1e1e797e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 07 14:18:44.548265 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:44.548216    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:18:44.548683 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:44.548507    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:18:44.549206 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:44.549192    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-zglr5"
Jul 07 14:18:58.948991 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:18:58.948957    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:19:16.754551 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:16.754510    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:19:28.510919 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.510884    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"]
Jul 07 14:19:28.511525 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.511419    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c9d0dc-87de-4ced-8d57-fc1d7848ceb8" containerName="authorino"
Jul 07 14:19:28.511525 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.511439    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c9d0dc-87de-4ced-8d57-fc1d7848ceb8" containerName="authorino"
Jul 07 14:19:28.511525 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.511512    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="35c9d0dc-87de-4ced-8d57-fc1d7848ceb8" containerName="authorino"
Jul 07 14:19:28.513921 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.513900    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.518278 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.518256    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kcktd\""
Jul 07 14:19:28.518409 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.518292    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 14:19:28.518409 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.518318    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 14:19:28.518409 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.518263    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 14:19:28.524867 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.524848    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"]
Jul 07 14:19:28.617770 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.617737    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvkbv\" (UniqueName: \"kubernetes.io/projected/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-kube-api-access-rvkbv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.617978 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.617868    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.617978 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.617895    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.617978 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.617924    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.618109 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.618023    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.618109 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.618051    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.718601 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.718560    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvkbv\" (UniqueName: \"kubernetes.io/projected/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-kube-api-access-rvkbv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.718782 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.718623    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.718782 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.718652    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.718782 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.718690    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.718938 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.718818    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.718938 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.718881    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.719095 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.719075    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.719172 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.719154    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.719224 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.719203    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.720966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.720942    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.721125 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.721106    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.726936 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.726916    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvkbv\" (UniqueName: \"kubernetes.io/projected/40e21e2e-a67f-47f8-9ba7-ba69519b7c9b-kube-api-access-rvkbv\") pod \"e2e-trlp-test-simulated-kserve-598466548d-z9p5n\" (UID: \"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.824487 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.824454    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:28.952668 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.952644    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"]
Jul 07 14:19:28.955272 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:19:28.955241    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e21e2e_a67f_47f8_9ba7_ba69519b7c9b.slice/crio-528142daa6eca007554492457274a4ea00d8318f05b250a90cb62f0c69d5f64e WatchSource:0}: Error finding container 528142daa6eca007554492457274a4ea00d8318f05b250a90cb62f0c69d5f64e: Status 404 returned error can't find the container with id 528142daa6eca007554492457274a4ea00d8318f05b250a90cb62f0c69d5f64e
Jul 07 14:19:28.957005 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:28.956987    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:19:29.018427 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:29.018393    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n" event={"ID":"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b","Type":"ContainerStarted","Data":"528142daa6eca007554492457274a4ea00d8318f05b250a90cb62f0c69d5f64e"}
Jul 07 14:19:29.658177 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:29.658137    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:19:31.032710 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:31.032667    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n" event={"ID":"40e21e2e-a67f-47f8-9ba7-ba69519b7c9b","Type":"ContainerStarted","Data":"c845b088caf21b73e17aabbabf0b7a80ad09213e028ad1600b607bdaebcea7c8"}
Jul 07 14:19:31.052358 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:31.052310    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n" podStartSLOduration=1.9681067429999999 podStartE2EDuration="3.05229604s" totalImagesPullingTime="1.084189297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:19:31.051438195 +0000 UTC m=+760.413761362" watchObservedRunningTime="2026-07-07 14:19:31.05229604 +0000 UTC m=+760.414619206"
Jul 07 14:19:38.759430 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:38.759391    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:19:38.824598 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:38.824570    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:38.824748 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:38.824642    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:38.837084 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:38.837064    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:39.080046 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:39.080013    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-z9p5n"
Jul 07 14:19:53.458400 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:19:53.458361    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:20:03.016212 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.016176    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"]
Jul 07 14:20:03.020480 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.020460    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.023553 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.023532    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 07 14:20:03.029762 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.029739    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"]
Jul 07 14:20:03.103672 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.103637    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/370caf24-f063-434f-914c-d77b7fa2e7e5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.103672 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.103673    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/370caf24-f063-434f-914c-d77b7fa2e7e5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.103866 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.103718    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/370caf24-f063-434f-914c-d77b7fa2e7e5-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.103866 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.103740    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k257\" (UniqueName: \"kubernetes.io/projected/370caf24-f063-434f-914c-d77b7fa2e7e5-kube-api-access-2k257\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.103866 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.103790    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/370caf24-f063-434f-914c-d77b7fa2e7e5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.103866 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.103817    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/370caf24-f063-434f-914c-d77b7fa2e7e5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.204224 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.204189    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/370caf24-f063-434f-914c-d77b7fa2e7e5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.204451 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.204261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/370caf24-f063-434f-914c-d77b7fa2e7e5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.204451 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.204293    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/370caf24-f063-434f-914c-d77b7fa2e7e5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.204451 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.204398    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/370caf24-f063-434f-914c-d77b7fa2e7e5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.204625 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.204457    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/370caf24-f063-434f-914c-d77b7fa2e7e5-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.204625 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.204484    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k257\" (UniqueName: \"kubernetes.io/projected/370caf24-f063-434f-914c-d77b7fa2e7e5-kube-api-access-2k257\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.204728 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.204677    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/370caf24-f063-434f-914c-d77b7fa2e7e5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.204770 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.204724    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/370caf24-f063-434f-914c-d77b7fa2e7e5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.204862 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.204837    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/370caf24-f063-434f-914c-d77b7fa2e7e5-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.206543 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.206525    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/370caf24-f063-434f-914c-d77b7fa2e7e5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.206821 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.206803    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/370caf24-f063-434f-914c-d77b7fa2e7e5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.212288 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.212265    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k257\" (UniqueName: \"kubernetes.io/projected/370caf24-f063-434f-914c-d77b7fa2e7e5-kube-api-access-2k257\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4\" (UID: \"370caf24-f063-434f-914c-d77b7fa2e7e5\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.330066 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.330038    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:03.456978 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:03.456953    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"]
Jul 07 14:20:04.176107 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:04.176075    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4" event={"ID":"370caf24-f063-434f-914c-d77b7fa2e7e5","Type":"ContainerStarted","Data":"ed95f59412bbd45d198831c1cddc97207440f218cf96bcb8fb26c868bcfa1f5c"}
Jul 07 14:20:05.182329 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:05.182291    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4" event={"ID":"370caf24-f063-434f-914c-d77b7fa2e7e5","Type":"ContainerStarted","Data":"f9efc8b9f6a23aa67b8cd1c533a9e9ae3f6e90c1db8c08981ff66c4752b27bf4"}
Jul 07 14:20:05.202837 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:05.202764    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4" podStartSLOduration=2.354277037 podStartE2EDuration="3.202747824s" totalImagesPullingTime="848.470787ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:20:05.201223112 +0000 UTC m=+794.563546279" watchObservedRunningTime="2026-07-07 14:20:05.202747824 +0000 UTC m=+794.565070970"
Jul 07 14:20:05.560425 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:05.560397    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:20:13.330418 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:13.330325    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:13.330418 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:13.330371    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:13.342826 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:13.342791    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:20:14.238663 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:20:14.238634    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4"
Jul 07 14:21:03.492610 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:03.492579    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7555bfcf78-cbj5x"]
Jul 07 14:21:03.495342 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:03.495324    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7555bfcf78-cbj5x"
Jul 07 14:21:03.498843 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:03.498823    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z6vxp\""
Jul 07 14:21:03.499003 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:03.498847    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 14:21:03.502421 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:03.502403    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7555bfcf78-cbj5x"]
Jul 07 14:21:03.598859 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:03.598833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/902d620f-3d07-428f-b164-f106cda5c273-tls-cert\") pod \"authorino-7555bfcf78-cbj5x\" (UID: \"902d620f-3d07-428f-b164-f106cda5c273\") " pod="kuadrant-system/authorino-7555bfcf78-cbj5x"
Jul 07 14:21:03.598985 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:03.598879    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pt8l\" (UniqueName: \"kubernetes.io/projected/902d620f-3d07-428f-b164-f106cda5c273-kube-api-access-7pt8l\") pod \"authorino-7555bfcf78-cbj5x\" (UID: \"902d620f-3d07-428f-b164-f106cda5c273\") " pod="kuadrant-system/authorino-7555bfcf78-cbj5x"
Jul 07 14:21:03.700273 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:03.700247    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/902d620f-3d07-428f-b164-f106cda5c273-tls-cert\") pod \"authorino-7555bfcf78-cbj5x\" (UID: \"902d620f-3d07-428f-b164-f106cda5c273\") " pod="kuadrant-system/authorino-7555bfcf78-cbj5x"
Jul 07 14:21:03.700379 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:03.700283    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pt8l\" (UniqueName: \"kubernetes.io/projected/902d620f-3d07-428f-b164-f106cda5c273-kube-api-access-7pt8l\") pod \"authorino-7555bfcf78-cbj5x\" (UID: \"902d620f-3d07-428f-b164-f106cda5c273\") " pod="kuadrant-system/authorino-7555bfcf78-cbj5x"
Jul 07 14:21:03.702659 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:03.702640    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/902d620f-3d07-428f-b164-f106cda5c273-tls-cert\") pod \"authorino-7555bfcf78-cbj5x\" (UID: \"902d620f-3d07-428f-b164-f106cda5c273\") " pod="kuadrant-system/authorino-7555bfcf78-cbj5x"
Jul 07 14:21:03.707959 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:03.707935    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pt8l\" (UniqueName: \"kubernetes.io/projected/902d620f-3d07-428f-b164-f106cda5c273-kube-api-access-7pt8l\") pod \"authorino-7555bfcf78-cbj5x\" (UID: \"902d620f-3d07-428f-b164-f106cda5c273\") " pod="kuadrant-system/authorino-7555bfcf78-cbj5x"
Jul 07 14:21:03.804773 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:03.804700    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7555bfcf78-cbj5x"
Jul 07 14:21:03.925784 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:03.925762    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7555bfcf78-cbj5x"]
Jul 07 14:21:03.927783 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:21:03.927756    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod902d620f_3d07_428f_b164_f106cda5c273.slice/crio-02d427b22cee572eba21e1209def935bdc86c9031a48951baca6cf03a91e8716 WatchSource:0}: Error finding container 02d427b22cee572eba21e1209def935bdc86c9031a48951baca6cf03a91e8716: Status 404 returned error can't find the container with id 02d427b22cee572eba21e1209def935bdc86c9031a48951baca6cf03a91e8716
Jul 07 14:21:04.446780 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:04.446748    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7555bfcf78-cbj5x" event={"ID":"902d620f-3d07-428f-b164-f106cda5c273","Type":"ContainerStarted","Data":"43a86b378b50e2bdbc404ead895c725533d40df159a8d1a4cc1a31f538f0bf03"}
Jul 07 14:21:04.446780 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:04.446787    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7555bfcf78-cbj5x" event={"ID":"902d620f-3d07-428f-b164-f106cda5c273","Type":"ContainerStarted","Data":"02d427b22cee572eba21e1209def935bdc86c9031a48951baca6cf03a91e8716"}
Jul 07 14:21:04.462174 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:04.462124    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7555bfcf78-cbj5x" podStartSLOduration=1.04500368 podStartE2EDuration="1.462108314s" totalImagesPullingTime="417.104634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:21:04.460729354 +0000 UTC m=+853.823052532" watchObservedRunningTime="2026-07-07 14:21:04.462108314 +0000 UTC m=+853.824431480"
Jul 07 14:21:32.242849 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:32.242817    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:21:43.342833 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:43.342764    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:21:55.035099 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:21:55.035064    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:22:03.845681 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:22:03.845648    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:22:14.542085 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:22:14.542050    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:22:42.749802 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:22:42.749767    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:22:54.244687 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:22:54.244652    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:23:27.047034 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:23:27.047001    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:23:36.139836 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:23:36.139802    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:23:44.555343 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:23:44.555307    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:23:50.046450 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:23:50.046417    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:24:00.760913 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:24:00.760875    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:24:09.846622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:24:09.846584    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:24:21.942361 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:24:21.942327    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:24:30.543957 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:24:30.543913    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:24:37.642078 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:24:37.642042    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:24:45.544865 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:24:45.544781    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:24:57.145679 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:24:57.145642    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:25:09.144611 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:25:09.144577    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:25:30.441583 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:25:30.441551    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:25:42.153035 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:25:42.153001    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:25:59.852125 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:25:59.852086    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:26:13.449779 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:26:13.449700    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:26:26.149446 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:26:26.149412    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:26:34.143433 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:26:34.143392    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:28:23.751262 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:28:23.751213    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:28:33.040286 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:28:33.040252    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:28:45.249970 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:28:45.249929    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:28:57.743017 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:28:57.742984    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:29:08.641296 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:29:08.641264    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:29:18.447136 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:29:18.447102    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:29:28.037667 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:29:28.037632    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:29:40.536272 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:29:40.536239    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:29:49.445601 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:29:49.445567    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:29:59.447834 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:29:59.447797    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:30:12.249249 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:30:12.249200    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:30:30.949031 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:30:30.948996    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:30:39.850563 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:30:39.850525    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:30:49.351811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:30:49.351730    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:31:05.142934 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:31:05.142902    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:31:26.749498 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:31:26.749462    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:31:35.047457 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:31:35.047417    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:31:44.853249 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:31:44.853197    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:31:54.444565 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:31:54.444526    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:32:03.639039 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:32:03.639004    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:32:17.352096 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:32:17.352047    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:32:26.448408 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:32:26.448369    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:32:35.550009 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:32:35.549977    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:32:47.747729 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:32:47.747689    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:32:58.651187 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:32:58.651151    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:33:07.840742 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:07.840706    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:33:19.052711 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:19.052665    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:33:31.243618 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:31.243575    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:33:40.646771 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:40.646736    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:33:51.976777 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:51.976746    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"]
Jul 07 14:33:51.979101 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:51.979083    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:51.981946 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:51.981922    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9d688a01-openshift-default-dockercfg-t8bds\""
Jul 07 14:33:51.999995 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:51.999971    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"]
Jul 07 14:33:52.026139 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.026107    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-podinfo\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.026139 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.026144    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-envoy\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.026400 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.026179    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-token\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.026400 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.026380    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-workload-certs\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.026517 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.026427    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8d8s\" (UniqueName: \"kubernetes.io/projected/fe71c332-293f-4b0c-ac1d-d1bc42413dff-kube-api-access-d8d8s\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.026517 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.026487    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-data\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.026517 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.026511    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istiod-ca-cert\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.026670 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.026548    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-workload-socket\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.026670 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.026573    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-credential-socket\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127076 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127043    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-data\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127076 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127080    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istiod-ca-cert\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127367 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127109    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-workload-socket\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127367 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127126    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-credential-socket\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127367 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127152    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-podinfo\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127367 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127182    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-envoy\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127367 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127224    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-token\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127367 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127286    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-workload-certs\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127367 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127310    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8d8s\" (UniqueName: \"kubernetes.io/projected/fe71c332-293f-4b0c-ac1d-d1bc42413dff-kube-api-access-d8d8s\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127740 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127475    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-data\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127740 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127526    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-workload-socket\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127859 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127790    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-credential-socket\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127859 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127835    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-workload-certs\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.127968 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.127941    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istiod-ca-cert\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.129640 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.129617    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-envoy\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.129863 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.129844    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-podinfo\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.135223 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.135195    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-token\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.135388 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.135371    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8d8s\" (UniqueName: \"kubernetes.io/projected/fe71c332-293f-4b0c-ac1d-d1bc42413dff-kube-api-access-d8d8s\") pod \"e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") " pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.292447 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.292367    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:52.424698 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.424669    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"]
Jul 07 14:33:52.426174 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:33:52.426150    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe71c332_293f_4b0c_ac1d_d1bc42413dff.slice/crio-61b83dd5aa4eae7bf1db94330b0f6d17c69f8dab8e8ff04d97b75057f7f86dd5 WatchSource:0}: Error finding container 61b83dd5aa4eae7bf1db94330b0f6d17c69f8dab8e8ff04d97b75057f7f86dd5: Status 404 returned error can't find the container with id 61b83dd5aa4eae7bf1db94330b0f6d17c69f8dab8e8ff04d97b75057f7f86dd5
Jul 07 14:33:52.428442 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.428413    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:33:52.428518 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.428476    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:33:52.428554 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.428522    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:33:52.902603 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.902566    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn" event={"ID":"fe71c332-293f-4b0c-ac1d-d1bc42413dff","Type":"ContainerStarted","Data":"3df3c9f9bfc4c571e93bdc18abd61cffc6f86eb7cbbc1fd57af24b2fb8819d07"}
Jul 07 14:33:52.902783 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.902629    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn" event={"ID":"fe71c332-293f-4b0c-ac1d-d1bc42413dff","Type":"ContainerStarted","Data":"61b83dd5aa4eae7bf1db94330b0f6d17c69f8dab8e8ff04d97b75057f7f86dd5"}
Jul 07 14:33:52.929076 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:52.929024    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn" podStartSLOduration=1.9290106599999999 podStartE2EDuration="1.92901066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:33:52.928087849 +0000 UTC m=+1622.290411015" watchObservedRunningTime="2026-07-07 14:33:52.92901066 +0000 UTC m=+1622.291333827"
Jul 07 14:33:53.293364 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:53.293276    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:53.298055 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:53.298032    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:53.907433 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:53.907405    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:53.908345 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:53.908324    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:33:55.749056 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:55.749023    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:33:58.361694 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:58.361657    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"]
Jul 07 14:33:58.362539 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:33:58.362470    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn" podUID="fe71c332-293f-4b0c-ac1d-d1bc42413dff" containerName="istio-proxy" containerID="cri-o://3df3c9f9bfc4c571e93bdc18abd61cffc6f86eb7cbbc1fd57af24b2fb8819d07" gracePeriod=30
Jul 07 14:34:03.912641 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:03.912616    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:34:03.954687 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:03.954606    2557 generic.go:356] "Generic (PLEG): container finished" podID="fe71c332-293f-4b0c-ac1d-d1bc42413dff" containerID="3df3c9f9bfc4c571e93bdc18abd61cffc6f86eb7cbbc1fd57af24b2fb8819d07" exitCode=0
Jul 07 14:34:03.954687 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:03.954639    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn" event={"ID":"fe71c332-293f-4b0c-ac1d-d1bc42413dff","Type":"ContainerDied","Data":"3df3c9f9bfc4c571e93bdc18abd61cffc6f86eb7cbbc1fd57af24b2fb8819d07"}
Jul 07 14:34:03.954687 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:03.954668    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"
Jul 07 14:34:03.954889 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:03.954698    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn" event={"ID":"fe71c332-293f-4b0c-ac1d-d1bc42413dff","Type":"ContainerDied","Data":"61b83dd5aa4eae7bf1db94330b0f6d17c69f8dab8e8ff04d97b75057f7f86dd5"}
Jul 07 14:34:03.954889 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:03.954723    2557 scope.go:117] "RemoveContainer" containerID="3df3c9f9bfc4c571e93bdc18abd61cffc6f86eb7cbbc1fd57af24b2fb8819d07"
Jul 07 14:34:03.963289 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:03.963270    2557 scope.go:117] "RemoveContainer" containerID="3df3c9f9bfc4c571e93bdc18abd61cffc6f86eb7cbbc1fd57af24b2fb8819d07"
Jul 07 14:34:03.963539 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:34:03.963517    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3df3c9f9bfc4c571e93bdc18abd61cffc6f86eb7cbbc1fd57af24b2fb8819d07\": container with ID starting with 3df3c9f9bfc4c571e93bdc18abd61cffc6f86eb7cbbc1fd57af24b2fb8819d07 not found: ID does not exist" containerID="3df3c9f9bfc4c571e93bdc18abd61cffc6f86eb7cbbc1fd57af24b2fb8819d07"
Jul 07 14:34:03.963619 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:03.963543    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df3c9f9bfc4c571e93bdc18abd61cffc6f86eb7cbbc1fd57af24b2fb8819d07"} err="failed to get container status \"3df3c9f9bfc4c571e93bdc18abd61cffc6f86eb7cbbc1fd57af24b2fb8819d07\": rpc error: code = NotFound desc = could not find container \"3df3c9f9bfc4c571e93bdc18abd61cffc6f86eb7cbbc1fd57af24b2fb8819d07\": container with ID starting with 3df3c9f9bfc4c571e93bdc18abd61cffc6f86eb7cbbc1fd57af24b2fb8819d07 not found: ID does not exist"
Jul 07 14:34:04.029611 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.029574    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-data\") pod \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") "
Jul 07 14:34:04.029797 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.029634    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-workload-socket\") pod \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") "
Jul 07 14:34:04.029797 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.029666    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-envoy\") pod \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") "
Jul 07 14:34:04.029797 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.029689    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8d8s\" (UniqueName: \"kubernetes.io/projected/fe71c332-293f-4b0c-ac1d-d1bc42413dff-kube-api-access-d8d8s\") pod \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") "
Jul 07 14:34:04.029797 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.029718    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-workload-certs\") pod \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") "
Jul 07 14:34:04.029797 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.029755    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-token\") pod \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") "
Jul 07 14:34:04.030101 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.029830    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-podinfo\") pod \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") "
Jul 07 14:34:04.030101 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.029880    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-credential-socket\") pod \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") "
Jul 07 14:34:04.030101 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.029924    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istiod-ca-cert\") pod \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\" (UID: \"fe71c332-293f-4b0c-ac1d-d1bc42413dff\") "
Jul 07 14:34:04.030101 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.029932    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fe71c332-293f-4b0c-ac1d-d1bc42413dff" (UID: "fe71c332-293f-4b0c-ac1d-d1bc42413dff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:04.030101 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.030083    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fe71c332-293f-4b0c-ac1d-d1bc42413dff" (UID: "fe71c332-293f-4b0c-ac1d-d1bc42413dff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:04.030373 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.030219    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-workload-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:04.030373 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.030261    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-workload-socket\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:04.030464 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.030420    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fe71c332-293f-4b0c-ac1d-d1bc42413dff" (UID: "fe71c332-293f-4b0c-ac1d-d1bc42413dff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:04.030464 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.030441    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-data" (OuterVolumeSpecName: "istio-data") pod "fe71c332-293f-4b0c-ac1d-d1bc42413dff" (UID: "fe71c332-293f-4b0c-ac1d-d1bc42413dff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:04.030464 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.030450    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fe71c332-293f-4b0c-ac1d-d1bc42413dff" (UID: "fe71c332-293f-4b0c-ac1d-d1bc42413dff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:34:04.031973 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.031930    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fe71c332-293f-4b0c-ac1d-d1bc42413dff" (UID: "fe71c332-293f-4b0c-ac1d-d1bc42413dff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:34:04.032095 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.031993    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe71c332-293f-4b0c-ac1d-d1bc42413dff-kube-api-access-d8d8s" (OuterVolumeSpecName: "kube-api-access-d8d8s") pod "fe71c332-293f-4b0c-ac1d-d1bc42413dff" (UID: "fe71c332-293f-4b0c-ac1d-d1bc42413dff"). InnerVolumeSpecName "kube-api-access-d8d8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:34:04.032296 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.032277    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fe71c332-293f-4b0c-ac1d-d1bc42413dff" (UID: "fe71c332-293f-4b0c-ac1d-d1bc42413dff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:04.032352 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.032331    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-token" (OuterVolumeSpecName: "istio-token") pod "fe71c332-293f-4b0c-ac1d-d1bc42413dff" (UID: "fe71c332-293f-4b0c-ac1d-d1bc42413dff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:34:04.131393 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.131355    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istiod-ca-cert\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:04.131568 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.131425    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-data\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:04.131568 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.131439    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-envoy\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:04.131568 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.131458    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8d8s\" (UniqueName: \"kubernetes.io/projected/fe71c332-293f-4b0c-ac1d-d1bc42413dff-kube-api-access-d8d8s\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:04.131568 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.131470    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-token\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:04.131568 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.131483    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fe71c332-293f-4b0c-ac1d-d1bc42413dff-istio-podinfo\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:04.131568 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.131495    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fe71c332-293f-4b0c-ac1d-d1bc42413dff-credential-socket\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:04.276784 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.276754    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"]
Jul 07 14:34:04.285656 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.285631    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9d688a01-openshift-default-99c56fdb9-qqxpn"]
Jul 07 14:34:04.456644 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.456612    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:34:04.559572 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.559495    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"]
Jul 07 14:34:04.559833 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.559813    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe71c332-293f-4b0c-ac1d-d1bc42413dff" containerName="istio-proxy"
Jul 07 14:34:04.559833 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.559834    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe71c332-293f-4b0c-ac1d-d1bc42413dff" containerName="istio-proxy"
Jul 07 14:34:04.559953 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.559893    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe71c332-293f-4b0c-ac1d-d1bc42413dff" containerName="istio-proxy"
Jul 07 14:34:04.562609 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.562589    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.565556 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.565535    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-42700fcd-openshift-default-dockercfg-dvgh5\""
Jul 07 14:34:04.575910 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.575885    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"]
Jul 07 14:34:04.636959 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.636923    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-envoy\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.636959 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.636950    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0762c6b1-9b26-4776-bc2b-ae156c656268-istiod-ca-cert\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.637217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.636972    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-credential-socket\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.637217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.636988    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-token\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.637217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.637057    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-workload-socket\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.637217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.637140    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-data\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.637217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.637163    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbzp9\" (UniqueName: \"kubernetes.io/projected/0762c6b1-9b26-4776-bc2b-ae156c656268-kube-api-access-cbzp9\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.637217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.637197    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-podinfo\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.637434 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.637271    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-workload-certs\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.738056 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.738010    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-credential-socket\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.738056 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.738054    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-token\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.738056 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.738073    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-workload-socket\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.738425 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.738122    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-data\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.738425 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.738139    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbzp9\" (UniqueName: \"kubernetes.io/projected/0762c6b1-9b26-4776-bc2b-ae156c656268-kube-api-access-cbzp9\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.738425 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.738169    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-podinfo\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.738425 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.738376    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-workload-certs\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.738626 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.738443    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-envoy\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.738626 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.738464    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0762c6b1-9b26-4776-bc2b-ae156c656268-istiod-ca-cert\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.738626 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.738525    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-credential-socket\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.738626 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.738552    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-workload-socket\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.738626 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.738581    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-data\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.738787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.738692    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-workload-certs\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.739083 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.739067    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0762c6b1-9b26-4776-bc2b-ae156c656268-istiod-ca-cert\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.740548 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.740524    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-envoy\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.740666 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.740651    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-podinfo\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.745865 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.745841    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbzp9\" (UniqueName: \"kubernetes.io/projected/0762c6b1-9b26-4776-bc2b-ae156c656268-kube-api-access-cbzp9\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.746358 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.746341    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-token\") pod \"e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") " pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:04.873205 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:04.873172    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:05.003287 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:05.003262    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"]
Jul 07 14:34:05.005168 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:34:05.005143    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0762c6b1_9b26_4776_bc2b_ae156c656268.slice/crio-cd247650b866658c8dc29356b8273af03fcd7b24adc700bd7a7aa3cdf6cda1f4 WatchSource:0}: Error finding container cd247650b866658c8dc29356b8273af03fcd7b24adc700bd7a7aa3cdf6cda1f4: Status 404 returned error can't find the container with id cd247650b866658c8dc29356b8273af03fcd7b24adc700bd7a7aa3cdf6cda1f4
Jul 07 14:34:05.007156 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:05.007122    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:34:05.007248 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:05.007189    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:34:05.007248 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:05.007217    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:34:05.119441 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:05.119406    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe71c332-293f-4b0c-ac1d-d1bc42413dff" path="/var/lib/kubelet/pods/fe71c332-293f-4b0c-ac1d-d1bc42413dff/volumes"
Jul 07 14:34:05.968280 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:05.968241    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6" event={"ID":"0762c6b1-9b26-4776-bc2b-ae156c656268","Type":"ContainerStarted","Data":"d2a6a8e11c292d59ef89555b66d3d7ff5091f42d1923eae3ac45b579392671ea"}
Jul 07 14:34:05.968464 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:05.968298    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6" event={"ID":"0762c6b1-9b26-4776-bc2b-ae156c656268","Type":"ContainerStarted","Data":"cd247650b866658c8dc29356b8273af03fcd7b24adc700bd7a7aa3cdf6cda1f4"}
Jul 07 14:34:05.992351 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:05.992301    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6" podStartSLOduration=1.9922846459999999 podStartE2EDuration="1.992284646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:05.991609826 +0000 UTC m=+1635.353933030" watchObservedRunningTime="2026-07-07 14:34:05.992284646 +0000 UTC m=+1635.354607813"
Jul 07 14:34:06.874123 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:06.874091    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:06.879431 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:06.879405    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:06.972594 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:06.972561    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:06.973645 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:06.973617    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:16.871493 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:16.871460    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"]
Jul 07 14:34:16.871926 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:16.871686    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6" podUID="0762c6b1-9b26-4776-bc2b-ae156c656268" containerName="istio-proxy" containerID="cri-o://d2a6a8e11c292d59ef89555b66d3d7ff5091f42d1923eae3ac45b579392671ea" gracePeriod=30
Jul 07 14:34:17.425372 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.425322    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:17.553701 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.553675    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-podinfo\") pod \"0762c6b1-9b26-4776-bc2b-ae156c656268\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") "
Jul 07 14:34:17.553841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.553707    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-token\") pod \"0762c6b1-9b26-4776-bc2b-ae156c656268\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") "
Jul 07 14:34:17.553841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.553735    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0762c6b1-9b26-4776-bc2b-ae156c656268-istiod-ca-cert\") pod \"0762c6b1-9b26-4776-bc2b-ae156c656268\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") "
Jul 07 14:34:17.553841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.553754    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-workload-certs\") pod \"0762c6b1-9b26-4776-bc2b-ae156c656268\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") "
Jul 07 14:34:17.553841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.553774    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-envoy\") pod \"0762c6b1-9b26-4776-bc2b-ae156c656268\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") "
Jul 07 14:34:17.553841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.553798    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-data\") pod \"0762c6b1-9b26-4776-bc2b-ae156c656268\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") "
Jul 07 14:34:17.553841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.553814    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbzp9\" (UniqueName: \"kubernetes.io/projected/0762c6b1-9b26-4776-bc2b-ae156c656268-kube-api-access-cbzp9\") pod \"0762c6b1-9b26-4776-bc2b-ae156c656268\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") "
Jul 07 14:34:17.553841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.553841    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-credential-socket\") pod \"0762c6b1-9b26-4776-bc2b-ae156c656268\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") "
Jul 07 14:34:17.554151 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.553875    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-workload-socket\") pod \"0762c6b1-9b26-4776-bc2b-ae156c656268\" (UID: \"0762c6b1-9b26-4776-bc2b-ae156c656268\") "
Jul 07 14:34:17.554151 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.554099    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0762c6b1-9b26-4776-bc2b-ae156c656268" (UID: "0762c6b1-9b26-4776-bc2b-ae156c656268"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:17.554351 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.554316    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0762c6b1-9b26-4776-bc2b-ae156c656268" (UID: "0762c6b1-9b26-4776-bc2b-ae156c656268"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:17.554351 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.554334    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0762c6b1-9b26-4776-bc2b-ae156c656268" (UID: "0762c6b1-9b26-4776-bc2b-ae156c656268"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:17.554507 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.554407    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0762c6b1-9b26-4776-bc2b-ae156c656268-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0762c6b1-9b26-4776-bc2b-ae156c656268" (UID: "0762c6b1-9b26-4776-bc2b-ae156c656268"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:34:17.554665 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.554648    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-data" (OuterVolumeSpecName: "istio-data") pod "0762c6b1-9b26-4776-bc2b-ae156c656268" (UID: "0762c6b1-9b26-4776-bc2b-ae156c656268"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:17.556179 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.556160    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-token" (OuterVolumeSpecName: "istio-token") pod "0762c6b1-9b26-4776-bc2b-ae156c656268" (UID: "0762c6b1-9b26-4776-bc2b-ae156c656268"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:34:17.556294 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.556210    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0762c6b1-9b26-4776-bc2b-ae156c656268-kube-api-access-cbzp9" (OuterVolumeSpecName: "kube-api-access-cbzp9") pod "0762c6b1-9b26-4776-bc2b-ae156c656268" (UID: "0762c6b1-9b26-4776-bc2b-ae156c656268"). InnerVolumeSpecName "kube-api-access-cbzp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:34:17.556376 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.556357    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0762c6b1-9b26-4776-bc2b-ae156c656268" (UID: "0762c6b1-9b26-4776-bc2b-ae156c656268"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:34:17.556433 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.556356    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0762c6b1-9b26-4776-bc2b-ae156c656268" (UID: "0762c6b1-9b26-4776-bc2b-ae156c656268"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:17.655260 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.655223    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-podinfo\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:17.655260 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.655256    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-token\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:17.655384 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.655265    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0762c6b1-9b26-4776-bc2b-ae156c656268-istiod-ca-cert\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:17.655384 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.655273    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-workload-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:17.655384 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.655281    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-envoy\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:17.655384 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.655288    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-istio-data\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:17.655384 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.655295    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbzp9\" (UniqueName: \"kubernetes.io/projected/0762c6b1-9b26-4776-bc2b-ae156c656268-kube-api-access-cbzp9\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:17.655384 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.655305    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-credential-socket\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:17.655384 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:17.655313    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0762c6b1-9b26-4776-bc2b-ae156c656268-workload-socket\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:18.025820 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:18.025784    2557 generic.go:356] "Generic (PLEG): container finished" podID="0762c6b1-9b26-4776-bc2b-ae156c656268" containerID="d2a6a8e11c292d59ef89555b66d3d7ff5091f42d1923eae3ac45b579392671ea" exitCode=0
Jul 07 14:34:18.026217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:18.025826    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"
Jul 07 14:34:18.026217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:18.025853    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6" event={"ID":"0762c6b1-9b26-4776-bc2b-ae156c656268","Type":"ContainerDied","Data":"d2a6a8e11c292d59ef89555b66d3d7ff5091f42d1923eae3ac45b579392671ea"}
Jul 07 14:34:18.026217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:18.025904    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6" event={"ID":"0762c6b1-9b26-4776-bc2b-ae156c656268","Type":"ContainerDied","Data":"cd247650b866658c8dc29356b8273af03fcd7b24adc700bd7a7aa3cdf6cda1f4"}
Jul 07 14:34:18.026217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:18.025933    2557 scope.go:117] "RemoveContainer" containerID="d2a6a8e11c292d59ef89555b66d3d7ff5091f42d1923eae3ac45b579392671ea"
Jul 07 14:34:18.034973 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:18.034958    2557 scope.go:117] "RemoveContainer" containerID="d2a6a8e11c292d59ef89555b66d3d7ff5091f42d1923eae3ac45b579392671ea"
Jul 07 14:34:18.035216 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:34:18.035197    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2a6a8e11c292d59ef89555b66d3d7ff5091f42d1923eae3ac45b579392671ea\": container with ID starting with d2a6a8e11c292d59ef89555b66d3d7ff5091f42d1923eae3ac45b579392671ea not found: ID does not exist" containerID="d2a6a8e11c292d59ef89555b66d3d7ff5091f42d1923eae3ac45b579392671ea"
Jul 07 14:34:18.035296 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:18.035240    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2a6a8e11c292d59ef89555b66d3d7ff5091f42d1923eae3ac45b579392671ea"} err="failed to get container status \"d2a6a8e11c292d59ef89555b66d3d7ff5091f42d1923eae3ac45b579392671ea\": rpc error: code = NotFound desc = could not find container \"d2a6a8e11c292d59ef89555b66d3d7ff5091f42d1923eae3ac45b579392671ea\": container with ID starting with d2a6a8e11c292d59ef89555b66d3d7ff5091f42d1923eae3ac45b579392671ea not found: ID does not exist"
Jul 07 14:34:18.046511 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:18.046491    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"]
Jul 07 14:34:18.051647 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:18.051628    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-42700fcd-openshift-default-7b788b797f-6m4r6"]
Jul 07 14:34:19.117431 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:19.117396    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0762c6b1-9b26-4776-bc2b-ae156c656268" path="/var/lib/kubelet/pods/0762c6b1-9b26-4776-bc2b-ae156c656268/volumes"
Jul 07 14:34:22.763768 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.763735    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"]
Jul 07 14:34:22.764203 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.764083    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0762c6b1-9b26-4776-bc2b-ae156c656268" containerName="istio-proxy"
Jul 07 14:34:22.764203 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.764094    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0762c6b1-9b26-4776-bc2b-ae156c656268" containerName="istio-proxy"
Jul 07 14:34:22.764203 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.764180    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0762c6b1-9b26-4776-bc2b-ae156c656268" containerName="istio-proxy"
Jul 07 14:34:22.765901 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.765871    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:22.768478 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.768457    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-4b93c8a3-openshift-default-dockercfg-vxqjz\""
Jul 07 14:34:22.779711 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.779684    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"]
Jul 07 14:34:22.899554 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.899519    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-workload-certs\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:22.899734 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.899563    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-workload-socket\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:22.899734 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.899594    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-envoy\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:22.899734 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.899648    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqvgv\" (UniqueName: \"kubernetes.io/projected/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-kube-api-access-jqvgv\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:22.899734 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.899676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-podinfo\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:22.899734 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.899698    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-token\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:22.900000 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.899763    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-data\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:22.900000 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.899835    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-credential-socket\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:22.900000 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:22.899877    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istiod-ca-cert\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.000996 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.000968    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqvgv\" (UniqueName: \"kubernetes.io/projected/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-kube-api-access-jqvgv\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.001157 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.001000    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-podinfo\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.001157 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.001021    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-token\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.001360 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.001266    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-data\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.001360 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.001329    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-credential-socket\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.001360 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.001347    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istiod-ca-cert\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.001507 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.001375    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-workload-certs\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.001507 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.001405    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-workload-socket\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.001507 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.001434    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-envoy\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.001710 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.001681    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-data\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.001826 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.001717    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-credential-socket\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.001826 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.001787    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-workload-certs\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.001826 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.001812    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-workload-socket\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.002068 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.002045    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istiod-ca-cert\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.003578 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.003557    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-podinfo\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.003578 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.003569    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-envoy\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.009073 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.009050    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-token\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.009366 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.009350    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqvgv\" (UniqueName: \"kubernetes.io/projected/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-kube-api-access-jqvgv\") pod \"e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") " pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.078034 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.078006    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:23.210123 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.210100    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"]
Jul 07 14:34:23.212546 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:34:23.212520    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f718dfd_9eb9_45a4_8a31_fe87b97d08f3.slice/crio-8b649e99cf5c39acfa2c0944b799cabc8da2504b42b3e84266957ccb9a61ed10 WatchSource:0}: Error finding container 8b649e99cf5c39acfa2c0944b799cabc8da2504b42b3e84266957ccb9a61ed10: Status 404 returned error can't find the container with id 8b649e99cf5c39acfa2c0944b799cabc8da2504b42b3e84266957ccb9a61ed10
Jul 07 14:34:23.214987 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.214957    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:34:23.215065 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.215016    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:34:23.215065 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:23.215043    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:34:24.055384 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:24.055353    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw" event={"ID":"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3","Type":"ContainerStarted","Data":"1fa2113b52a2aa70b89509a0a7c4a4dd62999e144d7b7aa94a24986346bf43e5"}
Jul 07 14:34:24.055834 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:24.055398    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw" event={"ID":"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3","Type":"ContainerStarted","Data":"8b649e99cf5c39acfa2c0944b799cabc8da2504b42b3e84266957ccb9a61ed10"}
Jul 07 14:34:24.078822 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:24.078790    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:24.079089 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:24.079050    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw" podStartSLOduration=2.079036304 podStartE2EDuration="2.079036304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:24.077423653 +0000 UTC m=+1653.439746834" watchObservedRunningTime="2026-07-07 14:34:24.079036304 +0000 UTC m=+1653.441359470"
Jul 07 14:34:24.084434 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:24.084414    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:25.060171 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:25.060142    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:25.061133 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:25.061117    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:26.743759 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:26.743727    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:34:28.498126 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:28.498092    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"]
Jul 07 14:34:28.498549 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:28.498277    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw" podUID="6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" containerName="istio-proxy" containerID="cri-o://1fa2113b52a2aa70b89509a0a7c4a4dd62999e144d7b7aa94a24986346bf43e5" gracePeriod=30
Jul 07 14:34:34.242151 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.242127    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:34.314589 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.314558    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-workload-socket\") pod \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") "
Jul 07 14:34:34.314589 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.314590    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-token\") pod \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") "
Jul 07 14:34:34.314813 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.314613    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-credential-socket\") pod \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") "
Jul 07 14:34:34.314813 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.314640    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-workload-certs\") pod \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") "
Jul 07 14:34:34.314813 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.314660    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istiod-ca-cert\") pod \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") "
Jul 07 14:34:34.314813 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.314693    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-data\") pod \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") "
Jul 07 14:34:34.314813 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.314749    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-podinfo\") pod \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") "
Jul 07 14:34:34.314813 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.314784    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqvgv\" (UniqueName: \"kubernetes.io/projected/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-kube-api-access-jqvgv\") pod \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") "
Jul 07 14:34:34.315102 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.314856    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" (UID: "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:34.315102 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.314881    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" (UID: "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:34.315102 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.315023    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" (UID: "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:34.315275 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.315121    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-workload-socket\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:34.315275 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.315139    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-credential-socket\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:34.315275 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.315153    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-workload-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:34.315275 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.315160    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" (UID: "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:34:34.315651 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.315622    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" (UID: "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:34.316888 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.316866    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-kube-api-access-jqvgv" (OuterVolumeSpecName: "kube-api-access-jqvgv") pod "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" (UID: "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3"). InnerVolumeSpecName "kube-api-access-jqvgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:34:34.317002 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.316901    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" (UID: "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:34:34.317002 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.316958    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" (UID: "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:34:34.416121 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.416090    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-envoy\") pod \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\" (UID: \"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3\") "
Jul 07 14:34:34.416337 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.416322    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istiod-ca-cert\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:34.416394 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.416339    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-data\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:34.416394 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.416348    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-podinfo\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:34.416394 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.416356    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqvgv\" (UniqueName: \"kubernetes.io/projected/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-kube-api-access-jqvgv\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:34.416394 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.416364    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-token\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:34.417983 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.417961    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" (UID: "6f718dfd-9eb9-45a4-8a31-fe87b97d08f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:34:34.517457 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:34.517431    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3-istio-envoy\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:34:35.116601 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:35.116569    2557 generic.go:356] "Generic (PLEG): container finished" podID="6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" containerID="1fa2113b52a2aa70b89509a0a7c4a4dd62999e144d7b7aa94a24986346bf43e5" exitCode=0
Jul 07 14:34:35.116744 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:35.116686    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"
Jul 07 14:34:35.117126 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:35.117101    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw" event={"ID":"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3","Type":"ContainerDied","Data":"1fa2113b52a2aa70b89509a0a7c4a4dd62999e144d7b7aa94a24986346bf43e5"}
Jul 07 14:34:35.117195 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:35.117146    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw" event={"ID":"6f718dfd-9eb9-45a4-8a31-fe87b97d08f3","Type":"ContainerDied","Data":"8b649e99cf5c39acfa2c0944b799cabc8da2504b42b3e84266957ccb9a61ed10"}
Jul 07 14:34:35.117195 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:35.117169    2557 scope.go:117] "RemoveContainer" containerID="1fa2113b52a2aa70b89509a0a7c4a4dd62999e144d7b7aa94a24986346bf43e5"
Jul 07 14:34:35.126154 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:35.126131    2557 scope.go:117] "RemoveContainer" containerID="1fa2113b52a2aa70b89509a0a7c4a4dd62999e144d7b7aa94a24986346bf43e5"
Jul 07 14:34:35.126442 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:34:35.126425    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fa2113b52a2aa70b89509a0a7c4a4dd62999e144d7b7aa94a24986346bf43e5\": container with ID starting with 1fa2113b52a2aa70b89509a0a7c4a4dd62999e144d7b7aa94a24986346bf43e5 not found: ID does not exist" containerID="1fa2113b52a2aa70b89509a0a7c4a4dd62999e144d7b7aa94a24986346bf43e5"
Jul 07 14:34:35.126529 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:35.126451    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fa2113b52a2aa70b89509a0a7c4a4dd62999e144d7b7aa94a24986346bf43e5"} err="failed to get container status \"1fa2113b52a2aa70b89509a0a7c4a4dd62999e144d7b7aa94a24986346bf43e5\": rpc error: code = NotFound desc = could not find container \"1fa2113b52a2aa70b89509a0a7c4a4dd62999e144d7b7aa94a24986346bf43e5\": container with ID starting with 1fa2113b52a2aa70b89509a0a7c4a4dd62999e144d7b7aa94a24986346bf43e5 not found: ID does not exist"
Jul 07 14:34:35.142064 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:35.142041    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"]
Jul 07 14:34:35.146338 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:35.146317    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-4b93c8a3-openshift-default-7ccc5db5f-rgthw"]
Jul 07 14:34:35.153730 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:35.153710    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:34:37.117083 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:34:37.117046    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" path="/var/lib/kubelet/pods/6f718dfd-9eb9-45a4-8a31-fe87b97d08f3/volumes"
Jul 07 14:35:55.844363 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:35:55.844331    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:36:03.549787 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:03.549753    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:36:09.031059 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.031028    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"]
Jul 07 14:36:09.031487 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.031409    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" containerName="istio-proxy"
Jul 07 14:36:09.031487 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.031421    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" containerName="istio-proxy"
Jul 07 14:36:09.031487 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.031486    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f718dfd-9eb9-45a4-8a31-fe87b97d08f3" containerName="istio-proxy"
Jul 07 14:36:09.033406 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.033389    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.035761 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.035738    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3883e616-openshift-default-dockercfg-42hmq\""
Jul 07 14:36:09.050976 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.050946    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"]
Jul 07 14:36:09.094068 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.094035    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-data\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.094068 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.094071    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-envoy\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.094303 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.094092    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-token\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.094303 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.094143    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-workload-certs\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.094303 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.094221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-credential-socket\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.094303 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.094285    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-workload-socket\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.094430 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.094310    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-podinfo\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.094430 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.094334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxwrk\" (UniqueName: \"kubernetes.io/projected/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-kube-api-access-zxwrk\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.094430 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.094353    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istiod-ca-cert\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.195437 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.195400    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-data\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.195437 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.195442    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-envoy\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.195675 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.195458    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-token\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.195675 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.195486    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-workload-certs\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.195675 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.195520    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-credential-socket\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.195675 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.195587    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-workload-socket\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.195675 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.195618    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-podinfo\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.195675 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.195641    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxwrk\" (UniqueName: \"kubernetes.io/projected/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-kube-api-access-zxwrk\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.195675 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.195669    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istiod-ca-cert\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.196068 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.195857    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-data\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.196068 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.195895    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-credential-socket\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.196179 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.196112    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-workload-socket\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.196372 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.196350    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-workload-certs\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.196599 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.196575    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istiod-ca-cert\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.197966 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.197942    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-envoy\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.198252 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.198209    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-podinfo\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.203308 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.203280    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-token\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.203422 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.203407    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxwrk\" (UniqueName: \"kubernetes.io/projected/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-kube-api-access-zxwrk\") pod \"e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") " pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.343743 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.343708    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:09.476158 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.476125    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"]
Jul 07 14:36:09.478580 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:36:09.478549    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41de2b3_3b0f_40c9_9e6c_4a509e27d1e4.slice/crio-82cc87b55754c2c0efb273575a551ea5977fe083d112a7ff038eb16e3880b6c7 WatchSource:0}: Error finding container 82cc87b55754c2c0efb273575a551ea5977fe083d112a7ff038eb16e3880b6c7: Status 404 returned error can't find the container with id 82cc87b55754c2c0efb273575a551ea5977fe083d112a7ff038eb16e3880b6c7
Jul 07 14:36:09.480737 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.480707    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:36:09.480835 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.480790    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:36:09.480951 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.480857    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:36:09.529713 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:09.529686    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d" event={"ID":"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4","Type":"ContainerStarted","Data":"82cc87b55754c2c0efb273575a551ea5977fe083d112a7ff038eb16e3880b6c7"}
Jul 07 14:36:10.541273 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:10.541219    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d" event={"ID":"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4","Type":"ContainerStarted","Data":"74a881c9cf58bb9df51a5a9108efccd1fd3cd5b9fdd92add68d4a381a4fc36f0"}
Jul 07 14:36:10.560159 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:10.560109    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d" podStartSLOduration=1.560094839 podStartE2EDuration="1.560094839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:10.559076005 +0000 UTC m=+1759.921399172" watchObservedRunningTime="2026-07-07 14:36:10.560094839 +0000 UTC m=+1759.922418040"
Jul 07 14:36:11.244822 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:11.244784    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:36:11.344960 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:11.344923    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:11.349529 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:11.349504    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:11.546357 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:11.546268    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:11.547291 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:11.547275    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:21.345354 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:21.345312    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:36:26.548276 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:26.548168    2557 patch_prober.go:28] interesting pod/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 07 14:36:26.548276 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:26.548246    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d" podUID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 07 14:36:26.618757 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:26.618722    2557 generic.go:356] "Generic (PLEG): container finished" podID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" containerID="74a881c9cf58bb9df51a5a9108efccd1fd3cd5b9fdd92add68d4a381a4fc36f0" exitCode=0
Jul 07 14:36:26.618990 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:26.618762    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d" event={"ID":"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4","Type":"ContainerDied","Data":"74a881c9cf58bb9df51a5a9108efccd1fd3cd5b9fdd92add68d4a381a4fc36f0"}
Jul 07 14:36:26.619194 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:26.619176    2557 scope.go:117] "RemoveContainer" containerID="74a881c9cf58bb9df51a5a9108efccd1fd3cd5b9fdd92add68d4a381a4fc36f0"
Jul 07 14:36:26.620174 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:26.620141    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:36:26.620295 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:26.620258    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:36:26.620364 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:26.620319    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:36:27.627687 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:27.627653    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d" event={"ID":"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4","Type":"ContainerStarted","Data":"ef72ddac2fa6b64bc59fe1353b5e1a5a14d3133ec72cd10413f699be4d87789e"}
Jul 07 14:36:28.141593 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:28.141555    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:36:28.344596 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:28.344560    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:28.344776 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:28.344753    2557 patch_prober.go:28] interesting pod/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 07 14:36:28.344835 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:28.344815    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d" podUID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 07 14:36:29.345032 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:29.344997    2557 patch_prober.go:28] interesting pod/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 07 14:36:29.345442 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:29.345052    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d" podUID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 07 14:36:30.344535 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:30.344502    2557 patch_prober.go:28] interesting pod/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 07 14:36:30.344702 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:30.344563    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d" podUID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 07 14:36:30.471034 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:30.468496    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"]
Jul 07 14:36:30.471034 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:30.469440    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d" podUID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" containerName="istio-proxy" containerID="cri-o://ef72ddac2fa6b64bc59fe1353b5e1a5a14d3133ec72cd10413f699be4d87789e" gracePeriod=30
Jul 07 14:36:36.825073 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.825043    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:36.850931 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.850907    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-token\") pod \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") "
Jul 07 14:36:36.851067 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.850990    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-workload-certs\") pod \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") "
Jul 07 14:36:36.851067 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.851020    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-credential-socket\") pod \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") "
Jul 07 14:36:36.851067 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.851056    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-workload-socket\") pod \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") "
Jul 07 14:36:36.851224 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.851084    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-data\") pod \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") "
Jul 07 14:36:36.851224 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.851130    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-podinfo\") pod \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") "
Jul 07 14:36:36.851224 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.851154    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istiod-ca-cert\") pod \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") "
Jul 07 14:36:36.851224 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.851188    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-envoy\") pod \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") "
Jul 07 14:36:36.851224 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.851222    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxwrk\" (UniqueName: \"kubernetes.io/projected/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-kube-api-access-zxwrk\") pod \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\" (UID: \"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4\") "
Jul 07 14:36:36.851529 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.851338    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" (UID: "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:36:36.851529 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.851355    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" (UID: "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:36:36.851654 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.851565    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-workload-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:36:36.851654 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.851583    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-credential-socket\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:36:36.851654 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.851628    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" (UID: "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:36:36.851985 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.851757    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" (UID: "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:36:36.852459 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.852428    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" (UID: "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:36:36.853272 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.853207    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" (UID: "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:36:36.853597 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.853568    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-kube-api-access-zxwrk" (OuterVolumeSpecName: "kube-api-access-zxwrk") pod "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" (UID: "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4"). InnerVolumeSpecName "kube-api-access-zxwrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:36:36.853765 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.853737    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" (UID: "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:36:36.853765 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.853744    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" (UID: "e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:36:36.952245 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.952200    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-workload-socket\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:36:36.952245 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.952243    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-data\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:36:36.952245 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.952253    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-podinfo\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:36:36.952519 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.952263    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istiod-ca-cert\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:36:36.952519 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.952272    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-envoy\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:36:36.952519 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.952284    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxwrk\" (UniqueName: \"kubernetes.io/projected/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-kube-api-access-zxwrk\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:36:36.952519 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:36.952292    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4-istio-token\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:36:37.674916 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:37.674882    2557 generic.go:356] "Generic (PLEG): container finished" podID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" containerID="ef72ddac2fa6b64bc59fe1353b5e1a5a14d3133ec72cd10413f699be4d87789e" exitCode=0
Jul 07 14:36:37.675126 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:37.674936    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"
Jul 07 14:36:37.675126 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:37.674935    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d" event={"ID":"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4","Type":"ContainerDied","Data":"ef72ddac2fa6b64bc59fe1353b5e1a5a14d3133ec72cd10413f699be4d87789e"}
Jul 07 14:36:37.675126 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:37.675003    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d" event={"ID":"e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4","Type":"ContainerDied","Data":"82cc87b55754c2c0efb273575a551ea5977fe083d112a7ff038eb16e3880b6c7"}
Jul 07 14:36:37.675126 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:37.675032    2557 scope.go:117] "RemoveContainer" containerID="ef72ddac2fa6b64bc59fe1353b5e1a5a14d3133ec72cd10413f699be4d87789e"
Jul 07 14:36:37.684145 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:37.683921    2557 scope.go:117] "RemoveContainer" containerID="74a881c9cf58bb9df51a5a9108efccd1fd3cd5b9fdd92add68d4a381a4fc36f0"
Jul 07 14:36:37.691597 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:37.691578    2557 scope.go:117] "RemoveContainer" containerID="ef72ddac2fa6b64bc59fe1353b5e1a5a14d3133ec72cd10413f699be4d87789e"
Jul 07 14:36:37.691999 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:36:37.691969    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef72ddac2fa6b64bc59fe1353b5e1a5a14d3133ec72cd10413f699be4d87789e\": container with ID starting with ef72ddac2fa6b64bc59fe1353b5e1a5a14d3133ec72cd10413f699be4d87789e not found: ID does not exist" containerID="ef72ddac2fa6b64bc59fe1353b5e1a5a14d3133ec72cd10413f699be4d87789e"
Jul 07 14:36:37.692112 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:37.692006    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef72ddac2fa6b64bc59fe1353b5e1a5a14d3133ec72cd10413f699be4d87789e"} err="failed to get container status \"ef72ddac2fa6b64bc59fe1353b5e1a5a14d3133ec72cd10413f699be4d87789e\": rpc error: code = NotFound desc = could not find container \"ef72ddac2fa6b64bc59fe1353b5e1a5a14d3133ec72cd10413f699be4d87789e\": container with ID starting with ef72ddac2fa6b64bc59fe1353b5e1a5a14d3133ec72cd10413f699be4d87789e not found: ID does not exist"
Jul 07 14:36:37.692112 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:37.692025    2557 scope.go:117] "RemoveContainer" containerID="74a881c9cf58bb9df51a5a9108efccd1fd3cd5b9fdd92add68d4a381a4fc36f0"
Jul 07 14:36:37.692327 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:36:37.692298    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74a881c9cf58bb9df51a5a9108efccd1fd3cd5b9fdd92add68d4a381a4fc36f0\": container with ID starting with 74a881c9cf58bb9df51a5a9108efccd1fd3cd5b9fdd92add68d4a381a4fc36f0 not found: ID does not exist" containerID="74a881c9cf58bb9df51a5a9108efccd1fd3cd5b9fdd92add68d4a381a4fc36f0"
Jul 07 14:36:37.692389 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:37.692333    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a881c9cf58bb9df51a5a9108efccd1fd3cd5b9fdd92add68d4a381a4fc36f0"} err="failed to get container status \"74a881c9cf58bb9df51a5a9108efccd1fd3cd5b9fdd92add68d4a381a4fc36f0\": rpc error: code = NotFound desc = could not find container \"74a881c9cf58bb9df51a5a9108efccd1fd3cd5b9fdd92add68d4a381a4fc36f0\": container with ID starting with 74a881c9cf58bb9df51a5a9108efccd1fd3cd5b9fdd92add68d4a381a4fc36f0 not found: ID does not exist"
Jul 07 14:36:37.693296 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:37.693276    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"]
Jul 07 14:36:37.702614 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:37.702592    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3883e616-openshift-default-bd94cf5d7-9vv9d"]
Jul 07 14:36:39.117338 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:39.117306    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" path="/var/lib/kubelet/pods/e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4/volumes"
Jul 07 14:36:51.915318 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.915288    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"]
Jul 07 14:36:51.915841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.915736    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" containerName="istio-proxy"
Jul 07 14:36:51.915841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.915755    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" containerName="istio-proxy"
Jul 07 14:36:51.915841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.915775    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" containerName="istio-proxy"
Jul 07 14:36:51.915841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.915784    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" containerName="istio-proxy"
Jul 07 14:36:51.916104 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.915864    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" containerName="istio-proxy"
Jul 07 14:36:51.916104 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.915876    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e41de2b3-3b0f-40c9-9e6c-4a509e27d1e4" containerName="istio-proxy"
Jul 07 14:36:51.918544 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.918526    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:51.921344 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.921324    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-184c55e7-openshift-default-dockercfg-d6hkr\""
Jul 07 14:36:51.929555 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.929530    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"]
Jul 07 14:36:51.983150 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.983113    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-workload-certs\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:51.983360 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.983173    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5496fc18-0c16-4763-bfd9-01488d78cd89-istiod-ca-cert\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:51.983360 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.983225    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-podinfo\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:51.983360 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.983264    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99s99\" (UniqueName: \"kubernetes.io/projected/5496fc18-0c16-4763-bfd9-01488d78cd89-kube-api-access-99s99\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:51.983360 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.983289    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-data\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:51.983583 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.983394    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-credential-socket\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:51.983583 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.983435    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-token\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:51.983583 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.983485    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-workload-socket\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:51.983583 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:51.983508    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-envoy\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.084490 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.084454    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-credential-socket\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.084490 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.084489    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-token\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.084757 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.084514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-workload-socket\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.084757 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.084530    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-envoy\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.084757 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.084566    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-workload-certs\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.084757 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.084590    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5496fc18-0c16-4763-bfd9-01488d78cd89-istiod-ca-cert\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.084757 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.084615    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-podinfo\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.084757 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.084632    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99s99\" (UniqueName: \"kubernetes.io/projected/5496fc18-0c16-4763-bfd9-01488d78cd89-kube-api-access-99s99\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.084757 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.084661    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-data\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.085058 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.084911    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-credential-socket\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.085058 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.084952    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-workload-socket\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.085058 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.084990    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-data\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.085164 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.085077    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-workload-certs\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.085483 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.085463    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5496fc18-0c16-4763-bfd9-01488d78cd89-istiod-ca-cert\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.086957 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.086932    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-envoy\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.087190 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.087166    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-podinfo\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.092429 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.092408    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99s99\" (UniqueName: \"kubernetes.io/projected/5496fc18-0c16-4763-bfd9-01488d78cd89-kube-api-access-99s99\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.092512 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.092494    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-token\") pod \"e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") " pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.229283 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.229181    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:52.359323 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.359298    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"]
Jul 07 14:36:52.362575 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:36:52.362534    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5496fc18_0c16_4763_bfd9_01488d78cd89.slice/crio-8b60dfc46e5c369c07d8b435deb2a4526f7a4e1f1a0236403f241c30cb3e7320 WatchSource:0}: Error finding container 8b60dfc46e5c369c07d8b435deb2a4526f7a4e1f1a0236403f241c30cb3e7320: Status 404 returned error can't find the container with id 8b60dfc46e5c369c07d8b435deb2a4526f7a4e1f1a0236403f241c30cb3e7320
Jul 07 14:36:52.364736 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.364703    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:36:52.364815 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.364769    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:36:52.364815 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.364797    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:36:52.746700 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.746664    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" event={"ID":"5496fc18-0c16-4763-bfd9-01488d78cd89","Type":"ContainerStarted","Data":"8776b2607f627e91585936702943a3539d65ee7edccf6b747713fedb87484b97"}
Jul 07 14:36:52.746902 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.746722    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" event={"ID":"5496fc18-0c16-4763-bfd9-01488d78cd89","Type":"ContainerStarted","Data":"8b60dfc46e5c369c07d8b435deb2a4526f7a4e1f1a0236403f241c30cb3e7320"}
Jul 07 14:36:52.765416 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:52.765366    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" podStartSLOduration=1.765350016 podStartE2EDuration="1.765350016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:52.764650222 +0000 UTC m=+1802.126973396" watchObservedRunningTime="2026-07-07 14:36:52.765350016 +0000 UTC m=+1802.127673183"
Jul 07 14:36:53.229765 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:53.229726    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:53.234503 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:53.234477    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:53.751604 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:53.751569    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:36:53.752443 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:36:53.752425    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:37:00.438862 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:00.438825    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:37:08.752733 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:08.752699    2557 patch_prober.go:28] interesting pod/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 14:37:08.753167 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:08.752766    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 14:37:08.827058 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:08.827022    2557 generic.go:356] "Generic (PLEG): container finished" podID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerID="8776b2607f627e91585936702943a3539d65ee7edccf6b747713fedb87484b97" exitCode=0
Jul 07 14:37:08.827281 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:08.827070    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" event={"ID":"5496fc18-0c16-4763-bfd9-01488d78cd89","Type":"ContainerDied","Data":"8776b2607f627e91585936702943a3539d65ee7edccf6b747713fedb87484b97"}
Jul 07 14:37:08.827536 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:08.827519    2557 scope.go:117] "RemoveContainer" containerID="8776b2607f627e91585936702943a3539d65ee7edccf6b747713fedb87484b97"
Jul 07 14:37:08.828563 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:08.828528    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:37:08.828651 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:08.828614    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:37:08.828693 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:08.828651    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:37:09.833629 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:09.833593    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" event={"ID":"5496fc18-0c16-4763-bfd9-01488d78cd89","Type":"ContainerStarted","Data":"1b56e01e12fdf892f260df8384454e46e29e9bea1d43662b5d289c40d4ec681e"}
Jul 07 14:37:10.230215 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:10.230128    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:37:10.230415 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:10.230392    2557 patch_prober.go:28] interesting pod/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 14:37:10.230468 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:10.230440    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 14:37:11.230274 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:11.230206    2557 patch_prober.go:28] interesting pod/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 14:37:11.230762 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:11.230297    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 14:37:12.229659 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:12.229618    2557 patch_prober.go:28] interesting pod/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 14:37:12.229847 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:12.229667    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 14:37:13.230474 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:13.230444    2557 patch_prober.go:28] interesting pod/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 14:37:13.230865 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:13.230498    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 14:37:14.233533 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:14.233503    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:37:14.233979 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:14.233794    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:37:14.234509 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:14.234491    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:37:27.346073 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:27.346037    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:37:44.150464 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:44.150429    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:37:58.037691 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:37:58.037655    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:38:37.552455 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:37.552420    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:38:40.926765 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:40.926725    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"]
Jul 07 14:38:40.927156 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:40.926923    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerName="istio-proxy" containerID="cri-o://1b56e01e12fdf892f260df8384454e46e29e9bea1d43662b5d289c40d4ec681e" gracePeriod=30
Jul 07 14:38:44.236447 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:44.236409    2557 patch_prober.go:28] interesting pod/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 14:38:44.236825 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:44.236484    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 14:38:46.181973 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.181938    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:38:46.287877 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.287777    2557 generic.go:356] "Generic (PLEG): container finished" podID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerID="1b56e01e12fdf892f260df8384454e46e29e9bea1d43662b5d289c40d4ec681e" exitCode=0
Jul 07 14:38:46.287877 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.287826    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"
Jul 07 14:38:46.287877 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.287866    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" event={"ID":"5496fc18-0c16-4763-bfd9-01488d78cd89","Type":"ContainerDied","Data":"1b56e01e12fdf892f260df8384454e46e29e9bea1d43662b5d289c40d4ec681e"}
Jul 07 14:38:46.288185 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.287920    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f" event={"ID":"5496fc18-0c16-4763-bfd9-01488d78cd89","Type":"ContainerDied","Data":"8b60dfc46e5c369c07d8b435deb2a4526f7a4e1f1a0236403f241c30cb3e7320"}
Jul 07 14:38:46.288185 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.287941    2557 scope.go:117] "RemoveContainer" containerID="1b56e01e12fdf892f260df8384454e46e29e9bea1d43662b5d289c40d4ec681e"
Jul 07 14:38:46.290123 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.290099    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5496fc18-0c16-4763-bfd9-01488d78cd89-istiod-ca-cert\") pod \"5496fc18-0c16-4763-bfd9-01488d78cd89\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") "
Jul 07 14:38:46.290289 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.290129    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-envoy\") pod \"5496fc18-0c16-4763-bfd9-01488d78cd89\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") "
Jul 07 14:38:46.290289 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.290179    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-podinfo\") pod \"5496fc18-0c16-4763-bfd9-01488d78cd89\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") "
Jul 07 14:38:46.290289 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.290199    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-credential-socket\") pod \"5496fc18-0c16-4763-bfd9-01488d78cd89\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") "
Jul 07 14:38:46.290289 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.290223    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-token\") pod \"5496fc18-0c16-4763-bfd9-01488d78cd89\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") "
Jul 07 14:38:46.290289 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.290265    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-workload-socket\") pod \"5496fc18-0c16-4763-bfd9-01488d78cd89\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") "
Jul 07 14:38:46.290564 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.290292    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-workload-certs\") pod \"5496fc18-0c16-4763-bfd9-01488d78cd89\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") "
Jul 07 14:38:46.290564 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.290311    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99s99\" (UniqueName: \"kubernetes.io/projected/5496fc18-0c16-4763-bfd9-01488d78cd89-kube-api-access-99s99\") pod \"5496fc18-0c16-4763-bfd9-01488d78cd89\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") "
Jul 07 14:38:46.290564 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.290349    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-data\") pod \"5496fc18-0c16-4763-bfd9-01488d78cd89\" (UID: \"5496fc18-0c16-4763-bfd9-01488d78cd89\") "
Jul 07 14:38:46.290714 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.290604    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5496fc18-0c16-4763-bfd9-01488d78cd89" (UID: "5496fc18-0c16-4763-bfd9-01488d78cd89"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:38:46.290772 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.290760    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5496fc18-0c16-4763-bfd9-01488d78cd89" (UID: "5496fc18-0c16-4763-bfd9-01488d78cd89"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:38:46.290847 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.290821    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5496fc18-0c16-4763-bfd9-01488d78cd89-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5496fc18-0c16-4763-bfd9-01488d78cd89" (UID: "5496fc18-0c16-4763-bfd9-01488d78cd89"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:38:46.290952 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.290933    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5496fc18-0c16-4763-bfd9-01488d78cd89" (UID: "5496fc18-0c16-4763-bfd9-01488d78cd89"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:38:46.291420 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.291396    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-data" (OuterVolumeSpecName: "istio-data") pod "5496fc18-0c16-4763-bfd9-01488d78cd89" (UID: "5496fc18-0c16-4763-bfd9-01488d78cd89"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:38:46.292905 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.292878    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5496fc18-0c16-4763-bfd9-01488d78cd89" (UID: "5496fc18-0c16-4763-bfd9-01488d78cd89"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:38:46.293022 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.292998    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-token" (OuterVolumeSpecName: "istio-token") pod "5496fc18-0c16-4763-bfd9-01488d78cd89" (UID: "5496fc18-0c16-4763-bfd9-01488d78cd89"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:38:46.293210 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.293182    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5496fc18-0c16-4763-bfd9-01488d78cd89" (UID: "5496fc18-0c16-4763-bfd9-01488d78cd89"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:38:46.293389 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.293285    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5496fc18-0c16-4763-bfd9-01488d78cd89-kube-api-access-99s99" (OuterVolumeSpecName: "kube-api-access-99s99") pod "5496fc18-0c16-4763-bfd9-01488d78cd89" (UID: "5496fc18-0c16-4763-bfd9-01488d78cd89"). InnerVolumeSpecName "kube-api-access-99s99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:38:46.312252 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.312215    2557 scope.go:117] "RemoveContainer" containerID="8776b2607f627e91585936702943a3539d65ee7edccf6b747713fedb87484b97"
Jul 07 14:38:46.320871 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.320844    2557 scope.go:117] "RemoveContainer" containerID="1b56e01e12fdf892f260df8384454e46e29e9bea1d43662b5d289c40d4ec681e"
Jul 07 14:38:46.321164 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:38:46.321142    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b56e01e12fdf892f260df8384454e46e29e9bea1d43662b5d289c40d4ec681e\": container with ID starting with 1b56e01e12fdf892f260df8384454e46e29e9bea1d43662b5d289c40d4ec681e not found: ID does not exist" containerID="1b56e01e12fdf892f260df8384454e46e29e9bea1d43662b5d289c40d4ec681e"
Jul 07 14:38:46.321267 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.321175    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b56e01e12fdf892f260df8384454e46e29e9bea1d43662b5d289c40d4ec681e"} err="failed to get container status \"1b56e01e12fdf892f260df8384454e46e29e9bea1d43662b5d289c40d4ec681e\": rpc error: code = NotFound desc = could not find container \"1b56e01e12fdf892f260df8384454e46e29e9bea1d43662b5d289c40d4ec681e\": container with ID starting with 1b56e01e12fdf892f260df8384454e46e29e9bea1d43662b5d289c40d4ec681e not found: ID does not exist"
Jul 07 14:38:46.321267 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.321196    2557 scope.go:117] "RemoveContainer" containerID="8776b2607f627e91585936702943a3539d65ee7edccf6b747713fedb87484b97"
Jul 07 14:38:46.321535 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:38:46.321507    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8776b2607f627e91585936702943a3539d65ee7edccf6b747713fedb87484b97\": container with ID starting with 8776b2607f627e91585936702943a3539d65ee7edccf6b747713fedb87484b97 not found: ID does not exist" containerID="8776b2607f627e91585936702943a3539d65ee7edccf6b747713fedb87484b97"
Jul 07 14:38:46.321622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.321543    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8776b2607f627e91585936702943a3539d65ee7edccf6b747713fedb87484b97"} err="failed to get container status \"8776b2607f627e91585936702943a3539d65ee7edccf6b747713fedb87484b97\": rpc error: code = NotFound desc = could not find container \"8776b2607f627e91585936702943a3539d65ee7edccf6b747713fedb87484b97\": container with ID starting with 8776b2607f627e91585936702943a3539d65ee7edccf6b747713fedb87484b97 not found: ID does not exist"
Jul 07 14:38:46.391783 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.391749    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5496fc18-0c16-4763-bfd9-01488d78cd89-istiod-ca-cert\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:38:46.391783 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.391775    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-envoy\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:38:46.391783 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.391786    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-podinfo\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:38:46.392023 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.391794    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-credential-socket\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:38:46.392023 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.391805    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-token\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:38:46.392023 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.391813    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-workload-socket\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:38:46.392023 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.391823    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-workload-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:38:46.392023 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.391832    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99s99\" (UniqueName: \"kubernetes.io/projected/5496fc18-0c16-4763-bfd9-01488d78cd89-kube-api-access-99s99\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:38:46.392023 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.391840    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5496fc18-0c16-4763-bfd9-01488d78cd89-istio-data\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:38:46.609271 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.609244    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"]
Jul 07 14:38:46.612794 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:46.612772    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-184c55e7-openshift-default-b49f4b975-45h8f"]
Jul 07 14:38:47.117900 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:38:47.117868    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" path="/var/lib/kubelet/pods/5496fc18-0c16-4763-bfd9-01488d78cd89/volumes"
Jul 07 14:39:34.783018 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.782958    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"]
Jul 07 14:39:34.783561 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.783368    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerName="istio-proxy"
Jul 07 14:39:34.783561 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.783381    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerName="istio-proxy"
Jul 07 14:39:34.783561 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.783397    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerName="istio-proxy"
Jul 07 14:39:34.783561 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.783402    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerName="istio-proxy"
Jul 07 14:39:34.783561 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.783460    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerName="istio-proxy"
Jul 07 14:39:34.783561 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.783470    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5496fc18-0c16-4763-bfd9-01488d78cd89" containerName="istio-proxy"
Jul 07 14:39:34.785979 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.785963    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.788578 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.788559    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-fd6585-openshift-default-dockercfg-mtcgv\""
Jul 07 14:39:34.797113 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.797088    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"]
Jul 07 14:39:34.798628 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.798600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-envoy\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.798762 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.798640    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d0fbf9c-e757-4abb-88a7-84326703a432-istiod-ca-cert\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.798762 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.798671    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-data\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.798877 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.798782    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-workload-certs\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.798877 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.798832    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-podinfo\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.798989 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.798875    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-credential-socket\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.798989 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.798908    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsqcd\" (UniqueName: \"kubernetes.io/projected/1d0fbf9c-e757-4abb-88a7-84326703a432-kube-api-access-vsqcd\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.798989 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.798946    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-token\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.799147 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.799014    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-workload-socket\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.900302 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.900268    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-envoy\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.900302 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.900303    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d0fbf9c-e757-4abb-88a7-84326703a432-istiod-ca-cert\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.900517 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.900327    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-data\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.900517 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.900347    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-workload-certs\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.900517 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.900473    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-podinfo\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.900517 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.900511    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-credential-socket\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.900671 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.900548    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsqcd\" (UniqueName: \"kubernetes.io/projected/1d0fbf9c-e757-4abb-88a7-84326703a432-kube-api-access-vsqcd\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.900671 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.900581    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-token\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.900671 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.900661    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-workload-socket\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.900811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.900755    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-workload-certs\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.900878 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.900848    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-data\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.901017 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.900997    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-workload-socket\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.901146 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.901128    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d0fbf9c-e757-4abb-88a7-84326703a432-istiod-ca-cert\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.901146 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.901139    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-credential-socket\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.902765 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.902736    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-envoy\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.902890 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.902872    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-podinfo\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.910903 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.910876    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-token\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:34.911026 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:34.910942    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsqcd\" (UniqueName: \"kubernetes.io/projected/1d0fbf9c-e757-4abb-88a7-84326703a432-kube-api-access-vsqcd\") pod \"e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") " pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:35.095575 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:35.095534    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:35.231814 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:35.231759    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"]
Jul 07 14:39:35.234817 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:39:35.234789    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d0fbf9c_e757_4abb_88a7_84326703a432.slice/crio-a0c9ce51b08191b85cfb16862aeb9da6070323219f841561a3c20b07a3c212e8 WatchSource:0}: Error finding container a0c9ce51b08191b85cfb16862aeb9da6070323219f841561a3c20b07a3c212e8: Status 404 returned error can't find the container with id a0c9ce51b08191b85cfb16862aeb9da6070323219f841561a3c20b07a3c212e8
Jul 07 14:39:35.237505 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:35.237468    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:39:35.237582 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:35.237554    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:39:35.237623 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:35.237595    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:39:35.518286 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:35.518165    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9" event={"ID":"1d0fbf9c-e757-4abb-88a7-84326703a432","Type":"ContainerStarted","Data":"ce6c37edfca5f805ae4ad69d742399d29ac27a6ebbb6c7136848ede3a8c7d981"}
Jul 07 14:39:35.518286 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:35.518219    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9" event={"ID":"1d0fbf9c-e757-4abb-88a7-84326703a432","Type":"ContainerStarted","Data":"a0c9ce51b08191b85cfb16862aeb9da6070323219f841561a3c20b07a3c212e8"}
Jul 07 14:39:35.540594 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:35.540546    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9" podStartSLOduration=1.540528678 podStartE2EDuration="1.540528678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:35.53844189 +0000 UTC m=+1964.900765057" watchObservedRunningTime="2026-07-07 14:39:35.540528678 +0000 UTC m=+1964.902851845"
Jul 07 14:39:36.095681 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:36.095644    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:36.100541 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:36.100516    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:36.522596 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:36.522522    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:36.523539 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:36.523518    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:43.348415 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:43.348337    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:39:51.523477 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:51.523435    2557 patch_prober.go:28] interesting pod/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 07 14:39:51.523984 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:51.523505    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9" podUID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 07 14:39:51.600905 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:51.600869    2557 generic.go:356] "Generic (PLEG): container finished" podID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerID="ce6c37edfca5f805ae4ad69d742399d29ac27a6ebbb6c7136848ede3a8c7d981" exitCode=0
Jul 07 14:39:51.601074 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:51.600913    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9" event={"ID":"1d0fbf9c-e757-4abb-88a7-84326703a432","Type":"ContainerDied","Data":"ce6c37edfca5f805ae4ad69d742399d29ac27a6ebbb6c7136848ede3a8c7d981"}
Jul 07 14:39:51.601394 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:51.601377    2557 scope.go:117] "RemoveContainer" containerID="ce6c37edfca5f805ae4ad69d742399d29ac27a6ebbb6c7136848ede3a8c7d981"
Jul 07 14:39:51.602440 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:51.602410    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:39:51.602505 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:51.602480    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:39:51.602545 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:51.602514    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 14:39:52.607188 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:52.607156    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9" event={"ID":"1d0fbf9c-e757-4abb-88a7-84326703a432","Type":"ContainerStarted","Data":"5c4e04b9e390384cf1e2e46cd4460d3ab4c3d5e26c601660d0e5320487c5b23a"}
Jul 07 14:39:53.096663 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:53.096622    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:53.096884 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:53.096864    2557 patch_prober.go:28] interesting pod/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 07 14:39:53.096939 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:53.096914    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9" podUID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 07 14:39:54.096057 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:54.096022    2557 patch_prober.go:28] interesting pod/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 07 14:39:54.096470 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:54.096075    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9" podUID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 07 14:39:54.544686 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:54.544601    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:39:55.096188 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:55.096145    2557 patch_prober.go:28] interesting pod/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 07 14:39:55.096654 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:55.096209    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9" podUID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 07 14:39:56.096435 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:56.096403    2557 patch_prober.go:28] interesting pod/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 07 14:39:56.096828 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:56.096470    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9" podUID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 07 14:39:57.099898 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:57.099870    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:57.100284 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:57.100178    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:39:57.100890 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:39:57.100874    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:40:06.650127 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:06.650090    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:40:30.917115 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:30.917083    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"]
Jul 07 14:40:30.920531 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:30.920514    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:30.924344 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:30.924325    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8d4709\"/\"openshift-service-ca.crt\""
Jul 07 14:40:30.924482 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:30.924440    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8d4709\"/\"test-model-8d4709-kserve-self-signed-certs\""
Jul 07 14:40:30.924482 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:30.924450    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8d4709\"/\"default-dockercfg-mbtfk\""
Jul 07 14:40:30.924482 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:30.924475    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8d4709\"/\"kube-root-ca.crt\""
Jul 07 14:40:30.927882 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:30.927694    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"]
Jul 07 14:40:30.990390 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:30.990356    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-tmp-dir\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:30.990390 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:30.990390    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdqp5\" (UniqueName: \"kubernetes.io/projected/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-kube-api-access-gdqp5\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:30.990587 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:30.990442    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-dshm\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:30.990587 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:30.990512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-home\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:30.990587 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:30.990533    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-model-cache\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:30.990587 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:30.990564    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-tls-certs\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.091202 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.091164    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-dshm\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.091403 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.091341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-home\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.091403 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.091364    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-model-cache\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.091403 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.091385    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-tls-certs\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.091568 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.091419    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-tmp-dir\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.091568 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.091446    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdqp5\" (UniqueName: \"kubernetes.io/projected/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-kube-api-access-gdqp5\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.091765 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.091729    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-home\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.091835 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.091765    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-model-cache\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.091835 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.091786    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-tmp-dir\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.093555 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.093533    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-dshm\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.093951 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.093929    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-tls-certs\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.099061 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.099035    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdqp5\" (UniqueName: \"kubernetes.io/projected/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-kube-api-access-gdqp5\") pod \"test-model-8d4709-kserve-97985669-rh2wh\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") " pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.231334 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.231249    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:31.364580 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.364555    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"]
Jul 07 14:40:31.365979 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:40:31.365954    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod948a0b25_f28a_4e2e_85fd_cc7d9160bc22.slice/crio-26a04cfa01fa83938b3f3dc1aec604567e842a4b1c6d32860b1e0c29df96c57f WatchSource:0}: Error finding container 26a04cfa01fa83938b3f3dc1aec604567e842a4b1c6d32860b1e0c29df96c57f: Status 404 returned error can't find the container with id 26a04cfa01fa83938b3f3dc1aec604567e842a4b1c6d32860b1e0c29df96c57f
Jul 07 14:40:31.790081 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.790039    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh" event={"ID":"948a0b25-f28a-4e2e-85fd-cc7d9160bc22","Type":"ContainerStarted","Data":"defc923f0702f5441c6249848636e3836fe6d68b9362a694331b8fb9fd6d0d6c"}
Jul 07 14:40:31.790272 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.790090    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh" event={"ID":"948a0b25-f28a-4e2e-85fd-cc7d9160bc22","Type":"ContainerStarted","Data":"26a04cfa01fa83938b3f3dc1aec604567e842a4b1c6d32860b1e0c29df96c57f"}
Jul 07 14:40:31.806846 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:31.806799    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh" podStartSLOduration=1.806786422 podStartE2EDuration="1.806786422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:40:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:40:31.806313541 +0000 UTC m=+2021.168636707" watchObservedRunningTime="2026-07-07 14:40:31.806786422 +0000 UTC m=+2021.169109623"
Jul 07 14:40:35.254375 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:35.254340    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:40:41.232341 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:41.232296    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:41.232841 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:41.232353    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:41.244605 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:41.244576    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:41.848407 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:41.848379    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:40:51.242902 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:51.242870    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:40:51.642653 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:40:51.642619    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"]
Jul 07 14:41:02.246092 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:02.246054    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:41:06.662819 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:06.662780    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh" podUID="948a0b25-f28a-4e2e-85fd-cc7d9160bc22" containerName="main" containerID="cri-o://defc923f0702f5441c6249848636e3836fe6d68b9362a694331b8fb9fd6d0d6c" gracePeriod=45
Jul 07 14:41:06.918122 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:06.918059    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:41:06.951092 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:06.951057    2557 generic.go:356] "Generic (PLEG): container finished" podID="948a0b25-f28a-4e2e-85fd-cc7d9160bc22" containerID="defc923f0702f5441c6249848636e3836fe6d68b9362a694331b8fb9fd6d0d6c" exitCode=0
Jul 07 14:41:06.951270 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:06.951091    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"
Jul 07 14:41:06.951270 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:06.951134    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh" event={"ID":"948a0b25-f28a-4e2e-85fd-cc7d9160bc22","Type":"ContainerDied","Data":"defc923f0702f5441c6249848636e3836fe6d68b9362a694331b8fb9fd6d0d6c"}
Jul 07 14:41:06.951270 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:06.951176    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh" event={"ID":"948a0b25-f28a-4e2e-85fd-cc7d9160bc22","Type":"ContainerDied","Data":"26a04cfa01fa83938b3f3dc1aec604567e842a4b1c6d32860b1e0c29df96c57f"}
Jul 07 14:41:06.951270 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:06.951205    2557 scope.go:117] "RemoveContainer" containerID="defc923f0702f5441c6249848636e3836fe6d68b9362a694331b8fb9fd6d0d6c"
Jul 07 14:41:06.961703 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:06.961680    2557 scope.go:117] "RemoveContainer" containerID="defc923f0702f5441c6249848636e3836fe6d68b9362a694331b8fb9fd6d0d6c"
Jul 07 14:41:06.962132 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:41:06.962108    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"defc923f0702f5441c6249848636e3836fe6d68b9362a694331b8fb9fd6d0d6c\": container with ID starting with defc923f0702f5441c6249848636e3836fe6d68b9362a694331b8fb9fd6d0d6c not found: ID does not exist" containerID="defc923f0702f5441c6249848636e3836fe6d68b9362a694331b8fb9fd6d0d6c"
Jul 07 14:41:06.962216 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:06.962145    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"defc923f0702f5441c6249848636e3836fe6d68b9362a694331b8fb9fd6d0d6c"} err="failed to get container status \"defc923f0702f5441c6249848636e3836fe6d68b9362a694331b8fb9fd6d0d6c\": rpc error: code = NotFound desc = could not find container \"defc923f0702f5441c6249848636e3836fe6d68b9362a694331b8fb9fd6d0d6c\": container with ID starting with defc923f0702f5441c6249848636e3836fe6d68b9362a694331b8fb9fd6d0d6c not found: ID does not exist"
Jul 07 14:41:07.109361 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.109333    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-dshm\") pod \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") "
Jul 07 14:41:07.109547 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.109405    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-model-cache\") pod \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") "
Jul 07 14:41:07.109547 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.109428    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-tls-certs\") pod \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") "
Jul 07 14:41:07.109547 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.109449    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-home\") pod \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") "
Jul 07 14:41:07.109547 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.109474    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-tmp-dir\") pod \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") "
Jul 07 14:41:07.109547 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.109529    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdqp5\" (UniqueName: \"kubernetes.io/projected/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-kube-api-access-gdqp5\") pod \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\" (UID: \"948a0b25-f28a-4e2e-85fd-cc7d9160bc22\") "
Jul 07 14:41:07.109817 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.109784    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-home" (OuterVolumeSpecName: "home") pod "948a0b25-f28a-4e2e-85fd-cc7d9160bc22" (UID: "948a0b25-f28a-4e2e-85fd-cc7d9160bc22"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:07.109817 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.109787    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "948a0b25-f28a-4e2e-85fd-cc7d9160bc22" (UID: "948a0b25-f28a-4e2e-85fd-cc7d9160bc22"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:07.109892 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.109834    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-model-cache" (OuterVolumeSpecName: "model-cache") pod "948a0b25-f28a-4e2e-85fd-cc7d9160bc22" (UID: "948a0b25-f28a-4e2e-85fd-cc7d9160bc22"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:07.111692 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.111661    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-dshm" (OuterVolumeSpecName: "dshm") pod "948a0b25-f28a-4e2e-85fd-cc7d9160bc22" (UID: "948a0b25-f28a-4e2e-85fd-cc7d9160bc22"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:07.111809 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.111746    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-kube-api-access-gdqp5" (OuterVolumeSpecName: "kube-api-access-gdqp5") pod "948a0b25-f28a-4e2e-85fd-cc7d9160bc22" (UID: "948a0b25-f28a-4e2e-85fd-cc7d9160bc22"). InnerVolumeSpecName "kube-api-access-gdqp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:41:07.111809 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.111769    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "948a0b25-f28a-4e2e-85fd-cc7d9160bc22" (UID: "948a0b25-f28a-4e2e-85fd-cc7d9160bc22"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:41:07.210563 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.210481    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-model-cache\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:07.210563 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.210508    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-tls-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:07.210563 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.210516    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-home\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:07.210563 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.210544    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-tmp-dir\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:07.210563 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.210553    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdqp5\" (UniqueName: \"kubernetes.io/projected/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-kube-api-access-gdqp5\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:07.210563 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.210563    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/948a0b25-f28a-4e2e-85fd-cc7d9160bc22-dshm\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:07.267690 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.267663    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"]
Jul 07 14:41:07.270824 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:07.270801    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-8d4709/test-model-8d4709-kserve-97985669-rh2wh"]
Jul 07 14:41:09.118079 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:09.118047    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="948a0b25-f28a-4e2e-85fd-cc7d9160bc22" path="/var/lib/kubelet/pods/948a0b25-f28a-4e2e-85fd-cc7d9160bc22/volumes"
Jul 07 14:41:34.199548 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:34.199513    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"]
Jul 07 14:41:34.200162 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:34.199763    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9" podUID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerName="istio-proxy" containerID="cri-o://5c4e04b9e390384cf1e2e46cd4460d3ab4c3d5e26c601660d0e5320487c5b23a" gracePeriod=30
Jul 07 14:41:38.238916 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:38.238881    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:41:39.459270 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.459225    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:41:39.586131 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586097    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-workload-certs\") pod \"1d0fbf9c-e757-4abb-88a7-84326703a432\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") "
Jul 07 14:41:39.586353 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586163    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-podinfo\") pod \"1d0fbf9c-e757-4abb-88a7-84326703a432\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") "
Jul 07 14:41:39.586353 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586192    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-workload-socket\") pod \"1d0fbf9c-e757-4abb-88a7-84326703a432\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") "
Jul 07 14:41:39.586353 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586219    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d0fbf9c-e757-4abb-88a7-84326703a432-istiod-ca-cert\") pod \"1d0fbf9c-e757-4abb-88a7-84326703a432\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") "
Jul 07 14:41:39.586353 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586285    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-credential-socket\") pod \"1d0fbf9c-e757-4abb-88a7-84326703a432\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") "
Jul 07 14:41:39.586353 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586321    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsqcd\" (UniqueName: \"kubernetes.io/projected/1d0fbf9c-e757-4abb-88a7-84326703a432-kube-api-access-vsqcd\") pod \"1d0fbf9c-e757-4abb-88a7-84326703a432\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") "
Jul 07 14:41:39.586643 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586360    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-envoy\") pod \"1d0fbf9c-e757-4abb-88a7-84326703a432\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") "
Jul 07 14:41:39.586643 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586396    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-token\") pod \"1d0fbf9c-e757-4abb-88a7-84326703a432\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") "
Jul 07 14:41:39.586643 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586465    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-data\") pod \"1d0fbf9c-e757-4abb-88a7-84326703a432\" (UID: \"1d0fbf9c-e757-4abb-88a7-84326703a432\") "
Jul 07 14:41:39.586643 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586503    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d0fbf9c-e757-4abb-88a7-84326703a432" (UID: "1d0fbf9c-e757-4abb-88a7-84326703a432"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:39.586643 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586576    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d0fbf9c-e757-4abb-88a7-84326703a432" (UID: "1d0fbf9c-e757-4abb-88a7-84326703a432"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:39.586643 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586512    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d0fbf9c-e757-4abb-88a7-84326703a432" (UID: "1d0fbf9c-e757-4abb-88a7-84326703a432"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:39.586893 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586706    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d0fbf9c-e757-4abb-88a7-84326703a432-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d0fbf9c-e757-4abb-88a7-84326703a432" (UID: "1d0fbf9c-e757-4abb-88a7-84326703a432"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:41:39.586893 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586793    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-workload-socket\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:39.586893 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586812    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d0fbf9c-e757-4abb-88a7-84326703a432-istiod-ca-cert\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:39.586893 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586826    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-credential-socket\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:39.587101 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.586937    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-workload-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:39.587710 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.587679    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d0fbf9c-e757-4abb-88a7-84326703a432" (UID: "1d0fbf9c-e757-4abb-88a7-84326703a432"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:39.588448 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.588428    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d0fbf9c-e757-4abb-88a7-84326703a432" (UID: "1d0fbf9c-e757-4abb-88a7-84326703a432"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:41:39.588535 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.588515    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d0fbf9c-e757-4abb-88a7-84326703a432" (UID: "1d0fbf9c-e757-4abb-88a7-84326703a432"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:41:39.588589 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.588568    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d0fbf9c-e757-4abb-88a7-84326703a432-kube-api-access-vsqcd" (OuterVolumeSpecName: "kube-api-access-vsqcd") pod "1d0fbf9c-e757-4abb-88a7-84326703a432" (UID: "1d0fbf9c-e757-4abb-88a7-84326703a432"). InnerVolumeSpecName "kube-api-access-vsqcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:41:39.588657 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.588640    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d0fbf9c-e757-4abb-88a7-84326703a432" (UID: "1d0fbf9c-e757-4abb-88a7-84326703a432"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:41:39.688244 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.688198    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsqcd\" (UniqueName: \"kubernetes.io/projected/1d0fbf9c-e757-4abb-88a7-84326703a432-kube-api-access-vsqcd\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:39.688244 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.688252    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-envoy\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:39.688474 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.688262    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-token\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:39.688474 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.688270    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-data\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:39.688474 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:39.688278    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d0fbf9c-e757-4abb-88a7-84326703a432-istio-podinfo\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:41:40.106915 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:40.106882    2557 generic.go:356] "Generic (PLEG): container finished" podID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerID="5c4e04b9e390384cf1e2e46cd4460d3ab4c3d5e26c601660d0e5320487c5b23a" exitCode=0
Jul 07 14:41:40.107080 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:40.106929    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"
Jul 07 14:41:40.107080 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:40.106959    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9" event={"ID":"1d0fbf9c-e757-4abb-88a7-84326703a432","Type":"ContainerDied","Data":"5c4e04b9e390384cf1e2e46cd4460d3ab4c3d5e26c601660d0e5320487c5b23a"}
Jul 07 14:41:40.107080 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:40.107012    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9" event={"ID":"1d0fbf9c-e757-4abb-88a7-84326703a432","Type":"ContainerDied","Data":"a0c9ce51b08191b85cfb16862aeb9da6070323219f841561a3c20b07a3c212e8"}
Jul 07 14:41:40.107080 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:40.107035    2557 scope.go:117] "RemoveContainer" containerID="5c4e04b9e390384cf1e2e46cd4460d3ab4c3d5e26c601660d0e5320487c5b23a"
Jul 07 14:41:40.115783 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:40.115768    2557 scope.go:117] "RemoveContainer" containerID="ce6c37edfca5f805ae4ad69d742399d29ac27a6ebbb6c7136848ede3a8c7d981"
Jul 07 14:41:40.123291 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:40.123276    2557 scope.go:117] "RemoveContainer" containerID="5c4e04b9e390384cf1e2e46cd4460d3ab4c3d5e26c601660d0e5320487c5b23a"
Jul 07 14:41:40.123520 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:41:40.123497    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c4e04b9e390384cf1e2e46cd4460d3ab4c3d5e26c601660d0e5320487c5b23a\": container with ID starting with 5c4e04b9e390384cf1e2e46cd4460d3ab4c3d5e26c601660d0e5320487c5b23a not found: ID does not exist" containerID="5c4e04b9e390384cf1e2e46cd4460d3ab4c3d5e26c601660d0e5320487c5b23a"
Jul 07 14:41:40.123612 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:40.123525    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c4e04b9e390384cf1e2e46cd4460d3ab4c3d5e26c601660d0e5320487c5b23a"} err="failed to get container status \"5c4e04b9e390384cf1e2e46cd4460d3ab4c3d5e26c601660d0e5320487c5b23a\": rpc error: code = NotFound desc = could not find container \"5c4e04b9e390384cf1e2e46cd4460d3ab4c3d5e26c601660d0e5320487c5b23a\": container with ID starting with 5c4e04b9e390384cf1e2e46cd4460d3ab4c3d5e26c601660d0e5320487c5b23a not found: ID does not exist"
Jul 07 14:41:40.123612 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:40.123541    2557 scope.go:117] "RemoveContainer" containerID="ce6c37edfca5f805ae4ad69d742399d29ac27a6ebbb6c7136848ede3a8c7d981"
Jul 07 14:41:40.123796 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:41:40.123780    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce6c37edfca5f805ae4ad69d742399d29ac27a6ebbb6c7136848ede3a8c7d981\": container with ID starting with ce6c37edfca5f805ae4ad69d742399d29ac27a6ebbb6c7136848ede3a8c7d981 not found: ID does not exist" containerID="ce6c37edfca5f805ae4ad69d742399d29ac27a6ebbb6c7136848ede3a8c7d981"
Jul 07 14:41:40.123833 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:40.123801    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce6c37edfca5f805ae4ad69d742399d29ac27a6ebbb6c7136848ede3a8c7d981"} err="failed to get container status \"ce6c37edfca5f805ae4ad69d742399d29ac27a6ebbb6c7136848ede3a8c7d981\": rpc error: code = NotFound desc = could not find container \"ce6c37edfca5f805ae4ad69d742399d29ac27a6ebbb6c7136848ede3a8c7d981\": container with ID starting with ce6c37edfca5f805ae4ad69d742399d29ac27a6ebbb6c7136848ede3a8c7d981 not found: ID does not exist"
Jul 07 14:41:40.127035 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:40.127016    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"]
Jul 07 14:41:40.131222 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:40.131204    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-fd6585-openshift-default-7d5cf6cf8f-9t7k9"]
Jul 07 14:41:41.117280 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:41.117252    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d0fbf9c-e757-4abb-88a7-84326703a432" path="/var/lib/kubelet/pods/1d0fbf9c-e757-4abb-88a7-84326703a432/volumes"
Jul 07 14:41:52.043293 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:41:52.043260    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:42:03.046688 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:03.046656    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:42:12.747545 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:12.747504    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:42:22.052322 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:22.052287    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:42:34.340501 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:34.340468    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:42:45.718575 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.718493    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"]
Jul 07 14:42:45.719005 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.718828    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="948a0b25-f28a-4e2e-85fd-cc7d9160bc22" containerName="main"
Jul 07 14:42:45.719005 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.718840    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="948a0b25-f28a-4e2e-85fd-cc7d9160bc22" containerName="main"
Jul 07 14:42:45.719005 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.718855    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerName="istio-proxy"
Jul 07 14:42:45.719005 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.718861    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerName="istio-proxy"
Jul 07 14:42:45.719005 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.718913    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerName="istio-proxy"
Jul 07 14:42:45.719005 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.718923    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerName="istio-proxy"
Jul 07 14:42:45.719005 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.718929    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="948a0b25-f28a-4e2e-85fd-cc7d9160bc22" containerName="main"
Jul 07 14:42:45.721801 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.721785    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.724160 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.724139    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-cc2ffa\"/\"default-dockercfg-4mzsj\""
Jul 07 14:42:45.725197 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.725181    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-cc2ffa\"/\"kube-root-ca.crt\""
Jul 07 14:42:45.725315 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.725240    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-cc2ffa\"/\"openshift-service-ca.crt\""
Jul 07 14:42:45.725315 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.725247    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-cc2ffa\"/\"auth-test-model-cc2ffa-kserve-self-signed-certs\""
Jul 07 14:42:45.731188 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.731168    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"]
Jul 07 14:42:45.842420 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.842388    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a7c6279-36c7-4ab4-8281-358f5a4fac04-tls-certs\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.842606 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.842426    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-model-cache\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.842606 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.842455    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-tmp-dir\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.842606 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.842508    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqt9z\" (UniqueName: \"kubernetes.io/projected/5a7c6279-36c7-4ab4-8281-358f5a4fac04-kube-api-access-fqt9z\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.842606 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.842580    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-home\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.842856 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.842611    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-dshm\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.943553 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.943516    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-tmp-dir\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.943720 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.943565    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqt9z\" (UniqueName: \"kubernetes.io/projected/5a7c6279-36c7-4ab4-8281-358f5a4fac04-kube-api-access-fqt9z\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.943720 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.943676    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-home\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.943720 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.943710    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-dshm\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.943895 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.943772    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a7c6279-36c7-4ab4-8281-358f5a4fac04-tls-certs\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.943895 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.943799    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-model-cache\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.944010 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.943954    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-tmp-dir\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.944101 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.944082    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-home\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.944182 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.944161    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-model-cache\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.945920 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.945899    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-dshm\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.946151 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.946135    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a7c6279-36c7-4ab4-8281-358f5a4fac04-tls-certs\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:45.950768 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:45.950745    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqt9z\" (UniqueName: \"kubernetes.io/projected/5a7c6279-36c7-4ab4-8281-358f5a4fac04-kube-api-access-fqt9z\") pod \"auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") " pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:46.030671 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:46.030603    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:46.158325 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:46.158303    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"]
Jul 07 14:42:46.160876 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:42:46.160850    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a7c6279_36c7_4ab4_8281_358f5a4fac04.slice/crio-29c80fdbc8a6a474043cfdc074f1131227e1b36490eb899c24b07dd063febb65 WatchSource:0}: Error finding container 29c80fdbc8a6a474043cfdc074f1131227e1b36490eb899c24b07dd063febb65: Status 404 returned error can't find the container with id 29c80fdbc8a6a474043cfdc074f1131227e1b36490eb899c24b07dd063febb65
Jul 07 14:42:46.410100 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:46.410058    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64" event={"ID":"5a7c6279-36c7-4ab4-8281-358f5a4fac04","Type":"ContainerStarted","Data":"5eea72b27b6e3cee818ac41bec813ceb205e36473d6523e71e8e671bf9db0094"}
Jul 07 14:42:46.410313 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:46.410110    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64" event={"ID":"5a7c6279-36c7-4ab4-8281-358f5a4fac04","Type":"ContainerStarted","Data":"29c80fdbc8a6a474043cfdc074f1131227e1b36490eb899c24b07dd063febb65"}
Jul 07 14:42:46.425803 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:46.425742    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64" podStartSLOduration=1.425726974 podStartE2EDuration="1.425726974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:42:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:42:46.425275586 +0000 UTC m=+2155.787598754" watchObservedRunningTime="2026-07-07 14:42:46.425726974 +0000 UTC m=+2155.788050141"
Jul 07 14:42:49.441882 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:49.441846    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:42:56.031547 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:56.031510    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:56.032017 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:56.031563    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:56.044112 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:56.044086    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:42:56.464576 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:42:56.464548    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:43:20.140526 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:43:20.140490    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:43:43.362640 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:43:43.362607    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:44:00.544477 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:44:00.544439    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:44:15.255405 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:44:15.255329    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:44:32.649431 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:44:32.649397    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:44:49.045839 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:44:49.045808    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:45:05.146091 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:05.146060    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:45:22.043784 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:22.043752    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:45:26.386923 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:26.386887    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"]
Jul 07 14:45:38.007352 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.007320    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"]
Jul 07 14:45:38.007803 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.007671    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerName="istio-proxy"
Jul 07 14:45:38.007803 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.007682    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d0fbf9c-e757-4abb-88a7-84326703a432" containerName="istio-proxy"
Jul 07 14:45:38.010823 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.010807    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.013326 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.013307    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-cc2ffa\"/\"sub-test-model-cc2ffa-kserve-self-signed-certs\""
Jul 07 14:45:38.020505 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.020484    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"]
Jul 07 14:45:38.063496 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.063469    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4094670e-232a-4fb3-8f08-6644c44af34e-tls-certs\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.063601 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.063511    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-dshm\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.063601 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.063550    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-home\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.063601 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.063567    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-555vs\" (UniqueName: \"kubernetes.io/projected/4094670e-232a-4fb3-8f08-6644c44af34e-kube-api-access-555vs\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.063703 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.063599    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-tmp-dir\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.063703 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.063670    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-model-cache\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.164690 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.164657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-tmp-dir\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.164690 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.164691    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-model-cache\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.164882 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.164717    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4094670e-232a-4fb3-8f08-6644c44af34e-tls-certs\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.164882 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.164838    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-dshm\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.164949 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.164906    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-home\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.165038 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.165015    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-555vs\" (UniqueName: \"kubernetes.io/projected/4094670e-232a-4fb3-8f08-6644c44af34e-kube-api-access-555vs\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.165102 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.165065    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-tmp-dir\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.165159 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.165118    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-model-cache\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.165218 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.165195    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-home\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.167061 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.167038    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-dshm\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.167174 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.167153    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4094670e-232a-4fb3-8f08-6644c44af34e-tls-certs\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.172091 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.172072    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-555vs\" (UniqueName: \"kubernetes.io/projected/4094670e-232a-4fb3-8f08-6644c44af34e-kube-api-access-555vs\") pod \"sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") " pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.246984 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.246961    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:45:38.320630 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.320605    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:38.447857 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:38.447823    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"]
Jul 07 14:45:38.450026 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:45:38.450002    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4094670e_232a_4fb3_8f08_6644c44af34e.slice/crio-bb5c4fbcbb8202600114e744dee12cc700a4f4211eb775fefe9bb82030bb082f WatchSource:0}: Error finding container bb5c4fbcbb8202600114e744dee12cc700a4f4211eb775fefe9bb82030bb082f: Status 404 returned error can't find the container with id bb5c4fbcbb8202600114e744dee12cc700a4f4211eb775fefe9bb82030bb082f
Jul 07 14:45:39.183967 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:39.183931    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b" event={"ID":"4094670e-232a-4fb3-8f08-6644c44af34e","Type":"ContainerStarted","Data":"41e5773e25b5389fbe2e9848251afcde5a3ce02e9a47c736569c2b73b5dd8b5e"}
Jul 07 14:45:39.184444 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:39.183981    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b" event={"ID":"4094670e-232a-4fb3-8f08-6644c44af34e","Type":"ContainerStarted","Data":"bb5c4fbcbb8202600114e744dee12cc700a4f4211eb775fefe9bb82030bb082f"}
Jul 07 14:45:39.199816 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:39.199771    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b" podStartSLOduration=2.199756798 podStartE2EDuration="2.199756798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:45:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:45:39.198974632 +0000 UTC m=+2328.561297797" watchObservedRunningTime="2026-07-07 14:45:39.199756798 +0000 UTC m=+2328.562080011"
Jul 07 14:45:41.406963 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.406914    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64" podUID="5a7c6279-36c7-4ab4-8281-358f5a4fac04" containerName="main" containerID="cri-o://5eea72b27b6e3cee818ac41bec813ceb205e36473d6523e71e8e671bf9db0094" gracePeriod=45
Jul 07 14:45:41.652379 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.652350    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:45:41.696769 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.696711    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a7c6279-36c7-4ab4-8281-358f5a4fac04-tls-certs\") pod \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") "
Jul 07 14:45:41.696769 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.696745    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqt9z\" (UniqueName: \"kubernetes.io/projected/5a7c6279-36c7-4ab4-8281-358f5a4fac04-kube-api-access-fqt9z\") pod \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") "
Jul 07 14:45:41.696947 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.696771    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-model-cache\") pod \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") "
Jul 07 14:45:41.696947 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.696813    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-home\") pod \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") "
Jul 07 14:45:41.696947 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.696848    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-tmp-dir\") pod \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") "
Jul 07 14:45:41.696947 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.696869    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-dshm\") pod \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\" (UID: \"5a7c6279-36c7-4ab4-8281-358f5a4fac04\") "
Jul 07 14:45:41.697168 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.697044    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-model-cache" (OuterVolumeSpecName: "model-cache") pod "5a7c6279-36c7-4ab4-8281-358f5a4fac04" (UID: "5a7c6279-36c7-4ab4-8281-358f5a4fac04"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:45:41.697168 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.697150    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-home" (OuterVolumeSpecName: "home") pod "5a7c6279-36c7-4ab4-8281-358f5a4fac04" (UID: "5a7c6279-36c7-4ab4-8281-358f5a4fac04"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:45:41.697285 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.697264    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5a7c6279-36c7-4ab4-8281-358f5a4fac04" (UID: "5a7c6279-36c7-4ab4-8281-358f5a4fac04"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:45:41.699114 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.699089    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a7c6279-36c7-4ab4-8281-358f5a4fac04-kube-api-access-fqt9z" (OuterVolumeSpecName: "kube-api-access-fqt9z") pod "5a7c6279-36c7-4ab4-8281-358f5a4fac04" (UID: "5a7c6279-36c7-4ab4-8281-358f5a4fac04"). InnerVolumeSpecName "kube-api-access-fqt9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:45:41.699204 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.699121    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a7c6279-36c7-4ab4-8281-358f5a4fac04-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5a7c6279-36c7-4ab4-8281-358f5a4fac04" (UID: "5a7c6279-36c7-4ab4-8281-358f5a4fac04"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:45:41.699204 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.699141    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-dshm" (OuterVolumeSpecName: "dshm") pod "5a7c6279-36c7-4ab4-8281-358f5a4fac04" (UID: "5a7c6279-36c7-4ab4-8281-358f5a4fac04"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:45:41.797616 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.797590    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a7c6279-36c7-4ab4-8281-358f5a4fac04-tls-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:45:41.797616 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.797614    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqt9z\" (UniqueName: \"kubernetes.io/projected/5a7c6279-36c7-4ab4-8281-358f5a4fac04-kube-api-access-fqt9z\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:45:41.797768 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.797628    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-model-cache\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:45:41.797768 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.797640    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-home\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:45:41.797768 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.797673    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-tmp-dir\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:45:41.797768 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:41.797685    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a7c6279-36c7-4ab4-8281-358f5a4fac04-dshm\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:45:42.200622 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:42.200586    2557 generic.go:356] "Generic (PLEG): container finished" podID="5a7c6279-36c7-4ab4-8281-358f5a4fac04" containerID="5eea72b27b6e3cee818ac41bec813ceb205e36473d6523e71e8e671bf9db0094" exitCode=0
Jul 07 14:45:42.200807 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:42.200631    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"
Jul 07 14:45:42.200807 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:42.200658    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64" event={"ID":"5a7c6279-36c7-4ab4-8281-358f5a4fac04","Type":"ContainerDied","Data":"5eea72b27b6e3cee818ac41bec813ceb205e36473d6523e71e8e671bf9db0094"}
Jul 07 14:45:42.200807 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:42.200700    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64" event={"ID":"5a7c6279-36c7-4ab4-8281-358f5a4fac04","Type":"ContainerDied","Data":"29c80fdbc8a6a474043cfdc074f1131227e1b36490eb899c24b07dd063febb65"}
Jul 07 14:45:42.200807 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:42.200721    2557 scope.go:117] "RemoveContainer" containerID="5eea72b27b6e3cee818ac41bec813ceb205e36473d6523e71e8e671bf9db0094"
Jul 07 14:45:42.209917 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:42.209901    2557 scope.go:117] "RemoveContainer" containerID="5eea72b27b6e3cee818ac41bec813ceb205e36473d6523e71e8e671bf9db0094"
Jul 07 14:45:42.210140 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:45:42.210123    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eea72b27b6e3cee818ac41bec813ceb205e36473d6523e71e8e671bf9db0094\": container with ID starting with 5eea72b27b6e3cee818ac41bec813ceb205e36473d6523e71e8e671bf9db0094 not found: ID does not exist" containerID="5eea72b27b6e3cee818ac41bec813ceb205e36473d6523e71e8e671bf9db0094"
Jul 07 14:45:42.210191 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:42.210146    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eea72b27b6e3cee818ac41bec813ceb205e36473d6523e71e8e671bf9db0094"} err="failed to get container status \"5eea72b27b6e3cee818ac41bec813ceb205e36473d6523e71e8e671bf9db0094\": rpc error: code = NotFound desc = could not find container \"5eea72b27b6e3cee818ac41bec813ceb205e36473d6523e71e8e671bf9db0094\": container with ID starting with 5eea72b27b6e3cee818ac41bec813ceb205e36473d6523e71e8e671bf9db0094 not found: ID does not exist"
Jul 07 14:45:42.220868 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:42.220845    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"]
Jul 07 14:45:42.222931 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:42.222912    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/auth-test-model-cc2ffa-kserve-6956dbfc75-ptj64"]
Jul 07 14:45:43.117464 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:43.117436    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a7c6279-36c7-4ab4-8281-358f5a4fac04" path="/var/lib/kubelet/pods/5a7c6279-36c7-4ab4-8281-358f5a4fac04/volumes"
Jul 07 14:45:48.321255 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:48.321202    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:48.321650 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:48.321276    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:48.333525 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:48.333496    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:45:49.041686 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:49.041650    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:45:49.245852 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:45:49.245824    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:46:03.748284 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:03.748222    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:46:29.848544 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:29.848502    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:46:43.686840 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:43.686806    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"]
Jul 07 14:46:47.446569 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:47.446536    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:46:48.512984 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.512953    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"]
Jul 07 14:46:48.513472 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.513456    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a7c6279-36c7-4ab4-8281-358f5a4fac04" containerName="main"
Jul 07 14:46:48.513523 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.513476    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a7c6279-36c7-4ab4-8281-358f5a4fac04" containerName="main"
Jul 07 14:46:48.513580 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.513569    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a7c6279-36c7-4ab4-8281-358f5a4fac04" containerName="main"
Jul 07 14:46:48.516567 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.516548    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.519150 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.519129    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-cc2ffa\"/\"rate-test-model-cc2ffa-kserve-self-signed-certs\""
Jul 07 14:46:48.526424 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.526403    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"]
Jul 07 14:46:48.537139 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.537118    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4db66\" (UniqueName: \"kubernetes.io/projected/30482aff-8776-4bd0-97f8-e45f65d521f8-kube-api-access-4db66\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.537258 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.537146    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-dshm\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.537258 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.537172    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-tmp-dir\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.537258 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.537249    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30482aff-8776-4bd0-97f8-e45f65d521f8-tls-certs\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.537382 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.537288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-home\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.537382 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.537329    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-model-cache\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.638124 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.638094    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-model-cache\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.638286 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.638147    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4db66\" (UniqueName: \"kubernetes.io/projected/30482aff-8776-4bd0-97f8-e45f65d521f8-kube-api-access-4db66\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.638286 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.638273    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-dshm\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.638393 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.638336    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-tmp-dir\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.638393 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.638378    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30482aff-8776-4bd0-97f8-e45f65d521f8-tls-certs\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.638498 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.638429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-home\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.638594 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.638573    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-model-cache\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.638687 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.638666    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-tmp-dir\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.638781 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.638709    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-home\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.640436 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.640418    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-dshm\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.640741 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.640722    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30482aff-8776-4bd0-97f8-e45f65d521f8-tls-certs\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.645674 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.645652    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4db66\" (UniqueName: \"kubernetes.io/projected/30482aff-8776-4bd0-97f8-e45f65d521f8-kube-api-access-4db66\") pod \"rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") " pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.825459 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.825429    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:48.954845 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:48.954813    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"]
Jul 07 14:46:48.956794 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:46:48.956753    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30482aff_8776_4bd0_97f8_e45f65d521f8.slice/crio-116eff88c54c5e09ab1c4aeb2247646e73b7a38ec0a6479a74392987b7d3189e WatchSource:0}: Error finding container 116eff88c54c5e09ab1c4aeb2247646e73b7a38ec0a6479a74392987b7d3189e: Status 404 returned error can't find the container with id 116eff88c54c5e09ab1c4aeb2247646e73b7a38ec0a6479a74392987b7d3189e
Jul 07 14:46:49.525099 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:49.525063    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24" event={"ID":"30482aff-8776-4bd0-97f8-e45f65d521f8","Type":"ContainerStarted","Data":"dc82c1024dd82686e023d816c6e1f90bd6030cffedc24890ad59de7f322c9cbc"}
Jul 07 14:46:49.525099 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:49.525104    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24" event={"ID":"30482aff-8776-4bd0-97f8-e45f65d521f8","Type":"ContainerStarted","Data":"116eff88c54c5e09ab1c4aeb2247646e73b7a38ec0a6479a74392987b7d3189e"}
Jul 07 14:46:49.541903 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:49.541860    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24" podStartSLOduration=1.541845109 podStartE2EDuration="1.541845109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:46:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:46:49.540860374 +0000 UTC m=+2398.903183557" watchObservedRunningTime="2026-07-07 14:46:49.541845109 +0000 UTC m=+2398.904168275"
Jul 07 14:46:58.706976 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:58.706931    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b" podUID="4094670e-232a-4fb3-8f08-6644c44af34e" containerName="main" containerID="cri-o://41e5773e25b5389fbe2e9848251afcde5a3ce02e9a47c736569c2b73b5dd8b5e" gracePeriod=45
Jul 07 14:46:58.826315 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:58.826285    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:58.826315 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:58.826332    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:58.839386 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:58.839348    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:58.968402 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:58.968331    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:46:59.026879 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.026835    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-tmp-dir\") pod \"4094670e-232a-4fb3-8f08-6644c44af34e\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") "
Jul 07 14:46:59.027074 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.026936    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-home\") pod \"4094670e-232a-4fb3-8f08-6644c44af34e\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") "
Jul 07 14:46:59.027074 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.027014    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-555vs\" (UniqueName: \"kubernetes.io/projected/4094670e-232a-4fb3-8f08-6644c44af34e-kube-api-access-555vs\") pod \"4094670e-232a-4fb3-8f08-6644c44af34e\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") "
Jul 07 14:46:59.027194 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.027090    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4094670e-232a-4fb3-8f08-6644c44af34e-tls-certs\") pod \"4094670e-232a-4fb3-8f08-6644c44af34e\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") "
Jul 07 14:46:59.027194 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.027091    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-home" (OuterVolumeSpecName: "home") pod "4094670e-232a-4fb3-8f08-6644c44af34e" (UID: "4094670e-232a-4fb3-8f08-6644c44af34e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:46:59.027194 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.027132    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-dshm\") pod \"4094670e-232a-4fb3-8f08-6644c44af34e\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") "
Jul 07 14:46:59.027194 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.027134    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4094670e-232a-4fb3-8f08-6644c44af34e" (UID: "4094670e-232a-4fb3-8f08-6644c44af34e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:46:59.027194 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.027190    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-model-cache\") pod \"4094670e-232a-4fb3-8f08-6644c44af34e\" (UID: \"4094670e-232a-4fb3-8f08-6644c44af34e\") "
Jul 07 14:46:59.027473 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.027446    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-model-cache" (OuterVolumeSpecName: "model-cache") pod "4094670e-232a-4fb3-8f08-6644c44af34e" (UID: "4094670e-232a-4fb3-8f08-6644c44af34e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:46:59.027529 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.027503    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-tmp-dir\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:46:59.027529 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.027515    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-home\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:46:59.027529 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.027522    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-model-cache\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:46:59.029185 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.029157    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-dshm" (OuterVolumeSpecName: "dshm") pod "4094670e-232a-4fb3-8f08-6644c44af34e" (UID: "4094670e-232a-4fb3-8f08-6644c44af34e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:46:59.029185 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.029178    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4094670e-232a-4fb3-8f08-6644c44af34e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4094670e-232a-4fb3-8f08-6644c44af34e" (UID: "4094670e-232a-4fb3-8f08-6644c44af34e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:46:59.029361 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.029217    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4094670e-232a-4fb3-8f08-6644c44af34e-kube-api-access-555vs" (OuterVolumeSpecName: "kube-api-access-555vs") pod "4094670e-232a-4fb3-8f08-6644c44af34e" (UID: "4094670e-232a-4fb3-8f08-6644c44af34e"). InnerVolumeSpecName "kube-api-access-555vs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:46:59.128540 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.128517    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4094670e-232a-4fb3-8f08-6644c44af34e-tls-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:46:59.128540 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.128539    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4094670e-232a-4fb3-8f08-6644c44af34e-dshm\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:46:59.128700 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.128548    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-555vs\" (UniqueName: \"kubernetes.io/projected/4094670e-232a-4fb3-8f08-6644c44af34e-kube-api-access-555vs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:46:59.581132 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.581097    2557 generic.go:356] "Generic (PLEG): container finished" podID="4094670e-232a-4fb3-8f08-6644c44af34e" containerID="41e5773e25b5389fbe2e9848251afcde5a3ce02e9a47c736569c2b73b5dd8b5e" exitCode=0
Jul 07 14:46:59.581335 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.581142    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"
Jul 07 14:46:59.581335 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.581187    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b" event={"ID":"4094670e-232a-4fb3-8f08-6644c44af34e","Type":"ContainerDied","Data":"41e5773e25b5389fbe2e9848251afcde5a3ce02e9a47c736569c2b73b5dd8b5e"}
Jul 07 14:46:59.581335 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.581239    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b" event={"ID":"4094670e-232a-4fb3-8f08-6644c44af34e","Type":"ContainerDied","Data":"bb5c4fbcbb8202600114e744dee12cc700a4f4211eb775fefe9bb82030bb082f"}
Jul 07 14:46:59.581335 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.581257    2557 scope.go:117] "RemoveContainer" containerID="41e5773e25b5389fbe2e9848251afcde5a3ce02e9a47c736569c2b73b5dd8b5e"
Jul 07 14:46:59.589794 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.589773    2557 scope.go:117] "RemoveContainer" containerID="41e5773e25b5389fbe2e9848251afcde5a3ce02e9a47c736569c2b73b5dd8b5e"
Jul 07 14:46:59.590107 ip-10-0-133-139 kubenswrapper[2557]: E0707 14:46:59.590087    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41e5773e25b5389fbe2e9848251afcde5a3ce02e9a47c736569c2b73b5dd8b5e\": container with ID starting with 41e5773e25b5389fbe2e9848251afcde5a3ce02e9a47c736569c2b73b5dd8b5e not found: ID does not exist" containerID="41e5773e25b5389fbe2e9848251afcde5a3ce02e9a47c736569c2b73b5dd8b5e"
Jul 07 14:46:59.590184 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.590117    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41e5773e25b5389fbe2e9848251afcde5a3ce02e9a47c736569c2b73b5dd8b5e"} err="failed to get container status \"41e5773e25b5389fbe2e9848251afcde5a3ce02e9a47c736569c2b73b5dd8b5e\": rpc error: code = NotFound desc = could not find container \"41e5773e25b5389fbe2e9848251afcde5a3ce02e9a47c736569c2b73b5dd8b5e\": container with ID starting with 41e5773e25b5389fbe2e9848251afcde5a3ce02e9a47c736569c2b73b5dd8b5e not found: ID does not exist"
Jul 07 14:46:59.593534 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.593517    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:46:59.598617 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.598594    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"]
Jul 07 14:46:59.604109 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:46:59.604086    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/sub-test-model-cc2ffa-kserve-597bdbdcf7-7xh4b"]
Jul 07 14:47:01.117327 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:47:01.117297    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4094670e-232a-4fb3-8f08-6644c44af34e" path="/var/lib/kubelet/pods/4094670e-232a-4fb3-8f08-6644c44af34e/volumes"
Jul 07 14:47:02.043244 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:47:02.043206    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:47:15.651058 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:47:15.650971    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:47:29.840863 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:47:29.840827    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:47:47.640162 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:47:47.640127    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:47:51.688111 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:47:51.688033    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"]
Jul 07 14:48:03.739431 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:03.739392    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:48:06.710855 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:06.710797    2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24" podUID="30482aff-8776-4bd0-97f8-e45f65d521f8" containerName="main" containerID="cri-o://dc82c1024dd82686e023d816c6e1f90bd6030cffedc24890ad59de7f322c9cbc" gracePeriod=45
Jul 07 14:48:06.900192 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:06.900157    2557 generic.go:356] "Generic (PLEG): container finished" podID="30482aff-8776-4bd0-97f8-e45f65d521f8" containerID="dc82c1024dd82686e023d816c6e1f90bd6030cffedc24890ad59de7f322c9cbc" exitCode=0
Jul 07 14:48:06.900370 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:06.900288    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24" event={"ID":"30482aff-8776-4bd0-97f8-e45f65d521f8","Type":"ContainerDied","Data":"dc82c1024dd82686e023d816c6e1f90bd6030cffedc24890ad59de7f322c9cbc"}
Jul 07 14:48:06.963547 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:06.963493    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:48:07.002355 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.002328    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30482aff-8776-4bd0-97f8-e45f65d521f8-tls-certs\") pod \"30482aff-8776-4bd0-97f8-e45f65d521f8\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") "
Jul 07 14:48:07.002501 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.002363    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-tmp-dir\") pod \"30482aff-8776-4bd0-97f8-e45f65d521f8\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") "
Jul 07 14:48:07.002501 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.002386    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-model-cache\") pod \"30482aff-8776-4bd0-97f8-e45f65d521f8\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") "
Jul 07 14:48:07.002501 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.002410    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-home\") pod \"30482aff-8776-4bd0-97f8-e45f65d521f8\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") "
Jul 07 14:48:07.002501 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.002436    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4db66\" (UniqueName: \"kubernetes.io/projected/30482aff-8776-4bd0-97f8-e45f65d521f8-kube-api-access-4db66\") pod \"30482aff-8776-4bd0-97f8-e45f65d521f8\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") "
Jul 07 14:48:07.002501 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.002449    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-dshm\") pod \"30482aff-8776-4bd0-97f8-e45f65d521f8\" (UID: \"30482aff-8776-4bd0-97f8-e45f65d521f8\") "
Jul 07 14:48:07.002791 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.002605    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "30482aff-8776-4bd0-97f8-e45f65d521f8" (UID: "30482aff-8776-4bd0-97f8-e45f65d521f8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:07.002791 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.002635    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-model-cache" (OuterVolumeSpecName: "model-cache") pod "30482aff-8776-4bd0-97f8-e45f65d521f8" (UID: "30482aff-8776-4bd0-97f8-e45f65d521f8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:07.002791 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.002723    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-home" (OuterVolumeSpecName: "home") pod "30482aff-8776-4bd0-97f8-e45f65d521f8" (UID: "30482aff-8776-4bd0-97f8-e45f65d521f8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:07.002791 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.002738    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-tmp-dir\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:48:07.002791 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.002753    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-model-cache\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:48:07.004508 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.004483    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30482aff-8776-4bd0-97f8-e45f65d521f8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "30482aff-8776-4bd0-97f8-e45f65d521f8" (UID: "30482aff-8776-4bd0-97f8-e45f65d521f8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:48:07.004632 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.004609    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-dshm" (OuterVolumeSpecName: "dshm") pod "30482aff-8776-4bd0-97f8-e45f65d521f8" (UID: "30482aff-8776-4bd0-97f8-e45f65d521f8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:48:07.004706 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.004638    2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30482aff-8776-4bd0-97f8-e45f65d521f8-kube-api-access-4db66" (OuterVolumeSpecName: "kube-api-access-4db66") pod "30482aff-8776-4bd0-97f8-e45f65d521f8" (UID: "30482aff-8776-4bd0-97f8-e45f65d521f8"). InnerVolumeSpecName "kube-api-access-4db66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:48:07.103352 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.103325    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4db66\" (UniqueName: \"kubernetes.io/projected/30482aff-8776-4bd0-97f8-e45f65d521f8-kube-api-access-4db66\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:48:07.103352 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.103349    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-dshm\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:48:07.103513 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.103362    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30482aff-8776-4bd0-97f8-e45f65d521f8-tls-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:48:07.103513 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.103371    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30482aff-8776-4bd0-97f8-e45f65d521f8-home\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 14:48:07.906011 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.905983    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"
Jul 07 14:48:07.906433 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.905978    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24" event={"ID":"30482aff-8776-4bd0-97f8-e45f65d521f8","Type":"ContainerDied","Data":"116eff88c54c5e09ab1c4aeb2247646e73b7a38ec0a6479a74392987b7d3189e"}
Jul 07 14:48:07.906433 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.906110    2557 scope.go:117] "RemoveContainer" containerID="dc82c1024dd82686e023d816c6e1f90bd6030cffedc24890ad59de7f322c9cbc"
Jul 07 14:48:07.922217 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.922193    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"]
Jul 07 14:48:07.925378 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:07.925355    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-cc2ffa/rate-test-model-cc2ffa-kserve-56b9c688dc-jpr24"]
Jul 07 14:48:09.117776 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:09.117744    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30482aff-8776-4bd0-97f8-e45f65d521f8" path="/var/lib/kubelet/pods/30482aff-8776-4bd0-97f8-e45f65d521f8/volumes"
Jul 07 14:48:39.044657 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:39.044620    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kbls6"]
Jul 07 14:48:43.896039 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:43.895956    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7555bfcf78-cbj5x_902d620f-3d07-428f-b164-f106cda5c273/authorino/0.log"
Jul 07 14:48:48.581016 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:48.580983    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lbb7r_3bb224bf-cd7a-476a-b30a-2b9207e15c0c/manager/0.log"
Jul 07 14:48:48.711298 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:48.711262    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-nk582_0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03/manager/0.log"
Jul 07 14:48:49.374801 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:49.374771    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ggb46_c52600f7-3d3c-4157-a337-3af9d64781e9/server/0.log"
Jul 07 14:48:49.488852 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:49.488818    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9xbjv_53f188b2-31dd-4ff0-9113-0115211425ce/manager/0.log"
Jul 07 14:48:49.732883 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:49.732807    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55dcd65d78-c9lf4_397f85ae-abb0-46a5-bbb3-af5e6586f59a/copy-manifests/0.log"
Jul 07 14:48:49.746275 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:49.746252    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55dcd65d78-c9lf4_397f85ae-abb0-46a5-bbb3-af5e6586f59a/manager/0.log"
Jul 07 14:48:51.279999 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:51.279970    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7555bfcf78-cbj5x_902d620f-3d07-428f-b164-f106cda5c273/authorino/0.log"
Jul 07 14:48:51.398271 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:51.398222    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-h45t2_3863f54e-3835-42c2-9bd0-77056e1847b2/manager/0.log"
Jul 07 14:48:51.505866 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:51.505836    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wftvg_a190aeed-32e9-4741-a1be-86b4dea2dc37/manager/0.log"
Jul 07 14:48:51.615070 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:51.615045    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2k6qc_13a2718f-3b7c-422e-8aff-bf6924646a91/kuadrant-console-plugin/0.log"
Jul 07 14:48:51.729247 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:51.729213    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pt6rj_4085c432-3a99-4779-bae0-1eb98d19c2f5/registry-server/0.log"
Jul 07 14:48:51.953069 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:51.952997    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kbls6_868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0/limitador/0.log"
Jul 07 14:48:52.065590 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:52.065565    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-w6cq8_d191e1e1-ef33-4335-9378-ee99663ed828/manager/0.log"
Jul 07 14:48:52.406902 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:52.406874    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf462jcp_b8cf52e3-e469-407d-b9db-5f416d7e953f/istio-proxy/0.log"
Jul 07 14:48:52.630291 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:52.630258    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769bbd759d-4kzfq_99679e7e-647a-482d-9b71-d1ae8cff966a/kube-auth-proxy/0.log"
Jul 07 14:48:52.856645 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:52.856615    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zglr5_317e8963-c493-4237-94c3-a2b1e1e797e4/istio-proxy/1.log"
Jul 07 14:48:53.764828 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:53.764799    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-z9p5n_40e21e2e-a67f-47f8-9ba7-ba69519b7c9b/main/0.log"
Jul 07 14:48:54.097422 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:48:54.097397    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-gxjc4_370caf24-f063-434f-914c-d77b7fa2e7e5/main/0.log"
Jul 07 14:49:01.437621 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:01.437590    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wrlhh_c661b77e-fb49-41fc-97ae-243728ee2c39/global-pull-secret-syncer/0.log"
Jul 07 14:49:01.544576 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:01.544542    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k2zhl_90a5edcc-b022-470d-9537-5a969feb1153/konnectivity-agent/0.log"
Jul 07 14:49:01.631606 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:01.631580    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-139.ec2.internal_098c8f1e1bab8bfb614b320b9ae089b4/haproxy/0.log"
Jul 07 14:49:07.732702 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:07.732670    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7555bfcf78-cbj5x_902d620f-3d07-428f-b164-f106cda5c273/authorino/0.log"
Jul 07 14:49:07.771210 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:07.771182    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-h45t2_3863f54e-3835-42c2-9bd0-77056e1847b2/manager/0.log"
Jul 07 14:49:07.811779 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:07.811750    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wftvg_a190aeed-32e9-4741-a1be-86b4dea2dc37/manager/0.log"
Jul 07 14:49:07.831836 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:07.831815    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2k6qc_13a2718f-3b7c-422e-8aff-bf6924646a91/kuadrant-console-plugin/0.log"
Jul 07 14:49:07.867363 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:07.867325    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pt6rj_4085c432-3a99-4779-bae0-1eb98d19c2f5/registry-server/0.log"
Jul 07 14:49:07.986785 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:07.986710    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kbls6_868c5fb0-a6c6-4d76-bbf2-6c7bf81d8bc0/limitador/0.log"
Jul 07 14:49:08.056690 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:08.056661    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-w6cq8_d191e1e1-ef33-4335-9378-ee99663ed828/manager/0.log"
Jul 07 14:49:10.146331 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:10.146307    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzhhq_19c7dd19-c21e-4d43-9f24-029e41e0766b/node-exporter/0.log"
Jul 07 14:49:10.167132 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:10.167112    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzhhq_19c7dd19-c21e-4d43-9f24-029e41e0766b/kube-rbac-proxy/0.log"
Jul 07 14:49:10.199701 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:10.199683    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzhhq_19c7dd19-c21e-4d43-9f24-029e41e0766b/init-textfile/0.log"
Jul 07 14:49:11.843290 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.843256    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"]
Jul 07 14:49:11.843680 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.843633    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30482aff-8776-4bd0-97f8-e45f65d521f8" containerName="main"
Jul 07 14:49:11.843680 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.843646    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="30482aff-8776-4bd0-97f8-e45f65d521f8" containerName="main"
Jul 07 14:49:11.843680 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.843660    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4094670e-232a-4fb3-8f08-6644c44af34e" containerName="main"
Jul 07 14:49:11.843680 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.843666    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4094670e-232a-4fb3-8f08-6644c44af34e" containerName="main"
Jul 07 14:49:11.843861 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.843723    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="30482aff-8776-4bd0-97f8-e45f65d521f8" containerName="main"
Jul 07 14:49:11.843861 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.843732    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4094670e-232a-4fb3-8f08-6644c44af34e" containerName="main"
Jul 07 14:49:11.846603 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.846587    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:11.849179 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.849158    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tp4qk\"/\"kube-root-ca.crt\""
Jul 07 14:49:11.850280 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.850257    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tp4qk\"/\"openshift-service-ca.crt\""
Jul 07 14:49:11.850418 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.850277    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tp4qk\"/\"default-dockercfg-rzd2q\""
Jul 07 14:49:11.852489 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.852470    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"]
Jul 07 14:49:11.936586 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.936547    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c4fb55f-0486-4995-9f7f-9966e253b5ac-lib-modules\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:11.936586 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.936586    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0c4fb55f-0486-4995-9f7f-9966e253b5ac-proc\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:11.936811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.936672    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c4fb55f-0486-4995-9f7f-9966e253b5ac-sys\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:11.936811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.936712    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hd2p\" (UniqueName: \"kubernetes.io/projected/0c4fb55f-0486-4995-9f7f-9966e253b5ac-kube-api-access-5hd2p\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:11.936811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:11.936734    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0c4fb55f-0486-4995-9f7f-9966e253b5ac-podres\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:12.037594 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:12.037543    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c4fb55f-0486-4995-9f7f-9966e253b5ac-lib-modules\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:12.037594 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:12.037600    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0c4fb55f-0486-4995-9f7f-9966e253b5ac-proc\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:12.037811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:12.037646    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c4fb55f-0486-4995-9f7f-9966e253b5ac-sys\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:12.037811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:12.037679    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hd2p\" (UniqueName: \"kubernetes.io/projected/0c4fb55f-0486-4995-9f7f-9966e253b5ac-kube-api-access-5hd2p\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:12.037811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:12.037687    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c4fb55f-0486-4995-9f7f-9966e253b5ac-lib-modules\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:12.037811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:12.037710    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0c4fb55f-0486-4995-9f7f-9966e253b5ac-podres\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:12.037811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:12.037721    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0c4fb55f-0486-4995-9f7f-9966e253b5ac-proc\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:12.037811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:12.037732    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c4fb55f-0486-4995-9f7f-9966e253b5ac-sys\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:12.037811 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:12.037810    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0c4fb55f-0486-4995-9f7f-9966e253b5ac-podres\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:12.045555 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:12.045532    2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hd2p\" (UniqueName: \"kubernetes.io/projected/0c4fb55f-0486-4995-9f7f-9966e253b5ac-kube-api-access-5hd2p\") pod \"perf-node-gather-daemonset-jxrkq\" (UID: \"0c4fb55f-0486-4995-9f7f-9966e253b5ac\") " pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:12.157982 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:12.157901    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:12.284720 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:12.284676    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"]
Jul 07 14:49:12.288667 ip-10-0-133-139 kubenswrapper[2557]: W0707 14:49:12.288638    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0c4fb55f_0486_4995_9f7f_9966e253b5ac.slice/crio-42f5bb5bb35dc35603ca8a3ed6471b1a6b893b6a44cfd9f123781ab92ad962e1 WatchSource:0}: Error finding container 42f5bb5bb35dc35603ca8a3ed6471b1a6b893b6a44cfd9f123781ab92ad962e1: Status 404 returned error can't find the container with id 42f5bb5bb35dc35603ca8a3ed6471b1a6b893b6a44cfd9f123781ab92ad962e1
Jul 07 14:49:13.199541 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:13.199506    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq" event={"ID":"0c4fb55f-0486-4995-9f7f-9966e253b5ac","Type":"ContainerStarted","Data":"b298a5c148d1c038e2c36807cff38529546615c8352c1c21fc1df304f6eeff4f"}
Jul 07 14:49:13.199962 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:13.199566    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq" event={"ID":"0c4fb55f-0486-4995-9f7f-9966e253b5ac","Type":"ContainerStarted","Data":"42f5bb5bb35dc35603ca8a3ed6471b1a6b893b6a44cfd9f123781ab92ad962e1"}
Jul 07 14:49:13.199962 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:13.199595    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:13.215798 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:13.215750    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq" podStartSLOduration=2.215733617 podStartE2EDuration="2.215733617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:49:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:49:13.213619593 +0000 UTC m=+2542.575942759" watchObservedRunningTime="2026-07-07 14:49:13.215733617 +0000 UTC m=+2542.578056785"
Jul 07 14:49:14.779985 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:14.779962    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fqnhj_fab96c66-1f3e-4e40-8933-ca91fa651627/dns/0.log"
Jul 07 14:49:14.801471 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:14.801445    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fqnhj_fab96c66-1f3e-4e40-8933-ca91fa651627/kube-rbac-proxy/0.log"
Jul 07 14:49:14.914692 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:14.914660    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dnfwh_0565009f-db88-49d2-84e8-de0653188d27/dns-node-resolver/0.log"
Jul 07 14:49:15.505042 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:15.505011    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lj45b_d25dc2c0-12a6-4c21-b56e-6a681deaba83/node-ca/0.log"
Jul 07 14:49:16.439808 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:16.439775    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf462jcp_b8cf52e3-e469-407d-b9db-5f416d7e953f/istio-proxy/0.log"
Jul 07 14:49:16.566121 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:16.566092    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769bbd759d-4kzfq_99679e7e-647a-482d-9b71-d1ae8cff966a/kube-auth-proxy/0.log"
Jul 07 14:49:16.635673 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:16.635647    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zglr5_317e8963-c493-4237-94c3-a2b1e1e797e4/istio-proxy/0.log"
Jul 07 14:49:16.663042 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:16.663019    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zglr5_317e8963-c493-4237-94c3-a2b1e1e797e4/istio-proxy/1.log"
Jul 07 14:49:17.545842 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:17.545811    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pmztk_7375d1d7-35a7-436f-ae17-b9b7c13761a1/serve-healthcheck-canary/0.log"
Jul 07 14:49:18.191953 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:18.191925    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbrjm_2730dc18-8aec-409b-8cb4-5db3428eba75/kube-rbac-proxy/0.log"
Jul 07 14:49:18.212210 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:18.212183    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbrjm_2730dc18-8aec-409b-8cb4-5db3428eba75/exporter/0.log"
Jul 07 14:49:18.231951 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:18.231928    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbrjm_2730dc18-8aec-409b-8cb4-5db3428eba75/extractor/0.log"
Jul 07 14:49:19.214431 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:19.214405    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tp4qk/perf-node-gather-daemonset-jxrkq"
Jul 07 14:49:20.350216 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:20.350191    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lbb7r_3bb224bf-cd7a-476a-b30a-2b9207e15c0c/manager/0.log"
Jul 07 14:49:20.475214 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:20.475179    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-nk582_0ce18c26-f7ff-4e8a-b2c4-e36f66ee3a03/manager/0.log"
Jul 07 14:49:20.735955 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:20.735878    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ggb46_c52600f7-3d3c-4157-a337-3af9d64781e9/server/0.log"
Jul 07 14:49:20.798190 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:20.798153    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9xbjv_53f188b2-31dd-4ff0-9113-0115211425ce/manager/0.log"
Jul 07 14:49:20.921551 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:20.921514    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55dcd65d78-c9lf4_397f85ae-abb0-46a5-bbb3-af5e6586f59a/manager/0.log"
Jul 07 14:49:20.937885 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:20.937860    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-55dcd65d78-c9lf4_397f85ae-abb0-46a5-bbb3-af5e6586f59a/copy-manifests/0.log"
Jul 07 14:49:22.490267 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:22.490222    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf462jcp_b8cf52e3-e469-407d-b9db-5f416d7e953f/istio-proxy/0.log"
Jul 07 14:49:22.597699 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:22.597677    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769bbd759d-4kzfq_99679e7e-647a-482d-9b71-d1ae8cff966a/kube-auth-proxy/0.log"
Jul 07 14:49:22.631460 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:22.631432    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zglr5_317e8963-c493-4237-94c3-a2b1e1e797e4/istio-proxy/0.log"
Jul 07 14:49:22.658194 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:22.658149    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zglr5_317e8963-c493-4237-94c3-a2b1e1e797e4/istio-proxy/1.log"
Jul 07 14:49:23.989871 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:23.989838    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf462jcp_b8cf52e3-e469-407d-b9db-5f416d7e953f/istio-proxy/0.log"
Jul 07 14:49:24.108135 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:24.108109    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-769bbd759d-4kzfq_99679e7e-647a-482d-9b71-d1ae8cff966a/kube-auth-proxy/0.log"
Jul 07 14:49:24.139740 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:24.139718    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zglr5_317e8963-c493-4237-94c3-a2b1e1e797e4/istio-proxy/0.log"
Jul 07 14:49:24.172375 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:24.172345    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-zglr5_317e8963-c493-4237-94c3-a2b1e1e797e4/istio-proxy/1.log"
Jul 07 14:49:28.857557 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:28.857527    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2jst6_e6552b16-7e6c-4380-85bb-2a30850f511f/kube-multus-additional-cni-plugins/0.log"
Jul 07 14:49:28.875784 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:28.875754    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2jst6_e6552b16-7e6c-4380-85bb-2a30850f511f/egress-router-binary-copy/0.log"
Jul 07 14:49:28.895028 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:28.895003    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2jst6_e6552b16-7e6c-4380-85bb-2a30850f511f/cni-plugins/0.log"
Jul 07 14:49:28.914589 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:28.914562    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2jst6_e6552b16-7e6c-4380-85bb-2a30850f511f/bond-cni-plugin/0.log"
Jul 07 14:49:28.932308 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:28.932282    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2jst6_e6552b16-7e6c-4380-85bb-2a30850f511f/routeoverride-cni/0.log"
Jul 07 14:49:28.950443 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:28.950423    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2jst6_e6552b16-7e6c-4380-85bb-2a30850f511f/whereabouts-cni-bincopy/0.log"
Jul 07 14:49:28.967976 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:28.967959    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2jst6_e6552b16-7e6c-4380-85bb-2a30850f511f/whereabouts-cni/0.log"
Jul 07 14:49:29.319070 ip-10-0-133-139 kubenswrapper[2557]: I0707 14:49:29.319048    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-z7qgr_7d4112bf-a5ba-493d-bcab-1e1b7b1c913b/kube-multus/0.log"